Data Pipeline ArchitectVeca Consulting Pvt Ltd • Bengaluru, Republic Of India, IN
Data Pipeline Architect
Veca Consulting Pvt Ltd • Bengaluru, Republic Of India, IN
13 days ago
Job descriptionProficiency in Hadoop ecosystems such as Spark, HDFS, Hive, Iceberg, Spark SQL. Extensive experience with Apache Kafka, Apache Flink, and other relevant streaming technologies. Proven ability to design and implement automated data pipelines and materialized views. Proficiency in Python, Unix or similar languages. Good understanding of SQL oracle, SQL server or similar languages. Ops & CI / CD : Monitoring (Prometheus / Grafana), logging, pipelines (Jenkins / GitHub Actions). Core Engineering : Data structures / algorithms, testing (JUnit / pytest), Git, clean code. 5+ years of directly applicable experience BS in Computer Science, Engineering, or equivalent experience.
Role Name : Data Engineer
Experience : 3+ Years
Location : Bangalore(No relocation)
Notice Period : 20-30 days(who are currently serving)
Mode : Hybrid
Type : Fulltime
Job Description :
As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This is a hands-on role focused on building, optimizing, and maintaining large data pipelines and warehouse infrastructure.
Key Responsibilities
- Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
- Implement data ETL processes for batch and streaming analytics requirements.
- Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
- Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
- Ensure data security, integrity, and compliance throughout the infrastructure.
- Maintain documentation and contribute to architecture reviews.
- Participate in incident response and operational excellence initiatives for the data warehouse.
- Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.
Required Skills and Experience
Create a job alert for this search
Data Pipeline Architect • Bengaluru, Republic Of India, IN
Related jobs
Data Pipeline Architect
NAM Info Inc • Bengaluru, Republic Of India, IN
Please find the below Job description.IF this is of your interest kindly share the resume along with contact details and the current CTC and expected CTC and send it to.
Note : Immediate Joiners and...Show more
Last updated: 10 days ago • Promoted
Cloud Integration & Data Pipeline Architect
Impelsys • Bengaluru, Republic Of India, IN
Job Title : Technical Architect / Delivery Lead.Walk-in Drive : 27th November, 2025.IWF Campus, Whitefield Main Road, B Narayanapura, Mahadevapura, Bengaluru, Karnataka 560048.As a Technical Architec...Show more
Last updated: 4 days ago • Promoted
Data Pipeline Architect
ANSR • Bengaluru, Republic Of India, IN
To Care for People on Life's Journey®.Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in more than 60 countries.American Airlin...Show more
Last updated: 20 days ago • Promoted
Lead Data Pipeline Architect (On-Premise Focus)
Blend • Bengaluru, Republic Of India, IN
Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client.
This role is part of a strategic initiative to enable ro...Show more
Last updated: 2 days ago • Promoted
Databricks Data Architect
Tata Consultancy Services • Bengaluru, Karnataka, India
Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e.
Docker, Kubernetes) for deploying data workflows.Should be able ...Show more
Last updated: 23 days ago • Promoted
Data Pipeline Architect (Bangalore)
Acme Services • Bengaluru, Republic Of India, IN
Design, develop, and maintain scalable and robust data pipelines (ETL / ELT) using PySpark on the Databricks platform.Implement data ingestion strategies to load data from various sources (e.APIs, da...Show more
Last updated: 5 days ago • Promoted
Data Pipeline Architect
Teamware Solutions • Bengaluru, Republic Of India, IN
Teamware Solutions a division of Quantum Leap Consulting Pvt.We have the below requirement for one of the reputed MNC for Bangalore location and require immediate joiners for the same.Required Skil...Show more
Last updated: 3 hours ago • Promoted • New!
Lead Data Pipeline Architect
SPIRO • Bengaluru, Republic Of India, IN
We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies.
The ideal candidate will have over five years of hands-on experience designi...Show more
Last updated: 19 hours ago • Promoted • New!
Data Architect
Andela • Bengaluru, IN
Andela exists to connect brilliance and opportunity.Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations ...Show more
Last updated: 9 days ago • Promoted
Data Pipeline Architect
Atyeti Inc • Bengaluru, Republic Of India, IN
Proficient with Python, PySpark and Airflow.Strong understanding of Object-Oriented Programming and Functional Programming paradigm.
Must have experience working with Spark and its architecture.Know...Show more
Last updated: 7 days ago • Promoted
AWS Data Architect
ACL Digital • Bengaluru, IN
AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices.
.AWS Certified Solutions Architect preferred.Show more
Last updated: 14 days ago • Promoted
Data Pipeline Architect
Sigmoid • Bengaluru, Republic Of India, IN
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team.You will be responsible for designing, implementing, and maintaining data pipelines to support our organization'...Show more
Last updated: 21 days ago • Promoted
Data Pipeline Architect
Relevance Lab • Bengaluru, Republic Of India, IN
SQL skills and hands-on experience using.AI-assisted development tools).The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, supporting analytics worklo...Show more
Last updated: 5 days ago • Promoted
Data Pipeline Architect
Tech Mahindra • Bengaluru, Republic Of India, IN
W are hiring Data Engineers, 4-9 years experience with below mandatory Skills.Job Location : Pan India ( Tech M Location).
Azure Databricks, ETL, Pyspark & SQL, Medallion architecture.Data bricks ce...Show more
Last updated: 5 days ago • Promoted
Senior Data Pipeline Architect
PriceEasy AI • Bengaluru, Republic Of India, IN
Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advan...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
ACL Digital • Bengaluru, Republic Of India, IN
GCP – Firestore, Google Cloud Storage, Cloud Build,BigQuery.Nutter Framework – Experience in writing unit test in Nutter Framework.Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
Alp Consulting Ltd. • Bengaluru, Republic Of India, IN
Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
Tata Consultancy Services • Bengaluru, Republic Of India, IN
Role : Data Engineer with Mandatory Pyspark Knowledge.Required Technical Skill Set : Python, Pyspark, BigQuery.Desired Experience Range : 5+ yrs.
Location : Bangalore, Pune, Chennai, Gurugram.Desired Co...Show more
Last updated: 30+ days ago • Promoted