Data Pipeline Architect
BlendHyderabad, Republic Of India, IN6 days ago
Job descriptionBachelor's or master's degree in computer science, Engineering, or a related field. 8+ years of hands-on experience in data engineering , with at least 3 years working with AWS Databricks . Strong programming skills in Python for data processing and automation. Advanced proficiency in SQL for querying and transforming large datasets. Deep experience with Apache Spark / PySpark in a distributed computing environment. Solid understanding of data modelling, warehousing, and performance optimization techniques. Proficiency with AWS services such as Glue , S3 , Lambda and EMR . Experience with version control Git or Code commit Experience in any workflow orchestration like Airflow, AWS Step functions is a plus. Excellent communication and stakeholder management skills with a strategic mindset.
We are looking for an experienced Data Engineering Manager with a strong foundation in Python, SQL, and Spark , and hands-on expertise in AWS, Databricks . In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives. You’ll work closely with cross-functional teams to drive data reliability, quality, and performance.
Responsibilities :
- Design, develop, and optimize scalable data pipelines using Databricks in AWS such as Glue, S3, Lambda, EMR, Databricks notebooks, workflows and jobs.
- Building data lake in WS Databricks.
- Build and maintain robust ETL / ELT workflows using Python and SQL to handle structured and semi-structured data.
- Develop distributed data processing solutions using Apache Spark or PySpark .
- Partner with data scientists and analysts to provide high-quality, accessible, and well-structured data.
- Ensure data quality, governance, security, and compliance across pipelines and data stores.
- Monitor, troubleshoot, and improve the performance of data systems and pipelines.
- Participate in code reviews and help establish engineering best practices.
- Mentor junior data engineers and support their technical development.
Requirements :
Create a job alert for this search
Data Pipeline Architect • Hyderabad, Republic Of India, IN
Related jobs
- Promoted
GCP Data Architect
Tata Consultancy Servicessecunderabad, telangana, in Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and consumption.Develop Data Pipelines...Show moreLast updated: 29 days ago
- Promoted
Data Architect
Tech MahindraHyderabad, Telangana, India Role : Azure Data Architect Exp : 10+yrs Location : Pan India Strong experience architecting and delivering data platforms on Azure Proficiency in Azure services including Azure Synapse Analytic...Show moreLast updated: 8 days ago
- Promoted
Databricks Data Architect
Tata Consultancy Servicessecunderabad, telangana, in Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e.
Docker, Kubernetes) for deploying data workflows.Should be able ...Show moreLast updated: 8 days ago
- Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.iosecunderabad, telangana, in We offer a vibrant and collaborative work environment, cutting-edge tools and technologies, and ample opportunities for professional growth.
Job Title : Azure Data Architect.Experience required : 15+ ...Show moreLast updated: 1 day ago
- Promoted
Data Pipeline Architect
Tata Consultancy ServicesHyderabad, Republic Of India, IN TCS is conducting Weekday Virtual drive for the role of.Years of experience : 5 to 10 yrs.Date of Interview : 6th Nov 2025.
Time of Interview : 10 AM to 2 PM.Developing, managing and optimizing robust ...Show moreLast updated: 30+ days ago
- Promoted
Data Pipeline Architect
BPMLinksHyderabad, Republic Of India, IN In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and data analyt...Show moreLast updated: 18 days ago
- Promoted
Data Pipeline Architect
DevRabbit IT SolutionsHyderabad, Republic Of India, IN We are looking for a highly skilled.Data Engineer / Analytics Engineer.The ideal candidate will have strong expertise in.
Python, Advanced SQL, DBT, and Snowflake.Design, develop, and maintain robus...Show moreLast updated: 1 day ago
- Promoted
Senior Data Pipeline Architect
People Tech Group IncHyderabad, Republic Of India, IN We are seeking a highly skilled.The ideal candidate will have strong expertise in SQL, Python, data modeling, and building scalable data pipelines.
Proficiency with AWS services (Redshift, S3, Glue,...Show moreLast updated: 8 days ago
- Promoted
Data Architect
Nextracker Inc.hyderabad, telangana, in A Data Architect is responsible for designing, developing, data and ETL work for the NX organization.The Individual must ensure data is efficiently stored, accessed, and analyzed by leveraging adva...Show moreLast updated: 8 days ago
- Promoted
Data Pipeline Architect
Saras AnalyticsHyderabad, Republic Of India, IN We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.
Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago
- Promoted
Data Pipeline Architect
Prudent Technologies and Consulting, Inc.Hyderabad, Republic Of India, IN Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 30+ days ago
- Promoted
Data Pipeline Architect
INFEC ServicesHyderabad, Republic Of India, IN Face to Face Interview on Nov 8 Friday.We are seeking a skilled and detail-oriented.The ideal candidate should have strong experience working across.
Design, develop, and maintain scalable.Work with...Show moreLast updated: 7 days ago
- Promoted
Data Architect
QualiZealHyderabad, Telangana, India Job Overview : We are seeking an experienced Data Architect with over 10 years of expertise in SQL development and database architecture.
The ideal candidate should have strong experience in ETL pro...Show moreLast updated: 30+ days ago
- Promoted
Data Pipeline Architect
Kanerika IncHyderabad, Republic Of India, IN Hyderabad, Indore and Ahmedabad (India).Develop and maintain data pipelines using Azure Data Factory (ADF) / Databricks for data integration and ETL processes.
Design, implement, and optimize Power B...Show moreLast updated: 30+ days ago
- Promoted
Data Pipeline Architect
Insight GlobalHyderabad, Republic Of India, IN We are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud.
The ideal candidate will have experie...Show moreLast updated: 5 days ago
- Promoted
Data Architect
ValueMomentumhyderabad, telangana, in AWS, Azure, GCP, Linux, Windows Environments, Redshift, and Databricks.Years of Experience in Data Modeling / Data Warehousing and 5+ years in Snowflake.
We are seeking a highly skilled Architect with...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Pipeline Architect
meanSquare.aiHyderabad, Republic Of India, IN Data Engineer (onsite | Offshore | PST Overlap Required).We’re looking for an experienced and independent.If you enjoy working with modern data tools, solving real-world data problems, and collabor...Show moreLast updated: 1 day ago
- Promoted
Lead Data Pipeline Architect
EgenHyderabad, Republic Of India, IN We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show moreLast updated: 30+ days ago