Build and maintain all facets of Data Pipelines for Data Engineering team.
Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.
Work with internal and external stakeholders to assist with data-related technical issues and data quality issues.
Engage in proof of concepts, technical demos and interaction with customers and other technical teams
Participate in the agile ceremonies
Ability to solve complex data-driven scenarios and triage towards defects and production issues
Technical Skills
Must Have Skills :
Proficient with Python, PySpark and Airflow
Strong understanding of Object-Oriented Programming and Functional Programming paradigm
Must have experience working with Spark and its architecture
Knowledge of Software Engineering best practices
Advanced SQL knowledge (preferably Oracle)
Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.
Good to Have Skills :
Knowledge of ‘Data’ related AWS Services
Knowledge of GitHub and Jenkins
Automated testing
Create a job alert for this search
Lead Data Engineer • Delhi, IN
Related jobs
Promoted
New!
Data Engineer
IGT SolutionsGurugram, Haryana, India
We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show moreLast updated: 11 hours ago
Promoted
New!
Lead Data Engineer
MakeMyTripGurugram, Haryana, India
At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show moreLast updated: 11 hours ago
Promoted
New!
Data Engineer
EXLGurugram, Haryana, India
We are looking for a Python & PySpark developer and data engineer who can design and build solutions for one of our Fortune 500 Client programs in the realm of Financial Master & Reference Data Man...Show moreLast updated: 11 hours ago
Promoted
New!
Data Engineer
NABGurugram, Haryana, India
Proficient in executing ETL processes between data environments.Proficient at coding in SQL (additional knowledge in Python and R is highly regarded).
Proficient at creating analytics related docume...Show moreLast updated: 11 hours ago
Promoted
New!
AWS Data Engineer
COVET IT INCGhaziabad, IN
Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc.
We are seeking a highly skilled AWS Data Engine...Show moreLast updated: 21 hours ago
Promoted
Senior Data Engineer
SAIVA AIDelhi, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
Promoted
Data Engineer (Spark / Scala)
Tata Consultancy ServicesDelhi, India
TCS is Hiring for Data Engineer (Spark / Scala) Experience : 5+Yrs Location : .Chennai, Bangalore, Pune, Gurugram Notice Period : 0-60 Days.
Please find the JD below Good work experience & Proven experi...Show moreLast updated: 27 days ago
Promoted
AWS Data Engineer (PySpark)
Atyeti IncDelhi, India
Technical Skills Must Have Skills : Proficient with Python, PySpark and Airflow Strong understanding of Object-Oriented Programming and Functional Programming paradigm Must have experience working w...Show moreLast updated: 2 days ago
Promoted
New!
Lead Data Engineer (Databricks)
SII Group IndiaNoida, Uttar Pradesh, India
We are looking for a highly skilled.The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, an...Show moreLast updated: 5 hours ago
Promoted
Data Engineer
IntraEdgeDelhi, IN
Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
Promoted
New!
Senior Data Engineer
ManpowerGroup IndiaGurgaon, Haryana, India
Qualifications : Strong 5 yrs to 8 yrs experience and understanding of ADF, ETL and SSIS, Python and SQL including data warehousing concepts and data warehousing principles.Proficiency in ETL ...Show moreLast updated: 6 hours ago
Promoted
New!
Lead GCP Data Engineer
ImpetusGurgaon, Haryana, India
Job Title : Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location : Gurgaon Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities...Show moreLast updated: 6 hours ago
Promoted
New!
Lead Data Engineer
VRIZEDelhi, India
Experience as a Data Engineer with strong track record of designing and implementing data solutions.Experience in programming language as Python, Pyspark with airflows Experience with cloud data wa...Show moreLast updated: 5 hours ago
Promoted
Lead PySpark Data Engineer _ Exp : 7+ Years
Atyeti IncDelhi, India
Job Description : Roles and Responsibility : .Build and maintain all facets of Data Pipelines for Data Engineering team.Build the pipelines required for optimal extraction, transformation, and loading ...Show moreLast updated: 8 days ago
Promoted
Data Engineer
Havells India LtdNoida, Uttar Pradesh, India
We are seeking a skilled and experienced Data Engineer to join our dynamic team.The ideal candidate will have a strong background in data engineering, with a focus on PySpark, Python, and SQL.Exper...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
DigitalzoneDelhi, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 18 days ago
Promoted
Senior Data Engineer
Straivegurgaon, haryana, in
The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer
SPIRODelhi, India
Senior Data Engineer Location : .Job Summary : We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies.
The ideal candidate will have ov...Show moreLast updated: 4 days ago