This job offer is not available in your country.
Agrim - Senior Data Engineer - Python / SQL
AGRIMGurugram30+ days ago
Job description5+ of experience in data engineering and big data processing. Strong proficiency in Python and SQL for data transformation and querying. Expertise in Apache Spark, Kafka, and Airflow for real-time and batch processing. Experience with cloud data warehouses (BigQuery, Redshift, Snowflake). Hands-on experience in ETL development, data modeling, and schema design. Strong knowledge of data partitioning, indexing, and query optimization. Experience with data lake architectures and storage formats like Parquet, ORC, Avro. Familiarity with containerization (Docker, Kubernetes) and CI / CD pipelines. Knowledge of monitoring tools (Prometheus, Grafana, ELK stack) for data infrastructure. Ability to mentor junior engineers and lead data-driven decision-making
Senior Data Engineer (SDE-3)
Location : Gurugram (Work from Office)
Experience : 5+
Tech Stack : Python, SQL (PostgreSQL / MySQL), Apache Spark, Kafka, Airflow, BigQuery / Redshift, Druid, Hadoop, Snowflake
Responsibilities :
- Design and develop scalable ETL pipelines for ingesting and transforming large datasets.
- Architect and optimize data warehouses and data lakes for high-performance analytics.
- Implement real-time and batch data processing using Apache Spark, Kafka, and Airflow.
- Work with structured and unstructured data across multiple storage solutions (Snowflake, BigQuery, Redshift, Hadoop, S3, etc.
- Ensure data quality, consistency, and integrity across multiple sources.
- Optimize SQL queries and database schemas for performance and cost efficiency.
- Implement data governance, security, and access controls.
- Collaborate with engineering, product, and analytics teams to design data models.
- Monitor and troubleshoot data pipeline failures and performance issues.
- Contribute to system design discussions, code reviews, and documentation.
Requirements :
(ref : hirist.tech)
Create a job alert for this search
Senior Data Engineer • Gurugram
Related jobs
![Senior Data Engineer [T500-18489]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobrapido-pms&company_name=Albertsons%20Companies%20India)
- Promoted
Senior Data Engineer
EXLDelhi, IN We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago
- Promoted
Senior Data Engineer
Otomeyt AInoida, delhi, in We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
- Promoted
Senior Azure Data Engineer
Programmers.iofaridabad, haryana, in Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.
We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
The Mastermind Groupfaridabad, haryana, in Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG).
Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Aceolutionfaridabad, haryana, in We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer
CESfaridabad, haryana, in As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 5 days ago
- Promoted
Senior Big Data Engineer
Veltrisfaridabad, haryana, in Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries.
We specialize in delivering next-gene...Show moreLast updated: 14 days ago
- Promoted
Senior Cloud Engineer AWS
Matrix USADelhi, IN We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 4 days ago
- Promoted
Backend and Data Pipeline Engineer
JRD Systemsfaridabad, haryana, in Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Engineer
TechVeritofaridabad, haryana, in You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights.
The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 2 hours ago
- Promoted
Senior Data Engineer
Evolentfaridabad, haryana, in Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 23 days ago
- Promoted
Senior Data Engineer [T500-18489]
Albertsons Companies Indiafaridabad, haryana, in About Albertsons Companies India : .At Albertsons Companies India, we're not just pushing the boundaries of technology and retail innovation, we're cultivating a space where ideas flourish and career...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
INFEC Servicesfaridabad, haryana, in Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago
- Promoted
Senior Data Engineer
DeltacubesGhaziabad, IN Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
- Promoted
Senior Data Engineer
SAIVA AIGhaziabad, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
Innodata Inc.Delhi, IN CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
- Promoted
Senior Data Engineer
Straivegurgaon, haryana, in The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 4 days ago
- Promoted
Data Analyst - Python / SQL
PLEXO HR Solutionsfaridabad, haryana, in Seeking experienced Data Analyst to join our analytics team! Work with cutting-edge tools and technologies.Perfect opportunity for data enthusiasts to make strategic impact through insights and ana...Show moreLast updated: 5 days ago