Talent.com
This job offer is not available in your country.
Senior Data Engineer - Python / SQL

Senior Data Engineer - Python / SQL

AvisoftGurugram
30+ days ago
Job description

About the Role

We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms that empower data-driven decision-making.

This role requires deep technical expertise in modern data engineering frameworks, architectural patterns, and cloud-native solutions on AWS.

You will be a key contributor to our data strategy, ensuring data quality, governance, and reliability while mentoring other engineers in the team.

Key Responsibilities

  • Design, develop, and own robust, scalable, and maintainable data pipelines (batch & real-time).
  • Architect and implement Data Lake, Data Warehouse, and Lakehouse solutions using modern frameworks and architectural patterns.
  • Ensure data quality, governance, and integrity across the entire data lifecycle.
  • Monitor, troubleshoot, and optimize the performance of data pipelines.
  • Contribute to and enforce best practices, design principles, and technical documentation.
  • Partner with cross-functional teams to translate business requirements into effective technical solutions.
  • Provide mentorship and guidance to junior data engineers, fostering continuous learning and growth.

Good to Have Skills :

  • Bachelors degree in Computer Science, Information Systems, or related field (Masters degree preferred).
  • 8+ years of experience as a Data Engineer, with a proven track record of building large-scale, production-grade pipelines.
  • Expertise in AWS Data Services (S3, Glue, Athena, EMR, Kinesis, etc.
  • Strong proficiency in SQL and deep understanding of file formats (Parquet, Delta Lake, Apache Iceberg, Hudi, CDC patterns).
  • Hands-on experience with stream processing frameworks (Apache Flink, Kafka Streams, or PySpark).
  • Proficiency in Apache Airflow or similar workflow orchestration tools.
  • Strong knowledge of database systems (relational & NoSQL) and data warehousing concepts.
  • Experience with data integration tools and cloud-based data platforms.
  • Excellent problem-solving skills and ability to work independently in fast-paced environments.
  • Strong communication and collaboration skills to work effectively with both technical and business stakeholders.
  • Passion for emerging technologies and keeping pace with industry best :
  • AWS (S3, Glue, Athena, EMR, Kinesis), SQL, Data Warehouse, Data Lake, Lakehouse, Parquet, Delta Lake, Iceberg, Hudi, CDC, Apache Flink, Kafka Streams, PySpark, Apache Airflow, ETL, Data Pipelines, Data Integration, Cloud, NoSQL, Architecture, Data Key Skills :
  • Data warehouse, Architectural Patterns, Modern data engineering tools and framework, AWS, SQL, File Area :
  • AWS (S3, Glue, Athena, EMR, Kinesis), SQL, Data Warehouse, Data Lake, Lakehouse, Parquet, Delta Lake, Iceberg, Hudi, CDC, Apache Flink, Kafka Streams, PySpark, Apache Airflow, ETL, Data Pipelines, Data Integration, Cloud, NoSQL, Architecture, Data :
  • 810 years of proven experience as a Data Engineer, with expertise in designing and implementing large-scale data solutions
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Gurugram

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Manuh TechnologiesGhaziabad, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLDelhi, IN
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EvolentDelhi, IN
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CESDelhi, IN
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIDelhi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIGhaziabad, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Aceolutionfaridabad, haryana, in
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CoreTek Labsfaridabad, haryana, in
    We’re Hiring for Top MNC –Senior Data Engineer! 📢.Notice Period : immediate to October joiners.Skill : Python, Pandas, Snowflake, SQL & Pytest(senior Data Engineer). Do not go for data bricks or dat...Show moreLast updated: 4 days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USADelhi, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tredence Inc.noida, delhi, in
    Design, build, and maintain scalable data pipelines using DBT and Airflow.Develop and optimize SQL queries and data models in Snowflake. Implement ETL / ELT workflows, ensuring data quality, performan...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivefaridabad, haryana, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 3 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPfaridabad, haryana, in
    Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AWS (e.Data Processing : Spark (PySpark), Glue, EMR AWS Core Services : S3, Glue, Athena, Lambda...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesDelhi, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DexianDelhi, IN
    We seek a Senior Data Engineer colleague to join our world-class client, one of the.Employment / Contract Type : Contract. Duration : 1 year (with potential to be extended).Hours per Week : 40 (Full-time...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesDelhi, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.new delhi, delhi, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Dhurindelhi, delhi, in
    Dhurin is a fastgrowing data science firm serving financial services industry.We work with banks, NBFCs, fintech and other financial institutions. Our work is in the space of risk, fraud, collection...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionsfaridabad, haryana, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 23 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisDelhi, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 13 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsDelhi, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 3 days ago