Talent.com
Senior Data Engineer

Senior Data Engineer

SPIROPune, Maharashtra, India
30+ days ago
Job description

Position : Senior Data Engineer

Location : Pune

Experience : 5+ years

Job Summary :

We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.

Key Responsibilities :

  • Design, develop, and maintain scalable data pipelines and ETL processes using PySpark and Spark.
  • Perform data wrangling, transformation, and integration across diverse data sources.
  • Optimize the performance and reliability of data processing workflows.
  • Implement data quality frameworks to ensure data accuracy and integrity.
  • Develop and maintain data architectures and data models to support business needs.
  • Collaborate with cross-functional teams including data analysts, software engineers, and business stakeholders to understand data requirements.
  • Stay updated with the latest advancements in Big Data tools, frameworks, and best practices.
  • Mentor and guide junior data engineers in technical and professional growth.

Required Skills and Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering roles.
  • Expertise in PySpark and Spark for large-scale data processing.
  • Strong understanding of Big Data ecosystems and technologies (e.g., Hadoop, Hive).
  • Hands-on experience with ETL development, data modeling, and data warehousing.
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Experience with cloud platforms like AWS, Azure, or Google Cloud.
  • Strong problem-solving skills and a detail-oriented mindset.
  • Excellent communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with containerization and orchestration tools like Docker and Kubernetes.
  • Knowledge of SQL and relational database management systems.
  • Familiarity with data orchestration tools like Airflow, Prefect, or similar.
  • Create a job alert for this search

    Senior Data Engineer • Pune, Maharashtra, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLPune, Maharashtra, India
    Summary : We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging...Show moreLast updated: 30+ days ago
    • Promoted
    5447 | Senior Data Engineer

    5447 | Senior Data Engineer

    EXLPune, Maharashtra, India
    Title : Senior Data Engineer Experience : 6+ Years We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, ...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Innova SolutionsPune, Maharashtra, India
    We're Hiring : Lead Data Consultant / Senior Data Engineer.Industry : Financial Services & Insurance (FSI).Are you passionate about building scalable, cloud-native data platforms? Join our team to le...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Senior Data Engineer- Freelance

    Senior Data Engineer- Freelance

    Quapton AI Solutionspune, maharashtra, in
    Quapton AI Solutions is an innovative tech startup dedicated to providing advanced IT services within the field of artificial intelligence. We aim to empower businesses with tailored AI-driven solut...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, Incpune, India
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 7 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsPune, Maharashtra, India
    Data Engineer with Pyspark, SQL, ETL Data Engineer.Job Type : Full Time Employment.Candidate should have 5+ years of experience in Data Engineering. Must have experience in Pyspark, SQL, ETL, data pi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Pune, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent SystemsPune, India
    We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiPune, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 3 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Futran Solutionspune, maharashtra, in
    Job Title : Senior Data Engineer / Data Engineer Lead.We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.The ideal candida...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear CorporationPune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerxPune, Maharashtra, India
    About the Role : We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions.The ideal candidate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    American Inferencepune, India
    Please apply directly through LinkedIn for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.We are an AI and Data ...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlancePune, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIROPune, Maharashtra, India
    Position : Senior Data Engineer Location : Pune Experience : 5+ years Job Summary : We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data techn...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasPune, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer - Snowflake / AWS

    Senior Data Engineer - Snowflake / AWS

    ResourcetreePune
    About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 30+ days ago