Talent.com
Senior Data Engineer

Senior Data Engineer

SPIROPune, Haveli
3 days ago
Job description

Position : Senior Data Engineer

Location : Pune

Experience : 5+ years

Job Summary :

We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.

Key Responsibilities :

  • Design, develop, and maintain scalable data pipelines and ETL processes using PySpark and Spark.
  • Perform data wrangling, transformation, and integration across diverse data sources.
  • Optimize the performance and reliability of data processing workflows.
  • Implement data quality frameworks to ensure data accuracy and integrity.
  • Develop and maintain data architectures and data models to support business needs.
  • Collaborate with cross-functional teams including data analysts, software engineers, and business stakeholders to understand data requirements.
  • Stay updated with the latest advancements in Big Data tools, frameworks, and best practices.
  • Mentor and guide junior data engineers in technical and professional growth.

Required Skills and Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering roles.
  • Expertise in PySpark and Spark for large-scale data processing.
  • Strong understanding of Big Data ecosystems and technologies (e.g., Hadoop, Hive).
  • Hands-on experience with ETL development, data modeling, and data warehousing.
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Experience with cloud platforms like AWS, Azure, or Google Cloud.
  • Strong problem-solving skills and a detail-oriented mindset.
  • Excellent communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with containerization and orchestration tools like Docker and Kubernetes.
  • Knowledge of SQL and relational database management systems.
  • Familiarity with data orchestration tools like Airflow, Prefect, or similar.
  • Create a job alert for this search

    Senior Data Engineer • Pune, Haveli

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLPune, Maharashtra, India
    Key Responsibilities : • Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovat...Show moreLast updated: 30+ days ago
    • Promoted
    5447 | Senior Data Engineer

    5447 | Senior Data Engineer

    EXLPune, Maharashtra, India
    Title : Senior Data Engineer Experience : 6+ Years We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, ...Show moreLast updated: 27 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Futran SolutionsPune, Maharashtra, India
    Job Title : Senior Data Engineer / Data Engineer Lead Job Description : We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platform...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Innova SolutionsPune, Maharashtra, India
    We're Hiring : Lead Data Consultant / Senior Data Engineer.Industry : Financial Services & Insurance (FSI).Are you passionate about building scalable, cloud-native data platforms? Join our team to le...Show moreLast updated: 18 days ago
    • Promoted
    Senior Azure Data Engineer - Fabric Platform

    Senior Azure Data Engineer - Fabric Platform

    Lancesoft India Pvt LtdPune
    Description : Role Overview : You will be responsible for building modern, scalable, and high-performance data architectures on the Azure Cloud....Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live ConnectionsPune, IN
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Azure Platform

    Senior Data Engineer - Azure Platform

    Futran SolutionsPune
    Description : Job Description : We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsPune, Maharashtra, India
    A highly skilled Data Engineering professional with 6 to 8 years of experience in designing, developing, and maintaining robust data solutions. Proven ability to work across the full software develo...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent SystemsPune, Maharashtra, India
    About Position : We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snow...Show moreLast updated: 6 days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careerspune, maharashtra, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiPune, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear CorporationPune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerxPune, Maharashtra, India
    About the Role : We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions.The ideal candidate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlancePune, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIROPune, Maharashtra, India
    Position : Senior Data Engineer Location : Pune Experience : 5+ years Job Summary : We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data techn...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasPune, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer - Snowflake / AWS

    Senior Data Engineer - Snowflake / AWS

    ResourcetreePune
    About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 30+ days ago