Talent.com
This job offer is not available in your country.
Senior Data Engineer - Python / ETL

Senior Data Engineer - Python / ETL

PRONEXUS CONSULTING PRIVATE LIMITEDPune
14 days ago
Job description

About the Role :

We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and platforms that power analytics, reporting, and machine learning use cases.

This role requires strong technical expertise in distributed data systems, cloud-native architectures, and automation frameworks.

The ideal candidate is passionate about building reliable, high-performance data infrastructure and enabling data-driven decision-making across the enterprise.

Key Responsibilities :

  • Data Pipeline Development : Design, develop, and maintain scalable ETL / ELT pipelines for ingesting, transforming, and processing large volumes of structured and unstructured data.
  • Platform Engineering : Enhance data-processing frameworks, orchestration workflows, monitoring systems, and CI / CD pipelines leveraging AWS, GitLab, and open-source technologies.
  • Optimization & Automation : Identify opportunities to automate manual processes, optimize workflows for efficiency, and re-architect solutions for improved scalability, availability, and usability.
  • Collaboration : Partner with product managers, data scientists, and application teams to understand requirements, define data models, and ensure reliable data delivery for analytical use cases.
  • Platform Support : Provide guidance, training, and technical support to internal stakeholders consuming platform services.
  • Monitoring & Reliability : Establish metrics, implement monitoring tools, and configure alerting mechanisms to proactively track system health, detect anomalies, and ensure SLA adherence.
  • Best Practices : Enforce coding standards, data governance policies, and DevOps practices for secure and compliant data solutions.

Qualifications & Technical Skills

Core Expertise :

  • Proven experience in building and optimizing data pipelines in distributed environments.
  • Strong programming expertise in Python and PySpark (4+ years).
  • Advanced proficiency in SQL for querying, modeling, and tuning performance.
  • Hands-on experience with Linux environments and shell scripting.
  • Cloud & Tools :

  • Experience with AWS services such as S3, Glue, EMR, Redshift, Lambda, and Athena.
  • Familiarity with CI / CD and version control tools : Git / Bitbucket, Jenkins, AWS CodeBuild, CodePipeline.
  • Exposure to monitoring and alerting tools (e.g., CloudWatch, Prometheus, Grafana, ELK).
  • Additional Skills :

  • Working knowledge of Palantir platform is a strong plus.
  • Experience collaborating with cross-functional teams (data scientists, analysts, DevOps, application developers).
  • Strong problem-solving and analytical skills with ability to debug complex data issues.
  • Knowledge of distributed computing concepts, data partitioning, and performance tuning.
  • Preferred Attributes :

  • Experience with modern data lakehouse and streaming platforms (Databricks, Kafka, Delta Lake).
  • Understanding of data security, governance, and compliance in regulated environments.
  • Ability to design highly available, cost-optimized, and production-ready solutions.
  • Strong communication skills to engage with stakeholders and present technical solutions clearly.
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Pune

    Related jobs
    • Promoted
    Tarana Wireless - Senior Data Engineer - Python / ETL

    Tarana Wireless - Senior Data Engineer - Python / ETL

    TARANA WIRELESS INDIA PRIVATE LIMITEDPune
    Job Summary : Build a world-class, high-volume data system from the ground up! We have growing data sets and several exciting Machine Learning systems to create or i...Show moreLast updated: 21 days ago
    • Promoted
    Big Data Engineer - ETL / Scala / Python

    Big Data Engineer - ETL / Scala / Python

    HyrEzy Talent SolutionsPune
    Role : Big Data Engineer About Organization : Our Client is an IT consulting organization focused on providing AI Led Digital Transforma...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesPune, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIPune, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Hireologistpune, maharashtra, in
    You’ll be working closely with product managers, architects, and engineering leads to define technical strategies and ensure the availability, reliability, and quality of data across the organizati...Show moreLast updated: 12 hours ago
    • Promoted
    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent Health - Senior Data Engineer - Python / SQL

    Evolent HealthPune
    Responsibilities : - Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Arch...Show moreLast updated: 22 days ago
    • Promoted
    Intellias - Senior Data Engineer - Python Programming

    Intellias - Senior Data Engineer - Python Programming

    IntelliasPune
    Why Work at Intellias ? At Intellias, we are more than just a technology company - we are a trusted partner to some of the worlds most prestigious organizations.With ...Show moreLast updated: 21 days ago
    • Promoted
    ETL Senior Engineer

    ETL Senior Engineer

    TESTQ Technologies LimitedPune
    About the Role : We are looking for a highly skilled ETL Senior Engineer with AWS expertise to design, build, and optimize robust data pip...Show moreLast updated: 17 days ago
    • Promoted
    Bits In Glass - Data Engineer - Python / ETL

    Bits In Glass - Data Engineer - Python / ETL

    Bits In GlassPune
    Title : Senior Data Engineer / ETL Engineer.Location : Pune / Hyderabad / Mohali.Job Summary : As a Senior Data Engineer / ETL Engineer, you w...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer - PySpark

    Senior Data Engineer - PySpark

    Xlr8 Talent SearchPune
    Job Description : We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digitalpune, maharashtra, in
    Python - Must have hands-on in Coding.SQL- Must have experience in writing queries.Must have experience in Data Lake / Lakehouse and open formats such as Iceberg, Hudi, Delta Lake" (remove Parquet).M...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - ETL / Python

    Senior Data Engineer - ETL / Python

    Synapse Tech Services IncPune
    About the Role : We are looking for a highly experienced Senior Data Engineer with deep expertise in the AWS ecosystem to design, implemen...Show moreLast updated: 25 days ago
    • Promoted
    Python & ETL Engineer - Data Pipeline

    Python & ETL Engineer - Data Pipeline

    Servhigh Global Services Private LimitedPune
    Role Overview : We are seeking a highly skilled Python + ETL Engineer with strong expertise in building data pipelines, automation workflows, and scalable ETL soluti...Show moreLast updated: 29 days ago
    • Promoted
    Senior Data Engineer - Python

    Senior Data Engineer - Python

    People Prime World WidePune
    About Client : Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France.Founded in 1967, It h...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Python

    Senior Data Engineer - Python

    Globner Consulting LLPPune
    Responsibilities : - Design, develop, and maintain scalable data pipelines using Python and modern data engineering tools. Understanding of banking data models, finan...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / ETL

    Data Engineer - Python / ETL

    Siyaton Software Solutions Pvt LtdPune
    Role : Data Engineer Experience : 6+ years Location : Pune / Hyderabad Work Mod...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 8 days ago
    • Promoted
    Azure Data Engineer - ETL / Python

    Azure Data Engineer - ETL / Python

    Confidential CompanyPune
    Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in the data engineering ...Show moreLast updated: 16 days ago