Talent.com
Apply in 3 Minutes! Senior Data Engineer

Apply in 3 Minutes! Senior Data Engineer

EXLPune, Maharashtra, India
14 hours ago
Job description

Summary : We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging. You will have the opportunity to use your expertise in solving big data problems and apply design thinking, coding and analytical skills to develop data pipelines that support marketing data products. We’re looking for talented Data Engineers passionate about building new data-driven solutions with the latest Big Data technology.

Technical Proficiency :

  • 6+ years of experience and a bachelor’s degree in computer science or a related field, or equivalent work experience
  • In-depth working experience of distributed systems Hadoop, Spark, Hive, DBT and Airflow / Dagster
  • At least 4 years of solid production quality coding experience in data pipeline implementation in Python
  • Experience working with public cloud platforms, preferably AWS
  • Experience working with Databricks and / or Snowflake
  • Experience in Git, JIRA, Jenkins, shell scripting
  • Familiarity with Agile methodology, test-driven development, source control management and test automation

Role and Responsibilities :

  • You will build services that will integrate directly with products and with external vendors.
  • You will work with modern data technologies such as Hadoop, Spark, DBT, Dagster / Airflow, Atlan, Trino, etc., modern data platforms such as Databricks and Snowflake and cloud technologies across AWS stack
  • Identify, design, and implement automation of manual processes, optimizing data delivery, reducing Cloud cost, etc.
  • Implement processes and systems to monitor Data Quality, Observability, Governance and Lineage.
  • Support operations to manage the production environment and help in resolving production issues with RCA
  • Write unit / integration tests, adopt Test-driven development, contribute to engineering wiki, and document design / implementation etc.
  • Education : Bachelor’s degree in computer science, Software Engineering, MIS or equivalent combination of education and experience

    Key Skills : SQL, Python, Hadoop, Spark, Hive, DBT and Airflow / Dagster, AWS

    Create a job alert for this search

    Senior Data Engineer • Pune, Maharashtra, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Coditaspune, maharashtra, in
    Understand Business requirements and implement scalable solutions.Translate complex technical and functional requirements into detailed designs. Develop a highly scalable, reliable, and high-perform...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear CorporationPune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLpune, maharashtra, in
    We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Futran SolutionsPune, IN
    We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms. The ideal candidate will have a proven track record of designing, imp...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastekpune, maharashtra, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Incpune, maharashtra, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    FinastraPune, IN
    Finastra’s Global Data Office is responsible for the strategy, governance, and enablement of data assets across 130+ countries globally to unlock innovation for our business units and 8000+ custome...Show moreLast updated: 5 hours ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladepune, maharashtra, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsPune, Maharashtra, India
    A highly skilled Data Engineering professional with 6 to 8 years of experience in designing, developing, and maintaining robust data solutions. Proven ability to work across the full software develo...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Innova Solutionspune, maharashtra, in
    We're Hiring : Lead Data Consultant / Senior Data Engineer.Industry : Financial Services & Insurance (FSI).Are you passionate about building scalable, cloud-native data platforms? Join our team to le...Show moreLast updated: 6 days ago
    • Promoted
    Senior Databricks Engineer

    Senior Databricks Engineer

    Newscape ConsultingPune, Maharashtra, India
    The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data ecos...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Copune, maharashtra, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer-Remote

    Senior Data Engineer-Remote

    Cimpress Indiapune, maharashtra, in
    Remote
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer- AWS

    Senior Data Engineer- AWS

    InfoCeptsPune, Maharashtra, India
    Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements. Should be able to design comple...Show moreLast updated: 30+ days ago
    • Promoted
    5447 | Senior Data Engineer

    5447 | Senior Data Engineer

    EXLpune, maharashtra, in
    We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIPune, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Azure Databricks Engineer

    Senior Azure Databricks Engineer

    Newscape ConsultingPune, IN
    We’re Hiring : Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer.Immediate Joiners / Notice Period ≤ 15 Days. Only local Pune candidates may apply.L2 interviews will be conducted....Show moreLast updated: 5 hours ago