Talent.com
This job offer is not available in your country.
Data Engineer - ETL / Python / Apache Airflow

Data Engineer - ETL / Python / Apache Airflow

K & R EnterprisesMumbai
30+ days ago
Job description

Roles and Responsibilities :

  • Develop, Monitor, and Maintain data pipeline.
  • Create and maintain optimal data pipeline architecture
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
  • Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
  • Incident diagnosis, routing, evaluation & resolution
  • Analyze the root cause of incidents.
  • Create an incident closure report

Requirements :

  • BE Degree in computer science or equivalent from business schools, IITins, NIIT, IIM's
  • Min 3 years of Experience in Data management
  • Experience with data modeling, data warehousing, and building ETL pipelines
  • Hands-on experience on Spark SQL and Spark streaming
  • Hands-on experience with Airflow or Luigi
  • Comfortable working with python and shell scripts
  • Good understanding of Hadoop Ecosystem
  • Experience with Data warehouses like RedShift and Databases like Postgres, MariaDB.
  • Ability to implement webhooks if required.
  • Immediate joining, need candidate within 15 or 30 days.

    (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Mumbai

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIKalyan-Dombivli, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyThane, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgedombivli, maharashtra, in
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesKalyan-Dombivli, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHnavi mumbai, maharashtra, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIdombivli, maharashtra, in
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIThane, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer - ETL / Python

    Data Engineer - ETL / Python

    Xanika InfotechMumbai
    Job Summary : We are seeking an experienced Data Engineer to join our team in Mumbai.The ideal candidate will have a strong background in data engi...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    R SystemsMumbai, IN
    Offshore candidates accepted (Singapore Based Company).Please don't apply if less than 4 years exp in Data Engineer).ETL pipelines, real-time streaming, and data transformations.RDDs, transformatio...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tredence Inc.thane, maharashtra, in
    Design, build, and maintain scalable data pipelines using DBT and Airflow.Develop and optimize SQL queries and data models in Snowflake. Implement ETL / ELT workflows, ensuring data quality, performan...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionThane, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivemumbai city, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIThane, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKalyan-Dombivli, IN
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesnavi mumbai, maharashtra, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.mumbai city, maharashtra, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 24 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPKalyan-Dombivli, IN
    Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AWS (e.Data Processing : Spark (PySpark), Glue, EMR AWS Core Services : S3, Glue, Athena, Lambda...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESThane, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 5 days ago