Talent.com
Azure Data Engineer - ETL/Python
Azure Data Engineer - ETL/PythonConfidential Company • Pune
Azure Data Engineer - ETL / Python

Azure Data Engineer - ETL / Python

Confidential Company • Pune
30+ days ago
Job description

Responsibilities :

  • Developing Modern Data Warehouse solutions using Databricks and Azure Stack.
  • Ability to provide solutions that are forward-thinking in the data engineering and analytics space.
  • Collaborate with DW / BI leads to understanding new ETL pipeline development requirements.
  • Triage issues to find gaps in existing pipelines and fix the issues.
  • Work with businesses to understand the need in the reporting layer and develop a data model to fulfill reporting needs.
  • Help joiner team members to resolve issues and technical challenges.
  • Drive technical discussions with client architects and team members.
  • Orchestrate the data pipelines in the scheduler via Airflow.

Requirements :

  • Must have a total of 5 years of IT experience in Data warehouse / ETL projects.
  • Deep understanding of Star and Snowflake dimensional modeling.
  • Strong knowledge of Data Management principles.
  • Good understanding of Databricks Data & AI platform and Azure Data Factory Architecture OR ADF.
  • Should have hands-on experience in SQL, Python, and Spark (PySpark).
  • Candidate must have experience in Azure stack.
  • Desirable to have ETL with batch and streaming (Kinesis).
  • Experience in building ETL / data warehouse transformation processes.
  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev / Ops environment with tools such as Terraform, CircleCI, and GIT.
  • Proficiency in RDBMS, complex SQL, PL / SQL, Unix Shell Scripting, performance tuning, and troubleshooting.
  • Databricks Certified Data Engineer Associate / Professional Certification (Desirable).
  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.
  • Should have experience working in Agile methodology.
  • Strong verbal and written communication skills.
  • Strong analytical and problem-solving skills with high attention to detail.
  • Mandatory Skills : Python / PySpark / Spark with Azure / Azure Data Factory
  • (ref : hirist.tech)

    Create a job alert for this search

    Azure Data Engineer • Pune

    Related jobs
    Senior Azure Data Engineer - ETL / PySpark

    Senior Azure Data Engineer - ETL / PySpark

    knowledge Artisan • Pune
    About the Role : We are looking for Sr.Azure Data Engineers to design, develop, and optimize data engineering pipelines ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Pune, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Pune, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 14 days ago • Promoted
    Big Data Engineer - ETL / Scala / Python

    Big Data Engineer - ETL / Scala / Python

    HyrEzy Talent Solutions • Pune
    Role : Big Data Engineer About Organization : Our Client is an IT consulting organization focused on providing AI Led Digital Transforma...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer - Python / ETL

    Azure Data Engineer - Python / ETL

    Orbion Infotech • Pune
    Description : Role : Azure Data Engineer We are seeking a highly skilled and experienced Azure Data Engineer to join our growing data engineering...Show more
    Last updated: 8 days ago • Promoted
    Coditas - Data Engineer - ETL / PySpark

    Coditas - Data Engineer - ETL / PySpark

    Coditas Technologies Pvt. Ltd. • Pune
    Description : Company Introduction.Coditas is a new-age, offshore product development organization, offering services pertaining to the entire software development li...Show more
    Last updated: 9 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tekfortune IT India Pvt Ltd • Pune
    Description : Title : Azure Data Engineer Experience : 8+ Years Work Location...Show more
    Last updated: 24 days ago • Promoted
    Azure-ETL Engineer

    Azure-ETL Engineer

    Coforge • Pune, Maharashtra, India
    The ideal candidate will be responsible for designing, implementing, and maintaining scalable data solutions that support business intelligence and analytics needs. Design, implement, and maintain d...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • Pune, Maharashtra, India
    Greetings from Tata Consultancy Services!!.We are hiring for Data Engineer.Python, Pyspark, Azure Function.Python, Pyspark, Azure Function, Data Bricks. Location : Azure, ADF, Databricks, Python.Exp...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - ETL / Python

    Data Engineer - ETL / Python

    TekIT Software Solutions Pvt. Ltd. • Pune
    Description : Job Title : Data Engineer.Experience Required : 4+ Years.Job Description : We are looking fo...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Pune, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more
    Last updated: 9 days ago • Promoted
    Data Support Engineer ( Azure, Databricks )

    Data Support Engineer ( Azure, Databricks )

    Kumaran Systems • Pune, IN
    We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
    Last updated: 2 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • Pune, IN
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 10 days ago • Promoted
    6221 Azure Data Engineer

    6221 Azure Data Engineer

    EXL • Pune, Maharashtra, India
    Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more
    Last updated: 8 days ago • Promoted
    Azure Data Lead Engineer

    Azure Data Lead Engineer

    Persistent Systems • Pune, India
    We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Role : Azure Data Lead Engineer.Job Type : Full Time Employment.Design...Show more
    Last updated: 7 days ago • Promoted
    Azure Databricks Engineer

    Azure Databricks Engineer

    Philodesign Technologies Inc • pune, India
    Job Opening : Azure Databricks Engineer (7+ Years Experience) | Budget : ₹1 LPM | Remote / Hybrid.We are seeking a highly skilled. This role is ideal for professionals who have deep expertise in buildin...Show more
    Last updated: 8 hours ago • Promoted • New!
    Azure Data Engineer - Python / PySpark

    Azure Data Engineer - Python / PySpark

    ACENET CONSULTING PRIVATE LIMITED • Pune
    Description : About Us : AceNet Consulting is a fast-growing global business and technology consulting firm specializing in ...Show more
    Last updated: 30+ days ago • Promoted