Talent.com
Azure Big data Engineer

Azure Big data Engineer

ConfidentialBengaluru / Bangalore, Hyderabad / Secunderabad, Telangana
30+ days ago
Job description
  • Overall 4 8 years of experience with a minimum 4+ years of relevant professional work experience with Azure Synapse and Azure Databricks
  • ETL Consultant - Databricks / ADF / Synapse, building common logging mechanism for all ETL processes, Build the ingestion process for fact data tables, Building the pipeline temporary pipeline to load data into on premise, Prepare the flow diagram covering it up all required ETLs Prepare folder design document Netezza Box
  • Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
  • Work together with data analysts to understand the needs for data and create effective data workflows.
  • Create and maintain data storage solutions including Azure Databricks, Azure Functions, Azure Data Lake, Azure Synapse, Azure Integration Services, Azure API Management, CI / CD and PowerShell Scripts, ADF, ETL Pipelines, Unity Catalog, Azure SQL Database, SQL Coding, Azure SQL Database, Azure Data Lake.
  • Utilizing Azure Data Factory to create and maintain ETL (Extract, Transform, Load) operations using ADF pipelines.
  • Hands-On Experience working on Data Bricks for implementing Transformations and Delta Lake.
  • Hands-On Experience working on Serverless SQL Pool, Dedicated SQL Pool.
  • Use ADF pipelines to orchestrate the end to end data transformation including the execution of DataBricks notebooks.
  • Should have experience working on Medallion Architecture
  • Experience working on CI / CD pipelines using Azure DevOps
  • Attaching both ADF and ADB to DevOps
  • Creating and managing Azure infrastructure across the landscape using Bicep
  • Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
  • Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
  • Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.
  • Good to have exposure on Power BI, Power Automate
  • Good to have knowledge on Azure fundamentals.
  • Desirable skills

    • Good ability to anticipate issues and formulate remedial actions
    • Sound interpersonal and team working skills
    • Sound Knowledge of unit testing methodologies and frameworks
    • Should be able to work independently
    • Good communication skills
    • Skills Required

      Sql Database, Azure Data Lake

    Create a job alert for this search

    Data Engineer Data • Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana

    Related jobs
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.ioHyderabad, Telangana, India
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekhyderabad, telangana, in
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer – Big Data & AWS (Python + PySpark)

    Senior Data Engineer – Big Data & AWS (Python + PySpark)

    CoforgeHyderabad, India
    We are hiring for the position of Senior Data Engineer – Big Data & AWS (Python + PySpark) at Coforge Ltd.Job Location : Greater Noida & Hyderabad Only. If you are a data enthusiast with a passion fo...Show moreLast updated: 16 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesHyderabad, Telangana, India
    Databricks, Azure, Python, Pyspark,.Interview Date : Weekend InPerson Drive 18-Oct-25.Location of Requirement- Hyderabad. Follow me for more Job updates!.Show moreLast updated: 30+ days ago
    • Promoted
    Azure data engineer

    Azure data engineer

    Tata Consultancy ServicesHyderabad, Telangana, India
    Greetings from TATA Consultancy Services.Azure data engineer (Pyspark , databricks , adf).Hyderabad, Kolkata, Bangalore, Pune, Chennai, Delhi. Pls find the Job Description below.Experience in Pyspar...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer- Snowflake

    Data Engineer- Snowflake

    Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India
    Job Description : We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipeli...Show moreLast updated: 21 days ago
    • Promoted
    Big Data Engineer - Hadoop / Spark

    Big Data Engineer - Hadoop / Spark

    ImpacteersHydrebad
    Position Overview : We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures.The ...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Bright & Smart HR SolutionsHyderabad, Telangana, India
    Work from Office (5 Days Working).Delta Lake, Spark, PySpark, SQL), .ETL / ELT pipeline development, InfluxDB or time-series data. First Round (Virtual) – Assessment test.Second Round (In-Person)– T...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer - Snowflake / AWS

    Senior Data Engineer - Snowflake / AWS

    ResourcetreeHyderabad
    About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer - Azure Cloud

    Data Engineer - Azure Cloud

    Texplorers IncHyderabad
    Data Engineer Job Description : Job Location : Hyderabad We are seeking a hands-on Data Engineer with a s...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Siyaton Software Solutions Pvt LtdHyderabad
    Job Title : Azure Data Engineer & Developer Location : Hyderabad, India Experience : Around 5 Years Start Date : Immediate Join...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladehyderabad, telangana, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 18 days ago
    • Promoted
    Nomiso - Data Engineer - Big Data Technologies

    Nomiso - Data Engineer - Big Data Technologies

    NOMISO INDIA PRIVATE LIMITEDHyderabad
    Roles and Responsibilities : - Create and maintain efficient and scalable data models as per business needs ...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Senior Data Engineer

    AWS Senior Data Engineer

    Tata Consultancy Serviceshyderabad, telangana, in
    Snowflake, dbt, Snowpipe, AWS services : AWS Lambda, Managed Airflow (MWAA),.Interview Date : Weekend InPerson Drive 18-Oct-25. Experience Range : 10 to 15 yrs.Location of Requirement- Hyderabad.Follow...Show moreLast updated: 7 days ago
    • Promoted
    Senior Azure Data Engineer (Snowflake and ADF)

    Senior Azure Data Engineer (Snowflake and ADF)

    Coforgehyderabad, telangana, in
    We are Hiring : Senior Azure Data Engineer (Snowflake and ADF) at Coforge Ltd.Greater Noida, Pune & Hyderabad Only.Send your updated CV to : Gaurav. WhatsApp for queries : 9667427662.This role is ideal...Show moreLast updated: 7 days ago
    • Promoted
    Azure Databricks Engineer

    Azure Databricks Engineer

    TechMantra GlobalHyderabad
    Role : Azure Databricks.Location : Any Hyderabad, Chennai , Bangalore , Pune , Noida, Gurgaon are preferred.Skills : Azure, Notebooks, Spark-Scala, Bigdata, Cloudera P...Show moreLast updated: 22 days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Tata Consultancy ServicesHyderabad, Telangana, India
    Minimum of 3+ years of working experience with.Datawarehouse and data lake service.Obvious track record of designing and implementing. Exposed to ETL / ELT and governance tools (incl.Experience within...Show moreLast updated: 7 days ago
    • Promoted
    Brightedge - Big Data Engineer - ETL / Python

    Brightedge - Big Data Engineer - ETL / Python

    brightedgeHyderabad
    About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results.Our platform processes m...Show moreLast updated: 30+ days ago