Talent.com
This job offer is not available in your country.
Azure Data Engineer

Azure Data Engineer

Akshaya IT Business solutionsBangalore
30+ days ago
Job description

Job Description : Responsibilities :

  • Design, develop, and maintain scalable and reliable data pipelines using Azure Data Factory (ADF) or Azure Synapse Pipelines to ingest, process, and transform large volumes of data from various sources (on premises, cloud, APIs, etc.).
  • Build and optimize data warehousing solutions on Azure Synapse Analytics (dedicated SQL pools or serverless SQL pools) or Azure SQL Database, ensuring efficient data storage, retrieval, and performance.
  • Implement and manage data lakes on Azure Data Lake Storage (ADLS Gen2) for storing structured, semi-structured, and unstructured data.
  • Develop and implement data quality frameworks and processes to ensure data accuracy, consistency, and integrity throughout the data lifecycle.
  • Design and implement data governance policies and procedures in collaboration with data governance teams.
  • Utilize Azure Databricks with Spark (PySpark or Scala) for advanced data processing, transformations, and analytics.
  • Implement data streaming solutions using Azure Event Hubs, Azure IoT Hub, or Azure Stream Analytics for real-time data ingestion and processing.
  • Develop and deploy data integration solutions using various Azure services and custom code as needed.
  • Monitor and troubleshoot data pipelines, data warehousing solutions, and data quality processes, ensuring high availability and performance.
  • Implement security measures for data storage and processing in Azure, adhering to best practices and compliance requirements.
  • Collaborate with data scientists, analysts, and business stakeholders to understand their data requirements and deliver solutions that meet their needs.
  • Automate data engineering tasks and deployments using Infrastructure-as-Code (IaC) tools like ARM templates or Terraform.
  • Stay up-to-date with the latest Azure data services and technologies and evaluate their potential application to our data architecture.
  • Optimize data pipelines and queries for performance and cost efficiency.
  • Document data pipelines, data models, and data engineering processes.
  • Participate in code reviews and ensure adherence to coding standards and best practices.
  • Potentially mentor and guide junior data engineers within the team.

Technical Qualifications :

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
  • 4+ years of hands-on experience in designing, building, and maintaining data pipelines and data warehousing solutions.
  • Extensive experience with Microsoft Azure data services, including :
  • 1. Azure Data Factory (ADF) or Azure Synapse Pipelines : Strong proficiency in creating and managing complex ETL / ELT pipelines.

    2. Azure Synapse Analytics (Dedicated SQL Pools and / or Serverless SQL Pools) or Azure SQL Database : Deep understanding of data warehousing concepts, schema design, performance tuning, and SQL.

    3. Azure Data Lake Storage (ADLS Gen2) : Experience in designing and managing data lakes.

    4. Azure Databricks : Strong experience with Spark (PySpark or Scala) for large-scale data processing and analytics.

    5. Azure Blob Storage : Understanding of different storage tiers and best practices.

  • Solid understanding of data modeling concepts (e.g., dimensional modeling, star schema, snowflake schema).
  • Strong SQL skills with experience in writing complex queries, stored procedures, and optimizing query performance.
  • Proficiency in at least one programming language, preferably Python, for data manipulation and automation.
  • Experience with data integration techniques and tools, including REST APIs and other data connectors.
  • Understanding of data quality principles and experience implementing data quality checks and monitoring.
  • Experience with CI / CD pipelines for data engineering deployments.
  • Familiarity with Infrastructure-as-Code (IaC) tools like ARM templates or Terraform.
  • Knowledge of data governance and security best practices in Azure.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and manage time effectively in a fast-paced environment. -
  • Preferred Qualifications :

  • Microsoft Azure Data Engineer certifications (DP-203 : Data Engineering on Microsoft Azure).
  • Experience with data streaming technologies like Azure Event Hubs, Azure IoT Hub, or Azure Stream Analytics.
  • Experience with NoSQL databases on Azure (Cosmos DB).
  • Familiarity with data science workflows and tools on Azure Machine Learning.
  • Experience with data visualization tools like Power BI.
  • Knowledge of DevOps practices and tools.
  • ref : hirist.tech)

    Create a job alert for this search

    Azure Data Engineer • Bangalore

    Related jobs
    Azure Data Engineer

    Azure Data Engineer

    Talent WorxBengaluru, KA, IN
    Quick Apply
    Global consulting firm seeking an Azure Data Engineer to join our dynamic team.As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows ...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Cloudesign TechnologyBangalore
    Role : Azure Data Engineer Location : Bangalore (JP Nagar Hybrid Model) Exp : 7- 9 Years<...Show moreLast updated: 18 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    ChangeleadersBangalore
    Candidate Requirements : - Candidate must be proficient in Databricks - Understands where to obtain information needed to make the appropriate de...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    DeloitteBangalore Urban, Karnataka, India
    Technology & Transformation : EAD : Azure Data Engineer-Consultant / Senior Consultant / Manager.India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportu...Show moreLast updated: 24 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    TEKsystems Global Services in IndiaBengaluru, Karnataka, India
    Urgent Hiring : Azure Data Engineer | Bangalore | Work From Office (WFO).We are actively seeking a skilled.Key Responsibilities & Requirements : . Azure Data Factory, Azure Databricks, Azure SQL Databa...Show moreLast updated: 2 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Squareroot ConsultingBangalore
    Role : Data Engineer Exp : 3-5 Yrs Job location : Hybrid Only immed...Show moreLast updated: 6 days ago
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Must have 10 years of IT Experience.Azure Data Factory, Databricks.SQL Query writing / optimization.Show moreLast updated: 13 days ago
    Azure Data Engineer

    Azure Data Engineer

    Feasible Technologies Pvt LtdBangalore, Karnataka, India
    Develop maintain and optimize scalable.Azure Databricks (ADB) and PySpark.Work with structured and unstructured data sources ensuring. Required Skills & Qualifications : .Azure Data Lake Azure Dat...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    QUARKS TECHNOSOFT PRIVATE LIMITEDBangalore
    Location : : 5- 10 years Job Type : Full-time Domain : Data Engineering / Azure Cloud / Data War...Show moreLast updated: 26 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Qualintia solutionsBangalore
    Job Title : Azure Data Engineer Experience : 6+ Years Location : Onsite - Pune, Bangalore, GurgaonShow moreLast updated: 30+ days ago
    Azure Data Engineer

    Azure Data Engineer

    Epergne SolutionsBengaluru, Karnataka, India
    Quick Apply
    Epergne Solutions is looking for Azure Data Engineers across PAN India Locations.Work Location : Bangalore / Hyderabad / Pune. Microsoft Azure, ensuring data flows smoothly from various sources to d...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    RandomTreesBangalore, IN
    We are seeking a skilled and experienced.The ideal candidate will have a strong background in building and optimizing data pipelines and data sets, utilizing Azure Data Factory, Databricks, PySpark...Show moreLast updated: 26 days ago
    Azure Data Engineer

    Azure Data Engineer

    Awign ExpertBangalore North, KA, in
    Quick Apply
    Azure Cloud Technologies, Azure Data Factory, Azure Databricks (Advance Knowledge), PySpark, CI / CD Pipeline (Jenkins, GitLab CI / CD or Azure DevOps), Data Ingestion, SOL. Seeking a skilled Data Engin...Show moreLast updated: 29 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    TEAM GEEK SOLUTIONS PRIVATE LIMITEDBangalore
    Job Summary : We are seeking a skilled and proactive Azure Data Engineer with 3 to 7 years of experience to join our growing team in Bangalore (Hy...Show moreLast updated: 8 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    VDart MalaysiaBengaluru, Karnataka, India
    We are Purpose Driven, High Growth and a Great Place to Work Certified Organization!.VDart Malaysia is one of the fastest growing talent management and digital solution providers established in the...Show moreLast updated: 2 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    RecroBengaluru, Karnataka, India
    We are seeking a highly skilled.The ideal candidate will have hands-on experience with.Azure Data Factory, Databricks, PySpark, and Azure Synapse Analytics. SQL and CI / CD (DevOps) practices.Design a...Show moreLast updated: 2 days ago
    Data Engineer (Azure)

    Data Engineer (Azure)

    Talent SocioBangalore, KA, India
    Quick Apply
    About the client : Our client is one of India's leading omnichannel sleep & comfort solutions brands, with 800+ retail stores, a f...Show moreLast updated: 4 days ago
    Azure Data Engineer

    Azure Data Engineer

    ArcadisBangalore, Karnataka, India
    Azure Data Engineer with a passion to drive and execute Digital to the core of everything we do.We firmly believe in Everything Digital Digital Everything. We are transforming we are reimagining the...Show moreLast updated: 30+ days ago