Talent.com
This job offer is not available in your country.
Azure Data Engineer

Azure Data Engineer

Huntsmen and baronsBangalore
28 days ago
Job description

Job Summary :

We are seeking a highly skilled and motivated Azure Data Engineer to join our innovative data engineering team.

The ideal candidate will have deep expertise in designing, building, and optimizing end-to-end data pipelines and data platforms within the Microsoft Azure ecosystem.

This role involves ingesting, transforming, and modeling large volumes of data from diverse sources including legacy on-premise systems such as mainframesto enable accurate, timely, and actionable business insights.

Your contributions will be pivotal in building scalable, secure, and high-performance data solutions that support enterprise-wide analytics and Responsibilities :

  • Design, develop, deploy, and maintain robust, scalable, and efficient data pipelines using Azure Data Factory and Azure Databricks (leveraging Apache Spark with PySpark or Scala) to process both batch and streaming data workloads.
  • Build and optimize semantic data models, ensuring high performance, maintainability, and seamless integration with platforms such as Rahona or equivalent BI / reporting tools.
  • Extract, transform, and load data from a wide range of on-premise sources including mainframe systems, SQL Server, Oracle databases, and file-based systems, ensuring data integrity and completeness throughout the pipeline.
  • Utilize big data frameworks and tools such as Sqoop for data transfer between relational databases and Hadoop, and leverage Hadoop ecosystem components for large-scale data processing where appropriate.
  • Manage comprehensive metadata and documentation for data ingestion workflows and business requirements, utilizing tools like Microsoft Excel and centralized documentation repositories to ensure transparency and traceability.
  • Write clean, modular, and reusable code using Python, Scala, or Java to automate data transformations, pipeline orchestration, and error handling processes.
  • Use advanced SQL techniques (T-SQL, PL / SQL) to perform complex querying, data manipulation, and aggregation to support downstream data needs and analytics.
  • Manage secure file transfers and ingestion processes via dedicated mailboxes or secure FTP, ensuring compliance with data security policies and governance.
  • Develop and maintain automated CI / CD pipelines using tools like Git for version control and Jenkins for build, test, and deployment automation, enabling faster and more reliable delivery of data engineering solutions.
  • Schedule, monitor, and troubleshoot data jobs and workflows using orchestration and scheduling tools such as Autosys or Oozie, ensuring timely and successful execution of data pipelines.
  • Work closely with data scientists, analysts, business stakeholders, and IT teams to gather requirements, design scalable data solutions, and deliver high-quality outputs that align with business goals.
  • Continuously monitor data pipeline health and performance, identify bottlenecks, troubleshoot issues proactively, and implement improvements to ensure data quality, reliability, and Skills & Experience :
  • Demonstrated expertise with Azure Data Factory, Azure Databricks, and Apache Spark (PySpark or Scala) for building scalable data pipelines.
  • Strong background in data modeling, schema design, and query performance tuning within cloud data platforms.
  • In-depth knowledge of various data ingestion patterns and techniques, particularly for extracting data from complex on-premise legacy systems into cloud environments.
  • Proficiency in programming with Python, Scala, or Java, including writing production-quality code for data transformation and automation.
  • Advanced skills in SQL (T-SQL, PL / SQL) for data extraction, transformation, and complex querying.
  • Hands-on experience with Git for source control and Jenkins or similar tools for CI / CD pipeline creation and maintenance.
  • Familiarity with job orchestration and scheduling tools such as Autosys or Oozie to manage and automate workflows efficiently.
  • Strong competency in metadata management and documentation practices using Microsoft Excel or equivalent tools.
  • Excellent analytical, problem-solving, and debugging skills with meticulous attention to detail.
  • Ability to work effectively both independently and as part of a collaborative team in an Agile development environment

ref : hirist.tech)

Create a job alert for this search

Azure Data Engineer • Bangalore

Related jobs
Azure Data Engineer

Azure Data Engineer

Talent WorxBengaluru, KA, IN
Quick Apply
Global consulting firm seeking an Azure Data Engineer to join our dynamic team.As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows ...Show moreLast updated: 30+ days ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

Squareroot ConsultingBangalore
Role : Data Engineer Exp : 3-5 Yrs Job location : Hybrid Only immed...Show moreLast updated: 6 days ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

Tata Consultancy ServicesGreater Bengaluru Area, India
Job Title : Azure Data Engineer.Required Skillset : Data Lake architecture, Azure Services – ADLS, ADF, Azure Databricks, Synapse. Location : Noida, Bangalore, Kolkata, Thane, Pune, Hyderabad, Chennai....Show moreLast updated: 10 days ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

Akshaya IT Business solutionsBangalore
Job Description : Responsibilities : - Design, develop, and maintain scalable and reliable data pipelines using Azure Data Facto...Show moreLast updated: 30+ days ago
Azure Data Engineer

Azure Data Engineer

TEKsystems Global Services in IndiaBengaluru, Karnataka, India
Urgent Hiring : Azure Data Engineer | Bangalore | Work From Office (WFO).We are actively seeking a skilled.Key Responsibilities & Requirements : . Azure Data Factory, Azure Databricks, Azure SQL Databa...Show moreLast updated: 1 day ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

ChangeleadersBangalore
Candidate Requirements : - Candidate must be proficient in Databricks - Understands where to obtain information needed to make the appropriate de...Show moreLast updated: 30+ days ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

Cloudesign TechnologyBangalore
Role : Azure Data Engineer Location : Bangalore (JP Nagar Hybrid Model) Exp : 7- 9 Years<...Show moreLast updated: 18 days ago
Azure Data Engineer

Azure Data Engineer

Feasible Technologies Pvt LtdBangalore, Karnataka, India
Develop maintain and optimize scalable.Azure Databricks (ADB) and PySpark.Work with structured and unstructured data sources ensuring. Required Skills & Qualifications : .Azure Data Lake Azure Dat...Show moreLast updated: 30+ days ago
Azure Data Engineer

Azure Data Engineer

RecroBengaluru, Karnataka, India
We are seeking a highly skilled.The ideal candidate will have hands-on experience with.Azure Data Factory, Databricks, PySpark, and Azure Synapse Analytics. SQL and CI / CD (DevOps) practices.Design a...Show moreLast updated: 1 day ago
Azure Data Engineer

Azure Data Engineer

Epergne SolutionsBengaluru, Karnataka, India
Quick Apply
Epergne Solutions is looking for Azure Data Engineers across PAN India Locations.Work Location : Bangalore / Hyderabad / Pune. Microsoft Azure, ensuring data flows smoothly from various sources to d...Show moreLast updated: 30+ days ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

QUARKS TECHNOSOFT PRIVATE LIMITEDBangalore
Location : : 5- 10 years Job Type : Full-time Domain : Data Engineering / Azure Cloud / Data War...Show moreLast updated: 26 days ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

Qualintia solutionsBangalore
Job Title : Azure Data Engineer Experience : 6+ Years Location : Onsite - Pune, Bangalore, GurgaonShow moreLast updated: 30+ days ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

RandomTreesBangalore, IN
We are seeking a skilled and experienced.The ideal candidate will have a strong background in building and optimizing data pipelines and data sets, utilizing Azure Data Factory, Databricks, PySpark...Show moreLast updated: 25 days ago
Azure Data Engineer

Azure Data Engineer

Awign ExpertBangalore North, KA, in
Quick Apply
Azure Cloud Technologies, Azure Data Factory, Azure Databricks (Advance Knowledge), PySpark, CI / CD Pipeline (Jenkins, GitLab CI / CD or Azure DevOps), Data Ingestion, SOL. Seeking a skilled Data Engin...Show moreLast updated: 29 days ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

TEAM GEEK SOLUTIONS PRIVATE LIMITEDBangalore
Job Summary : We are seeking a skilled and proactive Azure Data Engineer with 3 to 7 years of experience to join our growing team in Bangalore (Hy...Show moreLast updated: 8 days ago
Azure Data Engineer

Azure Data Engineer

KPMG IndiaBengaluru, Karnataka, India
Bangalore, Pune, Hyderabad, Gurugram (India).We are seeking a skilled and experienced.The ideal candidate will have a strong background in designing and implementing scalable data solutions using M...Show moreLast updated: 1 day ago
  • Promoted
Azure Data Engineer

Azure Data Engineer

VDart MalaysiaBengaluru, Karnataka, India
We are Purpose Driven, High Growth and a Great Place to Work Certified Organization!.VDart Malaysia is one of the fastest growing talent management and digital solution providers established in the...Show moreLast updated: 1 day ago
Azure Data Engineer

Azure Data Engineer

DeloitteBangalore Urban, Karnataka, India
Technology & Transformation : EAD : Azure Data Engineer-Consultant / Senior Consultant / Manager.India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportu...Show moreLast updated: 13 days ago