Talent.com
UST
Data Engineer - Azure Data FactoryUST • Thiruvananthapuram
Data Engineer - Azure Data Factory

Data Engineer - Azure Data Factory

UST • Thiruvananthapuram
24 days ago
Job description

Role: Data Engineer

Experience: 5-10 yrs

Job location: Trivandrum

We are seeking a skilled Azure Data Engineer with 510 years of experience in designing, developing, and maintaining modern data engineering solutions on Microsoft Azure. The ideal candidate will have strong expertise in Azure Data Factory (ADF), Azure Databricks (ADB), and Azure DevOps, with experience building scalable data pipelines, data transformation workflows, and cloud-based analytics platforms.

Key Responsibilities:

- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF).

- Build and optimize data processing workflows using Azure Databricks (PySpark/Scala/SQL).

- Develop ETL/ELT solutions to ingest, transform, and load data from multiple source systems.

- Implement data integration solutions for structured, semi-structured, and unstructured data.

- Collaborate with business analysts, data architects, and stakeholders to understand data requirements.

- Optimize data workflows for performance, scalability, and cost efficiency.

- Implement CI/CD pipelines using Azure DevOps for data engineering solutions.

- Monitor, troubleshoot, and resolve data pipeline failures and performance issues.

- Ensure data quality, security, governance, and compliance with organizational standards.

- Participate in code reviews and promote engineering best practices.

- Create and maintain technical documentation for data pipelines and workflows.

Required Skills:

- 510 years of experience in data engineering or data integration.

- Strong hands-on experience with Azure Data Factory (ADF).

- Expertise in Azure Databricks (ADB) using PySpark, Spark SQL, or Scala.

- Experience with Azure DevOps, including Git repositories, Boards, Pipelines, and CI/CD implementation.

- Strong SQL skills with experience in query optimization and database design.

- Experience working with Azure Data Lake Storage (ADLS) and cloud-based data storage solutions.

- Good understanding of ETL/ELT concepts and data warehousing principles.

- Experience integrating data from APIs, databases, files, and cloud services.

- Strong analytical, troubleshooting, and problem-solving skills.

- Excellent communication and collaboration abilities.

(ref:hirist.tech)
Create a job alert for this search

Data Engineer - Azure Data Factory • Thiruvananthapuram

Similar jobs

Ey - Gds Consulting - Ai And Data - Aws Databrick - Senior

EazyMLThiruvananthapuram, Republic Of India, IN

At EY, we’re all in to shape your future with confidence.We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ... Show more

 • Promoted

Sales Engineer

HeadSpinThiruvananthapuram, Republic Of India, IN

NetWitness is revolutionizing how organizations detect, investigate, and respond to cyber threats.As a leader in SIEM (Security Information and Event Management) and NDR (Network Detection and Resp... Show more

 • Promoted

Lead Product Security Engineer

EnvestnetTrivandrum, KL, IN

The primary work location for this role is Trivandrum with a hybrid work model.Envestnet is an adaptive WealthTech company that is redefining the future of wealth management by helping advisors mee... Show more

Lead Software Development Engineer

EnvestnetTrivandrum, KL, IN

The primary work location for this role is Trivandrum, Kerala with a hybrid work model.Envestnet is an adaptive WealthTech company that is redefining the future of wealth management by helping advi... Show more

Lead Security Engineer - Workspace

EnvestnetTrivandrum, KL, IN

The primary work location for this role is Trivandrum, India with a hybrid/ remote work model.Envestnet is an adaptive WealthTech company that is redefining the future of wealth management by helpi... Show more

Quality Analyst

GuidehouseThiruvananthapuram, Republic Of India, IN

Plans, monitors, direct and evaluate QA production on a daily basis.Ensures that daily schedules are met and communicates with Director, and Coding Operations if situations occur that hinder meetin... Show more

 • Promoted

Software Development Engineer II

EnvestnetTrivandrum, KL, IN

The primary work location for this role is Trivandrum with a hybrid work model.Envestnet is an adaptive WealthTech company that is redefining the future of wealth management by helping advisors mee... Show more

Senior Cyber Security Operations Engineer

EnvestnetTrivandrum, KL, IN

The primary work location for this role is Trivandrum, India with a hybrid/ remote work model.Envestnet is an adaptive WealthTech company that is redefining the future of wealth management by helpi... Show more

Senior Business Systems Analyst

EnvestnetTrivandrum, KL, IN

The primary work location for this role is Trivandrum, India with a remote/ hybrid work model.Envestnet is an adaptive WealthTech company that is redefining the future of wealth management by helpi... Show more

Senior Engineering Systems Administrator - Zscaler

EnvestnetTrivandrum, KL, IN

The Enterprise Applications Engineer will assist in implementation, maintaining enterprise security solutions, and work to resolve end user issues to protect organizational assets and ensure compli... Show more

Senior Analyst Engineer II

ICONTrivandrum, India

ICON plc is a world-leading healthcare intelligence and clinical research organization.We’re proud to foster an inclusive environment driving innovation and excellence, and we welcome you to join u... Show more

Financial Analyst II

EnvestnetTrivandrum, KL, IN

The primary work location for this role is Trivandrum with a hybrid work model.Envestnet is an adaptive WealthTech company that is redefining the future of wealth management by helping advisors mee... Show more