Lead Azure Data Pipeline EngineerAll European Careers • Republic Of India, IN
Lead Azure Data Pipeline Engineer
All European Careers • Republic Of India, IN
7 days ago
Job descriptionBachelor or Master degree; 8 years of experience in Data Modeling, Data / Information Architecture, Metadata Management, Master Data management, Data Governance & Data Quality. Expertise on Azure platforms including experience in Azure Databricks, ADLS, Synapse and its various components is mandatory; In-dept knowledge and hands-on experience in Microsoft Azure data stack i.E., Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions, Logic apps, Spark and Python / PySpark programming etc; Strong experience with designing ETL / ELT Pipelines / Data flows using Azure Data Factory as Primary skill and SSIS / Informatica as additional skills; Must have strong development & design skills in leading RDBMS environments e.G. MS SQL Server and Oracle; Expertise experience in complex SQL queries is required; Experience of Big data approach, architectural concepts, data sourcing / ingestion / curation and storage mechanisms; Experience withreal-time / near-real-time Data warehousing concepts and Design approaches; Should have executed end-to-end projects focusing on analytics, data warehousing, enterprise reporting; Leveraging components like Azure Automation, Azure Power Shell Scripting, Az Copy, Devops / ARM Templates; Should have thorough understanding of Data-lakes, raw / enriched / curated layer concepts and ETL within Azure framework; Highly skilled in end-to-end Data warehousing and BI (analytics) design / development; Create Design, Functional / Technical specification documentations or any artifacts needed; Fluent in English;
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databricks.
We are looking for a motivated contractor. Candidates need tbe fluent in English.
Tasks and responsibilities :
- Build data integration feeds according to the requirement;
- Review the business requirements and design the Pipelines that loads data into Azure Data Lakes or Azure Data warehouses, Azure Synapse, Azure Databricks or Cloud services. etc;
- Developing pipelines between different data sources including XML, flat files, SAP and databases.
- Strong Experience in Data Modeling, Data / Information Architecture, Metadata Management, Master Data management, Data Governance & Data Quality;
- Strong analytical abilities required to evaluate work and provide technical assistance;
- Perform Code optimization and strictly adhere IFC standards;
- Expertise in monitoring and improving performance of the Azure data feeds;
- Create Design, Functional / Technical specification documentations or any artifacts needed;
Profile :
Create a job alert for this search
Data Pipeline Engineer • Republic Of India, IN
Related jobs
Azure Data Pipeline Specialist
Coforge • Pune, Republic Of India, IN
The ideal candidate will be responsible for designing, implementing, and maintaining scalable data solutions that support business intelligence and analytics needs.
Design, implement, and maintain d...Show more
Last updated: 30+ days ago • Promoted
Lead Data Pipeline Engineer
ListenFirst • Jaipur, Republic Of India, IN
We are looking for a skilled and motivated Senior Data Engineer with strong experience in data engineering and ETL processes.
The ideal candidate should be comfortable working with any object-orient...Show more
Last updated: 30+ days ago • Promoted
Senior Data Pipeline Engineer
HNR Tech • Republic Of India, IN
We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show more
Last updated: 7 days ago • Promoted
Lead Data Pipeline Engineer
EXL • Pune, Republic Of India, IN
Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
Leverage technologies and solutions to innovate with increasingly larg...Show more
Last updated: 30+ days ago • Promoted
Azure Data Pipeline Engineer
Recro • Republic Of India, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 24 days ago • Promoted
Lead Data Pipeline Engineer
PwC India • Republic Of India, IN
As a Senior Associate, you will take ownership of designing and delivering complex data engineering solutions across cloud and on-premise environments.
You’ll lead the technical delivery of ETL / ELT ...Show more
Last updated: 9 days ago • Promoted
Lead Data Pipeline Engineer
Persistent Systems • Pune, Republic Of India, IN
We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services.
The ideal candidate will have a strong backgro...Show more
Last updated: 30+ days ago • Promoted
Lead Data Pipeline Engineer
Eucloid Data Solutions • Chennai, Republic Of India, IN
Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
Last updated: 22 days ago • Promoted
Data Pipeline Engineer
Luxoft • Chennai, Republic Of India, IN
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show more
Last updated: 3 days ago • Promoted
Azure Data Pipeline Specialist
Tata Consultancy Services • Republic Of India, IN
TCS is hiring for Azure Data Engineer.Designing and implementing data storage solutions on Azure.Azure data engineer is to design and implement data storage solutions on Azure.That includes selecti...Show more
Last updated: 9 days ago • Promoted
Azure Data Pipeline Engineer
EXL • Pune, Republic Of India, IN
Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more
Last updated: 9 days ago • Promoted
Lead Data Pipeline Engineer
MakeMyTrip • Republic Of India, IN
At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
Last updated: 24 days ago • Promoted
Azure Data Pipeline Engineer
Deloitte • Republic Of India, IN
India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organisations ...Show more
Last updated: 30+ days ago • Promoted
Lead Data Pipeline Engineer
Matrimony.com Limited • Chennai, Republic Of India, IN
Work Location : Chennai (Work From Office).The Decision Support Systems (DSS) function enables data-driven decision-making across Matrimony.
Com by delivering high-quality data pipelines, analytical ...Show more
Last updated: 17 days ago • Promoted
Senior Data Pipeline Engineer
VXI Global Solutions • Republic Of India, IN
We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success.
As a Data Engineer at VXI Glo...Show more
Last updated: 30+ days ago • Promoted
Lead Data Pipeline Engineer
Saks Global India • Republic Of India, IN
Data Engineer and Operations Lead.Saks Global is the largest multi-brand luxury retailer in the world, comprising Saks Fifth Avenue, Neiman Marcus, Bergdorf Goodman, Saks OFF 5TH, Last Call and Hor...Show more
Last updated: 30+ days ago • Promoted
Lead Azure Data Pipeline Architect
All European Careers • Republic Of India, IN
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
Last updated: 9 days ago • Promoted
Lead Data Pipeline Engineer
RapidBrains • Republic Of India, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 15 days ago • Promoted