Azure Data Pipeline Engineer
TVS DigitalBengaluru, Republic Of India, IN3 days ago
Job descriptionDesign and implement scalable data pipelines using Azure Data Factory, Azure Databricks and other Azure services. Build and manage data lakes, data warehouses, and structured / unstructured data storage. Develop and maintain data integration workflows from various on-premises and cloud data sources. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Ensure data quality, consistency, and reliability through robust validation and monitoring. Optimize existing data solutions for performance and cost-efficiency. Implement data security, compliance, and governance practices. Monitor, troubleshoot, and maintain existing data pipelines and systems. 5+ years of experience in data engineering with a strong focus on the Azure cloud ecosystem. Expertise in Azure Data Factory, Azure SQL Database, Data Lake Storage Gen2, and Azure Databricks. Strong SQL and Python / Scala programming skills. Experience with CI / CD, DevOps practices, and version control (e.G., Git). Familiarity with data modeling, data warehousing concepts, and dimensional modeling. Strong understanding of security best practices (RBAC, data masking, encryption). Good communication and stakeholder management skills. Knowledge on finance / SAP would be a plus.
Job Title : Azure Data Engineer
Company Info :
TVS Digital is a digital technology start-up focused on the Fintech & Automotive industry with platforms and services offerings in the Credit & Collection Services and Automotive & Retail domain. We provide IT Services to accelerate digital transformation by partnering with industry renowned platforms (Microsoft, Salesforce, Oracle, SAP) & help to develop center of excellence for our customers. TVS Digital’s mission is to build & deliver high quality software solutions & services to help address real life business challenges of global companies in these domains by harnessing the power of Analytics, Artificial Intelligence (AI), Machine Learning (ML). Our strategy is to leverage inorganic and organic means for the initial build out and subsequent expansion and growth. TVS Digital is a part of TVS Holdings and has also currently invested in several early-stage high tech start-ups globally in areas of connected manufacturing, fleet management and credit services.
Job Summary :
- We are seeking a skilled and experienced Azure Data Engineer to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures using Azure services. Team member is also expected to work closely with data analysts, data scientists, and business stakeholders to ensure seamless data flow and high-quality data delivery.
Key Responsibilities :
Required Skills and Qualifications :
Create a job alert for this search
Data Pipeline Engineer • Bengaluru, Republic Of India, IN
Related jobs
The ideal candidate will have a strong foundation in.Job Title : Azure Data Engineer.Work Timings : 5 : 00 PM to 2 : 00 AM IST.
If your expertise is primarily in.Lead the migration of large-scale SQL work...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticshosur, tamil nadu, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
- Promoted
Azure Data Engineer - Remote work
techolutionhosur, tamil nadu, inRemote
- Promoted
Data Engineer
Recrohosur, tamil nadu, in Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Python Data Engineer
iVoyanthosur, tamil nadu, in One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs.
we use Fast API).Data processing and reporting usin...Show moreLast updated: 15 days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladehosur, tamil nadu, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
Python Data Engineer
Dexian Indiahosur, tamil nadu, in Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 4 days ago
- Promoted
Backend and Data Pipeline Engineer
JRD Systemshosur, tamil nadu, in Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
Tata Consultancy Serviceshosur, tamil nadu, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 12 days ago
- Promoted
Azure Data Engineer
K&K Talents - Indiahosur, tamil nadu, in This position is with one of our.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.Employment Type : Full-time Permanent.
We are seeking an experienced Data Engineer with strong...Show moreLast updated: 24 days ago
- Promoted
AWS Data Engineer
TerraGiGhosur, tamil nadu, in Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 15 days ago
- Promoted
Data Engineer
Tata Consultancy Serviceshosur, tamil nadu, in Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Veraxionhosur, tamil nadu, in Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 15 days ago
- Promoted
Data Engineer
VAANTECHhosur, tamil nadu, in Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer – Azure & AWS
Yoda TechBangalore, IN We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms.
The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 13 days ago
- Promoted
Azure Data Engineer
LTIMindtreeBengaluru, Karnataka, India Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
- Promoted
Senior Azure Data Engineer
Programmers.iohosur, tamil nadu, in Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.
Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Response Informaticshosur, tamil nadu, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
IntraEdgehosur, tamil nadu, in Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago