Azure Data Solutions EngineerUbique Systems • Bengaluru, Republic Of India, IN
Azure Data Solutions Engineer
Ubique Systems • Bengaluru, Republic Of India, IN
13 days ago
Job descriptionDevelop, optimize, and maintain DQ rules in PySpark / Python for self-serve capabilities. Design and implement profiling frameworks for rule generation and automated remediation. Ensure DQ frameworks align with enterprise standards, governance, and audit requirements. Collaborate with front-end teams (Node.Js / Angular) to enable rule configuration, validation, and monitoring via a low-code UI. Develop APIs and services to expose DQ results and outputs for dashboards and self-service tools. Partner with Data Stewards, GPOs, and business owners to translate requirements into technical solutions. Contribute to BRDs, SRDs, and design reviews for DQ rules and pipelines. Provide inputs on governance, compliance, and change management processes. Support periodic reviews and continuous improvements of pipelines, rules, and dashboards. Strong programming skills in PySpark, Python, and SQL. Hands-on experience with Databricks (clusters, notebooks, Delta Lake). Experience designing and implementing CI / CD pipelines (Azure DevOps / GitHub Actions / Jenkins). Familiarity with Node.Js & Angular for UI integration. Solid understanding of data governance, DQ frameworks, and MDM concepts. Strong analytical, problem-solving, and stakeholder engagement skills. Cloud expertise, preferably Azure Data Lake, Data Factory, and Synapse. Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field. 4–8 years of relevant experience in data engineering, CI / CD, and DQ rule development. Proven expertise in Databricks, Azure data services, and low-code self-serve frameworks.
Primary skills : Python, SQL, data lakes, azure
Experience : 4+ years
Immediate Joiner
Key Responsibilities
Pipeline Development & Automation
- Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments.
- Optimize data pipelines and jobs for efficiency, scalability, and enterprise-grade reliability within Azure and Databricks.
- Implement best practices in version control, testing, and automated deployments.
Data Quality & Rule Development
UI & Self-Serve Integration
Collaboration & Governance
Required Skills & Qualifications
Education & Experience
Create a job alert for this search
Azure Data Engineer • Bengaluru, Republic Of India, IN
Related jobs
Azure Data Solutions Architect
PwC India • Bengaluru, Republic Of India, IN
Define reference architectures for lakehouse and medallion patterns using Delta Lake, OneLake, and Synapse / Fabric Lakehouse for scalable analytics and AI.
Create domain-driven data models, canonical...Show more
Last updated: 3 days ago • Promoted
Azure Data Engineer
Tata Consultancy Services • Bengaluru, Karnataka, India
Job Title : Azure Data Engineer With Databricks.Required Skillset : Azure Databricks, SQL, Python, PySpark, ADF, ADB.Location : HYD, Chennai, BLR, Noida, Pune, Kolkata.
Design, develop, and deploy data...Show more
Last updated: 30+ days ago • Promoted
Azure Databricks
Kumaran Systems • Bengaluru, IN
We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.
The candidate should be proficient in Dat...Show more
Last updated: 17 days ago • Promoted
Azure Data Solutions Engineer
Tata Consultancy Services • Bengaluru, Republic Of India, IN
Job Title : Azure Data Engineer With Databricks.Required Skillset : Azure Databricks, SQL, Python, PySpark, ADF, ADB.Location : HYD, Chennai, BLR, Noida, Pune, Kolkata.
Design, develop, and deploy data...Show more
Last updated: 30+ days ago • Promoted
Azure Data Solutions Engineer
Ubique Systems • Bengaluru, Karnataka, India
Primary skills : Python, SQL, data lakes, azure Experience : 4+ years Immediate Joiner Key Responsibilities Pipeline Development & Automation • Design, build, and maintain CI / CD pipelines to aut...Show more
Last updated: 1 day ago • Promoted
Senior Azure Data Engineer
Wissen Infotech • Bengaluru, Karnataka, India
Azure Data Engineer Know anyone who is interested!! Share your resumes to adilakshmi.Wissen Infotech is hiring for Bangalore.
Job Title : Azure Data Engineer.Years of Experience : 8 plus years.Locatio...Show more
Last updated: 30+ days ago • Promoted
Lead Azure Data Engineer
IQVIA • Bengaluru, Karnataka, India
Data Engineering, Python, Azure Databricks, Database, People management experience.Manages a team of professional-level employees.
Develops and communicates plans and priorities to meet team perform...Show more
Last updated: 24 days ago • Promoted
Azure Data Solutions Engineer
LTIMindtree • Bengaluru, Karnataka, India
Job Description : Seeking an experienced Senior Specialist with 7 to 11 years of expertise in Azure Data Factory and Azure SQL to design and manage scalable data integration solutions Design develop...Show more
Last updated: 12 hours ago • Promoted • New!
Azure Data Solutions Architect
IQVIA • Bengaluru, Karnataka, India
Work Experience : 9 to 13 Years Work location : Bengaluru Work Mode : Hybrid Must Have Skills : Data Engineering, Python, Azure Databricks, Database, People management experience Job Overvi...Show more
Last updated: 8 hours ago • Promoted • New!
AWS Lead Data engineer
Tata Consultancy Services • Bengaluru, Karnataka, India
In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show more
Last updated: 28 days ago • Promoted
AWS Data Engineer
Emids • Bengaluru, Karnataka, India
We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team.
The ideal candidate will be responsible fo...Show more
Last updated: 10 days ago • Promoted
Data Solutions Engineer
LatentView Analytics • Bengaluru, Republic Of India, IN
Designing and Implementing Data Pipelines : .Developing and maintaining scalable data pipelines using Databricks and related technologies like Azure Data Factory, Spark, and Python.Creating and optim...Show more
Last updated: 1 day ago • Promoted
AWS Data Architect
ACL Digital • Bengaluru, IN
AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices.
.AWS Certified Solutions Architect preferred.Show more
Last updated: 22 days ago • Promoted
Azure Data Engineer
Paritas Recruitment • Bengaluru, IN
Azure Data Engineer - 6 Month+ Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking an experienced and...Show more
Last updated: 2 days ago • Promoted
Azure Data Engineer
Kagool • Bangalore, IN
We are a fast-growing IT consultancy specialising in the transformation of complex Global enterprises.We are looking for passionate and hardworking individuals that to help deliver for our global c...Show more
Last updated: less than 1 hour ago • Promoted • New!
Azure Data Engineer
Sigmoid • Bengaluru, Karnataka, India
We are looking for a skilled TL Azure Data Engineer with 9+ years of experience in big data technologies, particularly Python, PYSpark, SQL and data lakehouse architectures.The ideal candidate will...Show more
Last updated: 3 days ago • Promoted
Azure Data Lakehouse Engineer
Sigmoid • Bengaluru, Karnataka, India
We are looking for a skilled TL Azure Data Engineer with 9+ years of experience in big data technologies, particularly Python, PYSpark, SQL and data lakehouse architectures.The ideal candidate will...Show more
Last updated: 8 hours ago • Promoted • New!
Azure Data Engineer
LTIMindtree • Bengaluru, Karnataka, India
Seeking an experienced Senior Specialist with 7 to 11 years of expertise in Azure Data Factory and Azure SQL to design and manage scalable data integration solutions.
Design develop and maintain sca...Show more
Last updated: 30+ days ago • Promoted