Data EngineerUbique Systems • Bengaluru, Karnataka, India
Data Engineer
Ubique Systems • Bengaluru, Karnataka, India
4 days ago
Job descriptionDevelop, optimize, and maintain DQ rules in PySpark / Python for self-serve capabilities. Design and implement profiling frameworks for rule generation and automated remediation. Ensure DQ frameworks align with enterprise standards, governance, and audit requirements. Collaborate with front-end teams (Node.js / Angular) to enable rule configuration, validation, and monitoring via a low-code UI. Develop APIs and services to expose DQ results and outputs for dashboards and self-service tools. Partner with Data Stewards, GPOs, and business owners to translate requirements into technical solutions. Contribute to BRDs, SRDs, and design reviews for DQ rules and pipelines. Provide inputs on governance, compliance, and change management processes. Support periodic reviews and continuous improvements of pipelines, rules, and dashboards. Strong programming skills in PySpark, Python, and SQL. Hands-on experience with Databricks (clusters, notebooks, Delta Lake). Experience designing and implementing CI / CD pipelines (Azure DevOps / GitHub Actions / Jenkins). Familiarity with Node.js & Angular for UI integration. Solid understanding of data governance, DQ frameworks, and MDM concepts. Strong analytical, problem-solving, and stakeholder engagement skills. Cloud expertise, preferably Azure Data Lake, Data Factory, and Synapse. Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field. 4–8 years of relevant experience in data engineering, CI / CD, and DQ rule development. Proven expertise in Databricks, Azure data services, and low-code self-serve frameworks.
Primary skills : Python, SQL, data lakes, azure
Experience : 4+ years
Immediate Joiner
Key Responsibilities
Pipeline Development & Automation
- Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments.
- Optimize data pipelines and jobs for efficiency, scalability, and enterprise-grade reliability within Azure and Databricks.
- Implement best practices in version control, testing, and automated deployments.
Data Quality & Rule Development
UI & Self-Serve Integration
Collaboration & Governance
Required Skills & Qualifications
Education & Experience
Create a job alert for this search
Data Engineer • Bengaluru, Karnataka, India
Related jobs
)
)
Data Engineer 2
Yubi • Bangalore Urban, Karnataka, India
As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Net2Source (N2S) • bangalore, India
Join a Global Leader in Workforce Solutions – Net2Source Inc.Show more
Last updated: 19 hours ago • Promoted • New!
Data Engineer
Recro • Bangalore, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
The Customization Group • Bengaluru, Karnataka, India
An information technology firm that provides consulting services in IT, software, and advanced areas such as Artificial Intelligence.
By leveraging latest technologies, we offer.We have a brand-new ...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Synechron • Bengaluru, Republic Of India, IN
We have immediate opportunity for AWS data engineer.At Synechron, we believe in the power of digital to transform businesses for the better.
Our global consulting firm combines creativity and innova...Show more
Last updated: 30+ days ago • Promoted
Data Engineer, CMT Dataplatform & Analytics
Amazon • Bengaluru, Karnataka, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly.DESCRIPTION : Amaz...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Insight Global • bangalore district, karnataka, in
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
Data Engineer - Palantir Foundry
NP Group • bangalore district, India
Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
Last updated: 11 days ago • Promoted
Data Engineer
Digitalzone • Bengaluru, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 22 days ago • Promoted
Data Engineer I, CMT Dataplatform & Analytics
Amazon • Bengaluru, Karnataka, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly.DESCRIPTION : Amaz...Show more
Last updated: 28 days ago • Promoted
Data Engineer 1
Aqilea (formerly Soltia) • Bangalore, Karnataka, India
We are a consulting company with a bunch of technology-interested and happy people!.We love technology we love design and we love quality.
Our diversity makes us unique and creates an inclusive and ...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Selector • Bengaluru, Karnataka, India
Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimensional.It enables ope...Show more
Last updated: 30+ days ago • Promoted
Data Engineer-1
Confidential • Bengaluru / Bangalore, India
We are brand builders who focus our passion and creativity to build Calvin Klein and TOMMY HILFIGER into the most desirable lifestyle brands in the world and at the same time position PVH as one of...Show more
Last updated: 26 days ago • Promoted
Customer Engineer (Data Engineer)
Konecta • Bengaluru, IN
In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
Last updated: 3 days ago • Promoted
Data Engineer
Mareana • Bengaluru, Karnataka, India
Data Engineer Bangalore / Full-Time Job Description Mareana is looking for experienced Data Engineer with a strong development background using, RDMS, graph database and NoSQL platforms.This role...Show more
Last updated: 30+ days ago • Promoted
Data Engineer I, CMT Dataplatform & Analytics
Confidential • Bengaluru / Bangalore, India
Amazon strives to be Earth's most customer-centric company where people can find and discover virtually anything they want to buy online.
By giving customers more of what they want - low prices, vas...Show more
Last updated: 10 days ago • Promoted
Data Engineer
Grid Dynamics • Bengaluru, Karnataka, India
Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies.
Grid Dynamics provides digital tra...Show more
Last updated: 30+ days ago • Promoted
Data Engineer l
Confidential • Bengaluru / Bangalore, India
Come join our passionate team! Barracuda is a leading cybersecurity company providing complete protection against complex threats.
Our platform protects email, data, applications, and networks with ...Show more
Last updated: 3 days ago • Promoted