Data EngineerUbique Systems • Bangalore (division)
Data Engineer
Ubique Systems • Bangalore (division)
2 days ago
Job descriptionDevelop, optimize, and maintain DQ rules in PySpark / Python for self-serve capabilities. Design and implement profiling frameworks for rule generation and automated remediation. Ensure DQ frameworks align with enterprise standards, governance, and audit requirements. Collaborate with front-end teams (Node.js / Angular) to enable rule configuration, validation, and monitoring via a low-code UI. Develop APIs and services to expose DQ results and outputs for dashboards and self-service tools. Partner with Data Stewards, GPOs, and business owners to translate requirements into technical solutions. Contribute to BRDs, SRDs, and design reviews for DQ rules and pipelines. Provide inputs on governance, compliance, and change management processes. Support periodic reviews and continuous improvements of pipelines, rules, and dashboards. Strong programming skills in PySpark, Python, and SQL. Hands-on experience with Databricks (clusters, notebooks, Delta Lake). Experience designing and implementing CI / CD pipelines (Azure DevOps / GitHub Actions / Jenkins). Familiarity with Node.js & Angular for UI integration. Solid understanding of data governance, DQ frameworks, and MDM concepts. Strong analytical, problem-solving, and stakeholder engagement skills. Cloud expertise, preferably Azure Data Lake, Data Factory, and Synapse. Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field. 4–8 years of relevant experience in data engineering, CI / CD, and DQ rule development. Proven expertise in Databricks, Azure data services, and low-code self-serve frameworks.
Primary skills : Python, SQL, data lakes, azure
Experience : 4+ years
Immediate Joiner
Key Responsibilities
Pipeline Development & Automation
- Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments.
- Optimize data pipelines and jobs for efficiency, scalability, and enterprise-grade reliability within Azure and Databricks.
- Implement best practices in version control, testing, and automated deployments.
Data Quality & Rule Development
UI & Self-Serve Integration
Collaboration & Governance
Required Skills & Qualifications
Education & Experience
Create a job alert for this search
Data Engineer • Bangalore (division)
Related jobs
Data Engineer
Recro • Tumkur, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Randstad Enterprise • Tumkur, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Digitalzone • Tumkur, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 19 days ago • Promoted
Customer Engineer (Data Engineer)
Konecta • Tumkur, IN
In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
Last updated: 14 hours ago • Promoted • New!
Data Engineer - Palantir Foundry
NP Group • Tumkur, IN
Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Tata Consultancy Services • Tumkur, IN
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
IntraEdge • Tumkur, IN
Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
Last updated: 30+ days ago • Promoted
Google Looker Data Engineer
Insight Global • Tumkur, IN
We’re seeking a skilled Data Engineer to support a major reporting migration from Tableau to Google Looker.This role focuses on designing and building scalable data models, data marts, and ETL / ELT ...Show more
Last updated: 11 days ago • Promoted
Senior Data Engineer
Mindlance • Tumkur, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer
DataOrbit AI • Tumkur, IN
DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness.
By uniting strategy, data preparation, technology, and execution, w...Show more
Last updated: 14 hours ago • Promoted • New!
Data Engineer
BayOne Solutions • Tumkur, IN
We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
MyData Insights Pvt Ltd • Tumkur, IN
The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
Last updated: 3 days ago • Promoted
Data Engineer (GCP)
HISH IT SERVICES • Tumkur, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 11 days ago • Promoted
Data Engineer
Aceolution • Tumkur, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted
AWS Data Engineer
Vista Applied Solutions Group Inc • Tumkur, IN
Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions).
Hands-on with AWS : Glue, Lambda, Redshif...Show more
Last updated: 5 days ago • Promoted
Data Engineer
Insight Global • Tumkur, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
Databricks Engineer
TTC Group • Tumkur, IN
We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show more
Last updated: 3 days ago • Promoted
GCP Data Engineer
Xsell Resources • Tumkur, IN
Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days.
GCP Google Cloud Professional Data Engineer Certi...Show more
Last updated: 18 days ago • Promoted