Data Engineer

Ubique SystemsBengaluru, Karnataka, India

1 day ago

Job description

Primary skills : Python, SQL, data lakes, azure

Experience : 4+ years

Immediate Joiner

Key Responsibilities

Pipeline Development & Automation

Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments.
Optimize data pipelines and jobs for efficiency, scalability, and enterprise-grade reliability within Azure and Databricks.
Implement best practices in version control, testing, and automated deployments.

Data Quality & Rule Development

Develop, optimize, and maintain DQ rules in PySpark / Python for self-serve capabilities.

Design and implement profiling frameworks for rule generation and automated remediation.

Ensure DQ frameworks align with enterprise standards, governance, and audit requirements.

UI & Self-Serve Integration

Collaborate with front-end teams (Node.js / Angular) to enable rule configuration, validation, and monitoring via a low-code UI.

Develop APIs and services to expose DQ results and outputs for dashboards and self-service tools.

Collaboration & Governance

Partner with Data Stewards, GPOs, and business owners to translate requirements into technical solutions.

Contribute to BRDs, SRDs, and design reviews for DQ rules and pipelines.

Provide inputs on governance, compliance, and change management processes.

Support periodic reviews and continuous improvements of pipelines, rules, and dashboards.

Required Skills & Qualifications

Strong programming skills in PySpark, Python, and SQL.

Hands-on experience with Databricks (clusters, notebooks, Delta Lake).

Experience designing and implementing CI / CD pipelines (Azure DevOps / GitHub Actions / Jenkins).

Familiarity with Node.js & Angular for UI integration.

Solid understanding of data governance, DQ frameworks, and MDM concepts.

Strong analytical, problem-solving, and stakeholder engagement skills.

Cloud expertise, preferably Azure Data Lake, Data Factory, and Synapse.

Education & Experience

Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.

4–8 years of relevant experience in data engineering, CI / CD, and DQ rule development.

Proven expertise in Databricks, Azure data services, and low-code self-serve frameworks.

Create a job alert for this search

Data Engineer • Bengaluru, Karnataka, India

Related jobs

Promoted

Data Engineer 2

YubiBangalore Urban, Karnataka, India

As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Networth CorpBengaluru, Karnataka, India

Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services. End to end development lifecycle of complex large-scale and ...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

DigitalzoneBangalore, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 18 days ago

Promoted

Data Engineer

Insight GlobalBangalore, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

RecroBangalore, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

MareanaBengaluru, Karnataka, India

Mareana is looking for experienced Data Engineer with a strong development background using, RDMS, graph database and NoSQL platforms. This role is responsible for developing and enhancing Mareana’s...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

HCLTechGreater Bengaluru Area, India

F2F Hackathon scheduled on 22nd Nov 2025.If you are passionate about building scalable data solutions on Google Cloud and enjoy solving real-time data engineering challenges, this is the perfect op...Show moreLast updated: 30+ days ago

Promoted
New!

Data Bricks Engineer

Relevance LabGreater Bengaluru Area, India

SQL skills and hands-on experience using.AI-assisted development tools).The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, supporting analytics worklo...Show moreLast updated: 14 hours ago

Promoted

Lead Data Engineer [T500-21309]

ANSRBengaluru, Karnataka, India

ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 16 days ago

Promoted
New!

Data Engineer I

LiciousGreater Bengaluru Area, India

SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform. Data Platform Engineering team at.In this role, you’ll design, bui...Show moreLast updated: 14 hours ago

Promoted
New!

Data Engineer

VIDA Digital IdentityGreater Bengaluru Area, India

At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show moreLast updated: 14 hours ago

Promoted

Data Engineer

SelectorBengaluru, Karnataka, India

Selector is building an operational intelligence platform for digital infrastructure.By adopting an AI / ML-based analytics approach, the platform provides actionable multi-dimensional.It enables ope...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Grid DynamicsBengaluru, Karnataka, India

Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital tra...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Veca Consulting Pvt LtdBengaluru, Karnataka, India

Role Name : Data Engineer Experience : 3+ Years Location : Bangalore(No relocation) Notice Period : 20-30 days(who are currently serving) Mode : Hybrid Type : Fulltime Job Description : As a D...Show moreLast updated: 9 days ago

Promoted
New!

Data Engineer – CDP

Integers.AiBangalore, IN

Job Description : Data Engineer – CDP.Data Engineer with strong CDP expertise.The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Sa...Show moreLast updated: 20 hours ago

Promoted
New!

Data Engineer

Tata Consultancy ServicesGreater Bengaluru Area, India

Previous experience as a data engineer or in a similar role.Must have experience with MS Azure services such as Data Lake Storage, Data Factory, Databricks, HDInsight, Azure SQL Database, Azure Syn...Show moreLast updated: 12 hours ago

Promoted
New!

AWS Data Engineer

Tata Consultancy ServicesGreater Bengaluru Area, India

TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 14 hours ago

Promoted
New!

Senior Data Engineer

ArcanaGreater Bengaluru Area, India

Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show moreLast updated: 14 hours ago