Data Engineer
Ubique Systemssrikakulam, andhra pradesh, in4 hours ago
Job descriptionDevelop, optimize, and maintain DQ rules in PySpark / Python for self-serve capabilities. Design and implement profiling frameworks for rule generation and automated remediation. Ensure DQ frameworks align with enterprise standards, governance, and audit requirements. Collaborate with front-end teams (Node.js / Angular) to enable rule configuration, validation, and monitoring via a low-code UI. Develop APIs and services to expose DQ results and outputs for dashboards and self-service tools. Partner with Data Stewards, GPOs, and business owners to translate requirements into technical solutions. Contribute to BRDs, SRDs, and design reviews for DQ rules and pipelines. Provide inputs on governance, compliance, and change management processes. Support periodic reviews and continuous improvements of pipelines, rules, and dashboards. Strong programming skills in PySpark, Python, and SQL. Hands-on experience with Databricks (clusters, notebooks, Delta Lake). Experience designing and implementing CI / CD pipelines (Azure DevOps / GitHub Actions / Jenkins). Familiarity with Node.js & Angular for UI integration. Solid understanding of data governance, DQ frameworks, and MDM concepts. Strong analytical, problem-solving, and stakeholder engagement skills. Cloud expertise, preferably Azure Data Lake, Data Factory, and Synapse. Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field. 4–8 years of relevant experience in data engineering, CI / CD, and DQ rule development. Proven expertise in Databricks, Azure data services, and low-code self-serve frameworks.
Primary skills : Python, SQL, data lakes, azure
Experience : 4+ years
Immediate Joiner
Key Responsibilities
Pipeline Development & Automation
- Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments.
- Optimize data pipelines and jobs for efficiency, scalability, and enterprise-grade reliability within Azure and Databricks.
- Implement best practices in version control, testing, and automated deployments.
Data Quality & Rule Development
UI & Self-Serve Integration
Collaboration & Governance
Required Skills & Qualifications
Education & Experience
Create a job alert for this search
Data Engineer • srikakulam, andhra pradesh, in
Related jobs
The ideal candidate will be responsible for designing, developing, and maintaining robust data pipelines that support key business functions across the supply chain domain.This role requires strong...Show moreLast updated: 4 hours ago
- Promoted
Data Engineer
BayOne Solutionssrikakulam, andhra pradesh, in We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 2 days ago
- Promoted
- New!
Data Engineer
NexionPro Servicessrikakulam, andhra pradesh, in PySpark-based data processing workflows.Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Optimi...Show moreLast updated: 4 hours ago
- Promoted
Data Engineer
Tata Consultancy Servicessrikakulam, andhra pradesh, in TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
- Promoted
- New!
Databricks Engineer
TTC Groupsrikakulam, andhra pradesh, in We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 4 hours ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicessrikakulam, andhra pradesh, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 24 days ago
- Promoted
Senior Data Engineer
SGS & Cosrikakulam, andhra pradesh, in Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show moreLast updated: 16 days ago
- Promoted
GCP Data Engineer
Adastrasrikakulam, andhra pradesh, in We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
HCLTechSrikakulam, Andhra Pradesh, India We’re Expanding Our Digital & Data Talent Pool Are you a professional ready to take on enterprise-scale transformation journey? We are on a mass hiring drive and looking for experts who can bring ...Show moreLast updated: 30+ days ago
- Promoted
Aws Data Engineer
Tata Consultancy ServicesChicacole, Republic Of India, IN Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 24 days ago
- Promoted
- New!
Data Engineer
MyData Insights Pvt Ltdsrikakulam, andhra pradesh, in The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 4 hours ago
- Promoted
Data Engineer
Sourcebaesrikakulam, andhra pradesh, in Join Our Data Engineering Team in Mumbai! (5-8 Yrs Exp.We're looking for an experienced and driven.If you are passionate about building scalable, high-performance data platforms and mentoring the n...Show moreLast updated: 16 days ago
- Promoted
Data Engineer
OWOWsrikakulam, andhra pradesh, in Data Engineer – AI-Powered Marketing Personalization Platform.AI-powered marketing personalization platform (V2.You’ll design and implement a robust multi-database infrastructure that enables real-...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Ubique SystemsSrikakulam, Andhra Pradesh, India Primary skills : Python, SQL, data lakes, azure Experience : 4+ years Immediate Joiner Key Responsibilities Pipeline Development & Automation • Design, build, and maintain CI / CD pipelines to automat...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Data Engineer
Mindlancesrikakulam, andhra pradesh, in We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 4 hours ago
- Promoted
- New!
Data Engineer (Remote)
QAAgility Technologiessrikakulam, andhra pradesh, inRemote
- Promoted
- New!
Azure Data Engineer
People Prime Worldwidesrikakulam, India Azure Data Lake Storage (Gen1 / Gen2).Show moreLast updated: less than 1 hour ago
- Promoted
- New!
Azure Data Engineer
Capgemini Inventsrikakulam, andhra pradesh, in At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 4 hours ago
- Promoted
- New!
Senior Data Engineer / Architect - Snowflake
Aezion, Incsrikakulam, andhra pradesh, in We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling.
The ideal candidate will design ...Show moreLast updated: 4 hours ago