Data Pipeline Validation EngineerPersistent Systems • Pune, Republic Of India, IN

Data Pipeline Validation Engineer

Persistent Systems • Pune, Republic Of India, IN

6 days ago

Job description

About Position :

We are seeking a skilled and detail-oriented Quality Analyst (QA) to support the migration of ETL workflows from Informatica to PySpark. The ideal candidate will have hands-on experience in validating data pipelines, ensuring data integrity, and working closely with development and business teams to ensure a smooth transition.

Role : QA Engineer
Location : All Persistent Locations
Experience : 10+ Years
Job Type : Full Time Employment

What You'll Do :

Understand existing Informatica workflows and validate their PySpark equivalents.

Develop and execute test plans, test cases, and test scripts for ETL processes.

Perform data validation, reconciliation, and regression testing across source and target systems.

Identify and report defects, track them to closure, and ensure timely resolution.

Collaborate with developers, business analysts, and project managers to clarify requirements and ensure test coverage.

Maintain QA documentation and contribute to process improvements.

Expertise You'll Bring :

Strong experience in ETL testing, preferably with Informatica and PySpark.

Proficiency in SQL for data validation and analysis.

Familiarity with big data platforms (e.G., Hadoop, Spark).

Experience with data migration or modernization projects.

Knowledge of Agile methodologies and tools like JIRA, Confluence, etc.

Excellent analytical, communication, and documentation skills.

Exposure to cloud platforms (e.G., AWS, Azure, GCP).

Experience with automation frameworks for data testing.

Understanding of data governance and quality standards.

Benefits :

Competitive salary and benefits package

Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications

Opportunity to work with cutting-edge technologies

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment :

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.Com / careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."

Create a job alert for this search

Data Pipeline Engineer • Pune, Republic Of India, IN

Related jobs

Validation Engineer - Validation Analyst - Validation Tester

Cygnus Professionals Inc • India, India

Job Title : Tester / Validation Analyst - ADX.Duration : 12+ Months Contracting Role.This role will be responsible for developing and maintaining test scripts across the Veeva Vault Platform.Familiar w...Show more

Last updated: 14 hours ago • Promoted • New!

Senior Data Engineer

Intellify Solutions • Nagpur, IN

Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show more

Last updated: 10 days ago • Promoted

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • Nagpur, IN

Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more

Last updated: 14 hours ago • Promoted • New!

Data Engineer

Digitalzone • Nagpur, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more

Last updated: 19 days ago • Promoted

Data Engineer

TEKsystems • Nagpur, IN

Location - Remote or Delhi or Hyderabad or Bangalore or Pune.Proficiency in Python and experience maintaining data-driven applications. Hands-on experience with ETL pipeline development, schema desi...Show more

Last updated: 30+ days ago • Promoted

Azure Data Engineer

Tata Consultancy Services • nagpur, maharashtra, in

TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services). Strong expertise in Azure Data Engineering & ETL Co...Show more

Last updated: 30+ days ago • Promoted

Snowflake Data Engineer

Live Connections • nagpur, maharashtra, in

Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more

Last updated: 9 days ago • Promoted

Data Engineer

LanceSoft, Inc. • Nagpur, IN

This team is looking to hire a motivated Sr.Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve vario...Show more

Last updated: 4 days ago • Promoted

Senior Azure Data Engineer

Tata Consultancy Services • Nagpur, IN

Job Title : Senior Data Engineer (Azure / SSIS).Minimum 6 yrs of experience in building.ETL pipeline using Azure data Factory, Azure Synapse. Minimum 6 yrs of ETL development using PL / SQL.Exposure in A...Show more

Last updated: 3 days ago • Promoted

Data Engineer

Aceolution • Nagpur, IN

Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more

Last updated: 30+ days ago • Promoted

AWS Data Engineer

Vista Applied Solutions Group Inc • Nagpur, IN

Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more

Last updated: 5 days ago • Promoted

Data Engineer

Sikich India • Nagpur, IN

Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

IntraEdge • Nagpur, IN

Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Recro • Nagpur, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

Model Validation

Tata Consultancy Services • Nagpur, IN

Year of Experience- 6 to 15 Years.Location-Bangalore, Hyderabad, Chennai, Pune, Kolkata.As a Senior Quantitative Analytics Associate, you will be responsible for leading independent validations and...Show more

Last updated: 5 days ago • Promoted

Data Engineer (GCP)

HISH IT SERVICES • Nagpur, IN

We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more

Last updated: 11 days ago • Promoted

Senior Data Engineer

SAIVA AI • Nagpur, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more

Last updated: 30+ days ago • Promoted

Hypervisor Validation Engineer

Piepeople Consulting Inc. • Republic Of India, IN

Solid understanding of hypervisors, virtual machines (VMs), and core concepts like CPU, memory, and I / O allocation.Basic operating systems (especially Linux), hardware basics, and fundamental progr...Show more

Last updated: 15 hours ago • Promoted • New!