iKrux - Big Data Tester

Job Description :

We are seeking a highly skilled Big Data Tester with strong expertise in ETL Testing, Hadoop, and Spark / PySpark. The candidate will be responsible for ensuring data quality, validating large-scale data pipelines, and working closely with data engineers and analysts to deliver reliable big data solutions.

Key Responsibilities :

• Perform end-to-end testing of big data applications, data pipelines, and ETL workflows.
• Validate data transformations, aggregations, and data quality across multiple sources and targets.
• Conduct functional, regression, system integration, and performance testing for big data solutions.
• Write and execute complex SQL and Hive queries to verify data accuracy and consistency.
• Collaborate with data engineers and developers to debug and resolve data issues.
• Design and maintain test plans, test cases, and automation frameworks for big data testing.
• Perform batch and streaming data validation on Hadoop ecosystem components.
• Ensure compliance with data governance, quality, and security standards.

Required Skills & Experience :

(ref : hirist.tech)