Talent.com
ETL Data testing

ETL Data testing

ConfidentialHyderabad / Secunderabad, Telangana
8 days ago
Job description

What You'll Do :

you will be responsible for building and maintaining data quality frameworks, creating test strategies, and collaborating with data and software teams to ensure the accuracy, integrity, and performance of enterprise data systems.

Key Responsibilities :

  • Select and integrate data tools and frameworks to support requested capabilities.
  • Provide technical guidance to software engineers on design, code, review, and test strategies.
  • Collaborate with data scientists, data engineers, and software engineers to build QA test suites for data and ML models.
  • Design and implement ETL processes for structured and unstructured data.
  • Monitor system performance and recommend infrastructure changes as needed.
  • Define and enforce data retention policies.
  • Collaborate with the recruitment team in hiring initiatives for the QA function.
  • Develop, maintain, and execute detailed and comprehensive test suites using Python and SQL.
  • Perform data validation by writing complex SQL queries and testing data pipelines.
  • Conduct UAT and support software testing in Agile environments.
  • Ensure continuous test automation to improve test coverage and reduce manual effort.
  • Provide both proactive and reactive support in deployment and production environments.
  • Troubleshoot applications, identify bugs, and manage the full defect lifecycle.
  • Test and validate data across multiple systems, including NoSQL databases, Hive, and Spark.
  • Integrate data from multiple structured and unstructured sources.

Requirements :

  • Experience in creating detailed test plans and automation frameworks using Python.
  • Proficient in Advanced SQL and query optimization for large datasets.
  • Strong understanding of Big Data concepts and NoSQL systems (preferred).
  • Expertise in HiveQL and Spark SQL.
  • Hands-on experience with data testing tools such as DBT, iCEDQ, QuerySurge, Denodo, Informatica, etc.
  • Familiarity with BI tools like Power BI and Tableau (preferred).
  • Experience with messaging systems such as Kafka or RabbitMQ.
  • Proficient in Linux / Unix environments and shell scripting.
  • Strong analytical thinking and debugging skills.
  • Ability to test, troubleshoot, and resolve cluster operation issues.
  • Experience working in Agile / Scrum environments.

    • Mandatory Skills :

    Python, Advanced SQL, Big Data concepts, NoSQL databases, HiveQL, Spark SQL, DBT, iCEDQ, QuerySurge, Denodo, Informatica, Linux / Unix, Kafka, RabbitMQ

    Driving Results :

  • Good individual contributor and effective team player.
  • Flexible and adaptive to project and team needs.
  • Proactively identifies and communicates issues and risks.

    • Other Personal Characteristics :

  • Dynamic, engaging, and self-reliant.
  • Comfortable navigating ambiguity.
  • Collaborative and analytical approach.
  • Self-confident yet humble.
  • Open to continuous learning.
  • Intelligent, rigorous thinker able to operate among high-performing teams.

    • Skills Required

    Python, Advanced Sql, Hiveql, Spark SQL

    Create a job alert for this search

    Etl Testing • Hyderabad / Secunderabad, Telangana