Job Title: ETL Tester
Key Responsibilities
As an ETL Tester, you will:
- Requirements Analysis: Work closely with business analysts, data architects, and data engineers to understand business requirements, data models, and ETL (Extract, Transform, Load) mapping documents.
- Test Strategy & Planning: Develop comprehensive ETL testing strategies, test plans, and test cases to ensure data accuracy, completeness, integrity, and performance.
- Test Case Design & Execution: Design and execute detailed test cases and SQL queries for various ETL testing scenarios, including:
- Source to Target data validation and reconciliation.
- Data transformation logic validation.
- Data quality and integrity checks (e.g., null values, data types, formats, duplicates, data loss).
- Row count verification.
- Performance testing of ETL processes.
- Metadata testing (data types, lengths, indexes, constraints).
- Error handling and logging validation.
- Defect Management: Identify, document, and report defects and issues found during ETL testing. Perform root cause analysis on data discrepancies and collaborate with ETL developers to ensure timely resolution.
- Data Validation & Quality: Verify data accuracy, consistency, and completeness across source systems, staging areas, and target data warehouses/databases.
- Reporting & Documentation: Document test results, create comprehensive summary reports, and ensure all testing activities are traceable to requirements.
- Test Data Management: Assist in creating and maintaining realistic test data for ETL testing.
- Collaboration: Work effectively with cross-functional teams, including ETL developers, data analysts, and business stakeholders, within an Agile/Scrum environment.
- Automation (Preferred): Where applicable, contribute to the automation of ETL testing processes using scripting or specialized tools.
Mandatory Skills & Experience
Technical Proficiency:
- SQL Expertise: Strong proficiency in SQL for writing complex queries to validate data consistency, transformation, and integrity across different database systems.
- Data Warehousing Concepts: Solid understanding of data warehousing concepts, including ETL processes, data modeling (dimensional modeling, star/snowflake schemas), OLAP/OLTP.
- ETL Testing Methodologies: In-depth knowledge of ETL testing methodologies, processes, and best practices.
- Database Knowledge: Experience with relational databases (e.g., Oracle, SQL Server, MySQL, PostgreSQL) and familiarity with non-relational databases (e.g., MongoDB) is a plus.
- Test Management Tools: Experience with test case management and defect tracking tools (e.g., Jira, Azure DevOps, HP ALM).
- Scripting (Preferred): Familiarity with scripting languages (e.g., Python, Shell scripting) for test automation or data manipulation.
- ETL Tools (Familiarity/Experience a plus): Exposure to or experience with common ETL tools (e.g., Informatica, Talend, Microsoft SSIS, AWS Glue, Azure Data Factory) is beneficial.
Experience & Qualifications:
- Proven experience as an ETL Tester or in a similar data quality/testing role.
- Demonstrated ability to design, execute, and troubleshoot ETL test cases.
- Experience in documenting test results and reporting defects.
Essential Professional Skills
- Analytical Skills: Excellent analytical and problem-solving skills with a keen eye for detail to identify inconsistencies and discrepancies in data.
- Communication Skills: Strong written and verbal communication skills to interact with technical and non-technical stakeholders, articulate issues, and present findings clearly.
- Attention to Detail: High level of accuracy in testing, documenting issues, and following procedures.
- Collaboration: Ability to work independently and as part of a cross-functional team in an Agile environment.
- Adaptability: Ability to quickly learn new data models, business rules, and technologies.
Skills Required
Manual Testing, Jmeter, Mysql, Postgresql, Jira, Azure Devops