Talent.com
Senior Data Quality Engineer

Senior Data Quality Engineer

ResourcetreeChennai
30+ days ago
Job description

Job Description :

We are seeking an experienced and detail-oriented Senior Data Engineer with strong expertise in QA process automation for data validation and testing. The ideal candidate will bring hands-on experience with QuerySurge and a solid foundation in ETL / ELT processes, data integration, and data quality assurance.

In this role, you will be responsible for designing, developing, and automating data validation and testing workflows across our data pipelines. You will ensure data integrity, accuracy, and reliability by leveraging automated testing frameworks and working closely with cross-functional teams. A strong background in data engineering, SQL, and QA automation practices is required.

Primary Skills : AWS, ETL Concepts, Data Integration Tool (Any), QA

Secondary Skills : Python, DataStage, Informatica IICS, Informatica, SSIS

Role Description :

The Lead Data Engineer will be responsible for overseeing the design, development, and maintenance of our data infrastructure and pipelines. This role requires strong technical expertise, leadership skills, and the ability to work collaboratively with cross-functional teams to ensure efficient and reliable data processes.

Role Responsibility :

  • Lead the design and architecture of scalable and robust data integration solutions on-premise and in the cloud.
  • Ensure solutions meet business requirements and industry standards.
  • Engage with executive leadership and key stakeholders to understand business needs and translate them into technical solutions.
  • Define data models, schemas, and structures to optimize data storage, retrieval, and processing for analytical workloads.
  • Work with data architects and solution architects to ensure alignment with overall data strategy and architecture principles.
  • Lead a team of data engineers by providing technical guidance, mentorship, and support.
  • Plan, prioritize, and manage data engineering projects, tasks, and timelines.
  • Design, develop, and maintain data integration pipelines and ETL / ELT workflows.
  • Lead more than one project or manage a larger team that might have sub-tracks.

Role Requirement :

  • Proficient in basic and advanced SQL.
  • Proficient in using Python for data integration and data engineering tasks.
  • Proficiency in ETL / ELT tools such as Informatica, Talend, DataStage, SSIS, DBT, Databricks or equivalent.
  • Experience with relational databases (like SQL Server, Oracle, MySQL, PostgreSQL) and NoSQL databases (like MongoDB,
  • Cassandra), cloud databases (RedShift, Snowflake, Azure SQL).

  • Familiarity with big data technologies like Hadoop, Spark, Kafka, and cloud platforms such as AWS, Azure, or Google Cloud.
  • Solid understanding of data modeling, data warehousing concepts, and practices.
  • Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling,change data capture, slowly changing dimensions etc.).
  • Knowledgeable in performance tuning and optimization
  • Experience in Data Profiling and Data validation
  • Experience in requirements gathering and documentation processes and performing unit testing.
  • Understanding and Implementing QA and various testing processes in the project.
  • Knowledge in any BI tools will be an added advantage.
  • Sound aptitude, outstanding logical reasoning, and analytical skills.
  • Willingness to learn and take initiatives.
  • Ability to adapt to fast-paced Agile environment.
  • Relevant certifications in data engineering or cloud platforms are a plus.
  • Additional Requirement :

  • 6+ years of experience in Data Engineering with exposure to data quality and QA processes.
  • 2+ years of hands-on experience in QuerySurge for test automation and data validation.
  • Strong proficiency in SQL for validation queries and test case design.
  • Experience with ETL / ELT tools (Informatica, Talend, DataStage, SSIS, DBT, or equivalent) and Redshift.
  • Proficiency in Python for scripting, automation, and test integration.
  • Familiarity with CI / CD pipelines, version control (Git), and Agile environments.
  • Strong understanding of data warehousing concepts, dimensional modeling, and data governance.
  • Experience in requirements gathering, test case creation, and defect lifecycle management.
  • Excellent analytical skills, logical reasoning, and problem-solving capabilities.
  • Relevant certifications in QA automation, data engineering, or cloud platforms are preferred.
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Chennai

    Related jobs
    • Promoted
    Quality Engineer

    Quality Engineer

    Tiger AnalyticsChennai, Tamil Nadu, India
    As a Quality Engineer - Data, you will be involved in every phase of SDLC and focus on Functional testability, Automation and Performance of the software. More specifically, you will work on : .Select...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiChennai, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MastekChennai, Tamil Nadu, India
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer - QA Process Automation - QuerySurge

    Senior Data Engineer - QA Process Automation - QuerySurge

    Resource Tree Global ServicesChennai
    Job Name : Senior Data Engineer - QA Process Automation (QuerySurge) Years of Experience : 6 Job Description : <...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, Tamil Nadu, India
    Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIChennai, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & CoChennai, Tamil Nadu, India
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 15 days ago
    • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek ConsultingChennai, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Dexian IndiaChennai, Tamil Nadu, India
    Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines. High proficiency in Python, ...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    PoshmarkChennai, Tamil Nadu, India
    Senior Software Engineer - Data Engineering.Big Data team is a central player in the Poshmark organization.Our goal is to democratize data, support exploding business, build data and ML pipelines t...Show moreLast updated: 28 days ago
    • Promoted
    SAP Data Quality & Master Data Specialist

    SAP Data Quality & Master Data Specialist

    TekGenioChennai, IN
    SAP Data Quality & Master Data Specialist (MRO / MDO / Content.We are seeking an experienced(4Y+) SAP Data Quality & Master Data Specialist to manage,. SAP systems with a focus on MRO (Maintenance, Repa...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivechennai, tamil nadu, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    GTM Engineer

    GTM Engineer

    Scalantecmount, India
    GTM Engineer (m / f / d) – Full Time, Remote.We’re looking for a GTM Engineer to help us build, automate and scale the outbound and growth systems behind our clients’ sales pipelines.You’ll work at the...Show moreLast updated: 22 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CYGNVSChennai, Tamil Nadu, India
    Our company culture is a perfect blend of productivity and enjoyment, prioritizing the growth and development of our talented employees as part of a high-achieving team. We are in search of exceptio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIChennai, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Pacific Data Integratorsmount, India
    Shift time : Open to work in EST shift (5PM to 2AM IST).Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (ID...Show moreLast updated: 22 hours ago
    • Promoted
    CYGNVS - Senior Data Engineer

    CYGNVS - Senior Data Engineer

    CYGNVS INDIA PRIVATE LIMITEDChennai
    Description : CYGNVS is a purpose-built, first-of-its-kind guided cyber crisis platform designed to allow users to prepa...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy Serviceschennai, India
    Job Title : Senior Data Engineer.Required Skillset : Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda). Master Databricks tools (job creation, cluster, notebook) and be able to qu...Show moreLast updated: 22 hours ago