Talent.com
This job offer is not available in your country.
Capco - Big Data Tester - Python / PySpark

Capco - Big Data Tester - Python / PySpark

Capco Technologies Pvt LtdPune
22 days ago
Job description

Position : Big Data Tester

Experience : 5-9 Years

Location : Pune, India

Job Summary :

We are seeking an experienced Big Data Tester with 5-9 years of experience in software quality assurance, with a dedicated focus on data. The ideal candidate will have a strong background in Python, PySpark, and SQL, along with a proven track record of implementing best practices for data validation and ETL testing. You will be responsible for ensuring the accuracy, integrity, and reliability of our large-scale data systems. This role is perfect for a detail-oriented professional with a strong technical skillset and a passion for data quality.

Key Responsibilities :

Data Validation and Testing :

  • Design, develop, and execute comprehensive test plans and test cases for Big Data applications.
  • Perform data validation and integrity checks across various data sources and systems.
  • Use Python and PySpark to write scripts and automate testing for ETL processes and data pipelines.

SQL & Data Querying :

  • Write and optimize complex SQL queries to validate data transformations and business logic.
  • Perform data analysis and use querying skills to identify discrepancies and anomalies.
  • Troubleshooting and Collaboration :

  • Work closely with data engineers and developers to troubleshoot and resolve data quality issues.
  • Participate in the entire software development lifecycle, ensuring quality is integrated from the start.
  • Required Skills & Qualifications

    Core Experience : 5-9 years of experience in a testing or quality assurance role.

    Mandatory Technical Skills :

  • Expertise in Python and PySpark for data processing and automation.
  • Extensive hands-on experience with SQL, including writing complex queries.
  • Strong knowledge of ETL processes and best practices for data validation.
  • Professional Attributes :

  • A strong, hands-on approach to testing and a meticulous attention to detail.
  • Excellent analytical and problem-solving skills.
  • Strong communication and collaboration skills to work effectively with cross-functional teams.
  • Preferred Skills :

  • Experience with Unix environments.
  • Hands-on experience with Big Data technologies such as Hadoop, Spark, Kafka, and NoSQL databases (MongoDB, Cassandra, Hive, etc.).
  • Experience with both traditional and modern Data Warehousing solutions (Oracle, Teradata, SQL Server, Amazon Redshift, Google BigQuery, Snowflake).
  • Prior development experience in AWS.
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data • Pune

    Related jobs
    • Promoted
    Big Data Developer

    Big Data Developer

    USTPune, Maharashtra, India
    The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show moreLast updated: 5 days ago
    • Promoted
    Big Data Specialist

    Big Data Specialist

    LTIMindtreePune, Maharashtra, India
    Greetings from LTIMindtree ! We are currently hiring for Bigdata Scala Spark.The position is ideal for professionals with 6–12 years of experience in Bigdata and related technologies.Experien...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - ETL / Scala / Python

    Big Data Engineer - ETL / Scala / Python

    HyrEzy Talent SolutionsPune
    Role : Big Data Engineer About Organization : Our Client is an IT consulting organization focused on providing AI Led Digital Transforma...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Scala / Spark / Python

    Big Data Engineer - Scala / Spark / Python

    Idyllic Services Pvt LtdPune
    Job Title : Big Data Engineer - Scala Experience : 7 to 10Years (Minimum 3+ years in Scala) Notice Period : ...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesPune, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 18 days ago
    • Promoted
    Big Data with Quantexa-Pan India

    Big Data with Quantexa-Pan India

    Tata Consultancy ServicesPune, IN
    We are looking for Big data developer with Quantexa as mandatory skill.Experience Range- 5 to 12 years.Data Engineer - Big Data Hadoop, Spark and Scala. Spark, Scala, Hadoop, HIVE, Oozie, Shell Scri...Show moreLast updated: 3 days ago
    • Promoted
    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Tata Consultancy ServicesPune, Maharashtra, India
    Relevant Experience (in Yrs) : .Hyderabad, Pune, Chennai, Bangalore, Noida.Technical / Functional Skills Must Have Experience in : . Hands on experience in Spark, Scala and Pyspark.Should be proficient i...Show moreLast updated: 20 days ago
    • Promoted
    iKrux - Big Data Tester

    iKrux - Big Data Tester

    Ikrux EngineeeringPune
    Job Description : We are seeking a highly skilled Big Data Tester with strong expertise in ETL Testing, Hadoop, and Spark / PySpark.The candi...Show moreLast updated: 8 days ago
    • Promoted
    iKrux - Big Data Engineer - Python / Scala

    iKrux - Big Data Engineer - Python / Scala

    Ikrux EngineeeringPune
    We are seeking a highly skilled and motivated Big Data Engineer with strong experience in building, optimizing, and managing large-scale data processing pipelines. The ideal candidate will have hand...Show moreLast updated: 17 days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy ServicesPune, Maharashtra, India
    Greetings from TCS! Skill : Big Data Years of Experience : 6 - 8 years Location : Pune / Mumbai / Chennai Job Description : - Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experien...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digitalpune, maharashtra, in
    Python - Must have hands-on in Coding.SQL- Must have experience in writing queries.Must have experience in Data Lake / Lakehouse and open formats such as Iceberg, Hudi, Delta Lake" (remove Parquet).M...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisPune, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 17 days ago
    • Promoted
    Capco - Senior Data Engineer - Python / Snowflake DB

    Capco - Senior Data Engineer - Python / Snowflake DB

    Capco Technologies Pvt LtdPune
    Position : Senior Data Engineer with Python and Snowflake Experience : 9+ Years Location : Hinjewadi, Pu...Show moreLast updated: 23 days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    Leinex ConsultingPune
    Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders < / p&...Show moreLast updated: 9 days ago
    • Promoted
    ETL Testing (GCP+Python) Immediate

    ETL Testing (GCP+Python) Immediate

    Tata Consultancy Servicespune, maharashtra, in
    Role – ETL Tester – With GCP Exp.Desired Competencies (Technical / Behavioral Competency).Overall Testing experience Years. Microsoft Azure Cloud platform.Working knowledge of Structured and Unstructu...Show moreLast updated: 19 days ago
    • Promoted
    Coditas - Senior Data Engineer - Python / Apache Spark

    Coditas - Senior Data Engineer - Python / Apache Spark

    Coditas Technologies Pvt. Ltd.Pune
    We are looking for Senior data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning. Build products in the data analytics space.Roles and Responsibil...Show moreLast updated: 12 days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    Iris Software Inc.Pune, Maharashtra, India
    Iris is a professional software services organization offering high-quality, cost-effective solutions to businesses.It has helped meet the IT requirements of companies ranging from those among the ...Show moreLast updated: 19 days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    4Bell TechnologyPune
    Job Description : Core Responsibilities : - Design, build, and maintain robust d...Show moreLast updated: 30+ days ago