Talent.com
This job offer is not available in your country.
PySpark Developer - Data Platform

PySpark Developer - Data Platform

NPG ConsultantsChennai
30+ days ago
Job description

We are seeking a highly skilled PySpark Developer with 7+ years of experience and expertise in Reltio MDM to join our data engineering team. You will design and implement scalable data processing solutions, integrate enterprise systems with Reltio, and ensure high-quality data governance.

Key Responsibilities :

  • Develop and maintain PySpark data pipelines on platforms like AWS EMR or Databricks.
  • Integrate and synchronize data between enterprise applications and Reltio MDM.
  • Design and implement data transformation, cleansing, and enrichment logic.
  • Collaborate with architects and analysts for effective data modeling.
  • Build and manage API-based integrations between Reltio and upstream / downstream systems.
  • Optimize PySpark jobs for performance, scalability, and cost-efficiency.
  • Ensure data quality, integrity, and governance throughout the pipeline lifecycle.
  • Troubleshoot and resolve data-related and performance issues.

Required Skills & Qualifications :

  • 7+ years of hands-on experience in PySpark and distributed data processing.
  • Strong command of Apache Spark, Spark SQL, and DataFrames.
  • Deep expertise in Reltio MDM (entity modeling, survivorship rules, match & merge configuration).
  • Proficiency in REST APIs, JSON, and data integration techniques.
  • Experience with AWS services (S3, Lambda, Step Functions).
  • Solid understanding of ETL workflows, data warehousing, and data modeling.
  • Familiarity with CI / CD pipelines and Git.
  • Excellent problem-solving, communication, and collaboration skills.
  • (ref : hirist.tech)

    Create a job alert for this search

    Pyspark Developer • Chennai

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIChennai, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    Lead Cloud Data Engineer - PySpark / SQL

    Lead Cloud Data Engineer - PySpark / SQL

    upGradChennai
    About the Job : We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark.Work with Databricks platform using Spark for big data processing and an...Show moreLast updated: 30+ days ago
    • Promoted
    Tech Services Developer | APIs, Python, SQL

    Tech Services Developer | APIs, Python, SQL

    Pinnacle Group, Inc.Chennai, Tamil Nadu, India
    Tech Services Developer | APIs, Python, SQL.Pinnacle Group is a nationally recognized leader in workforce solutions, known for delivering high-impact staffing, talent management, and technology ser...Show moreLast updated: 8 days ago
    • Promoted
    Spark / Scala Developer

    Spark / Scala Developer

    Cyanous Software Private LimitedChennai
    Detailed JD (Roles and Responsibilities) : - At least 8+ years of experience and strong knowledge in Scala programming language.Able to write clean, ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python / Pandas

    Data Engineer - Python / Pandas

    NUVENTO SYSTEMS PRIVATE LIMITEDChennai
    Data Engineer Experience Level : 3 to 8 Years Location : : - Proven experience as a Data Engineer or in a...Show moreLast updated: 21 days ago
    • Promoted
    Tredence Analytics Solutions - Lead Data Engineer - Google Cloud Platform

    Tredence Analytics Solutions - Lead Data Engineer - Google Cloud Platform

    Tredence Analytics Solutions Private LimitedChennai
    Job Description : Job Title : Lead GCP Data Engineer Skills required : GCP DE Experience, Big query, SQL, Cloud compressor / Python, Cloud functions, Datapro...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent SystemsChennai, Tamil Nadu, India
    We are conducting an in-person hiring drive for the position of Mlops Engineer in Chennai on 6th Sep 2025.Interview Location is mentioned below : . Chennai : Olympia Pinnacle, #1, S.Old Mahabalipuram R...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIChennai, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting.Should be comfortable with Unix File system as well as HDFS commands. Should have worked on query languages such as Oracle SQ...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer - Scala / Spark

    Lead Data Engineer - Scala / Spark

    Ixceed SolutionsChennai
    About the Role : We are seeking a highly skilled and experienced Lead Data Engineer / Scala Developer with strong hands-on expertise in Scala program...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalchennai, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    TechVeritochennai, tamil nadu, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 20 hours ago
    • Promoted
    Scala Developer - PySpark

    Scala Developer - PySpark

    Techmynd ConsultingChennai
    Pyspark, Scala Developer Location : Bangalore, Chennai Experience : 6- 8 Years Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - ETL / PySpark

    Data Engineer - ETL / PySpark

    Ixceed SolutionsChennai
    Role : Data Engineer Location : Chennai (Hybrid).Job Description : Key Responsibilities : Show moreLast updated: 14 days ago
    • Promoted
    PySpark Developer

    PySpark Developer

    Corpxcel ConsultingChennai
    Location : Chennai / Bangalore / Hyderabad / Coimbatore / Pune WFO : 3 days Mandatory from the above-mentioned locations.Role Summary : We are...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    IntraEdgeChennai, Tamil Nadu, India
    Senior Big Data Engineer (Python).Immediate to 30 Days Preferred.The ideal candidate will have hands-on experience working with Big Data technologies and cloud platforms, and a passion for writing ...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Architect

    AWS Data Architect

    HCLTechChennai, Tamil Nadu, India
    Kinldy share your availability.If your resume is shortlisted we will schedule your interview accordingly.We are seeking a highly skilled. The ideal candidate will have deep expertise in building sca...Show moreLast updated: 17 days ago
    • Promoted
    Spark & Scala Developer

    Spark & Scala Developer

    Dinoxo IT ConsultingChennai
    Responsibilities : - At least 8+ years of experience and strong knowledge in Scala programming language.Able to write cl...Show moreLast updated: 30+ days ago