Talent.com
This job offer is not available in your country.
PySpark Developer - Data Platform

PySpark Developer - Data Platform

NPG ConsultantsPune
30+ days ago
Job description

We are seeking a highly skilled PySpark Developer with 7+ years of experience and expertise in Reltio MDM to join our data engineering team. You will design and implement scalable data processing solutions, integrate enterprise systems with Reltio, and ensure high-quality data governance.

Key Responsibilities :

  • Develop and maintain PySpark data pipelines on platforms like AWS EMR or Databricks.
  • Integrate and synchronize data between enterprise applications and Reltio MDM.
  • Design and implement data transformation, cleansing, and enrichment logic.
  • Collaborate with architects and analysts for effective data modeling.
  • Build and manage API-based integrations between Reltio and upstream / downstream systems.
  • Optimize PySpark jobs for performance, scalability, and cost-efficiency.
  • Ensure data quality, integrity, and governance throughout the pipeline lifecycle.
  • Troubleshoot and resolve data-related and performance issues.

Required Skills & Qualifications :

  • 7+ years of hands-on experience in PySpark and distributed data processing.
  • Strong command of Apache Spark, Spark SQL, and DataFrames.
  • Deep expertise in Reltio MDM (entity modeling, survivorship rules, match & merge configuration).
  • Proficiency in REST APIs, JSON, and data integration techniques.
  • Experience with AWS services (S3, Lambda, Step Functions).
  • Solid understanding of ETL workflows, data warehousing, and data modeling.
  • Familiarity with CI / CD pipelines and Git.
  • Excellent problem-solving, communication, and collaboration skills.
  • (ref : hirist.tech)

    Create a job alert for this search

    Pyspark Developer • Pune

    Related jobs
    • Promoted
    Big Data Developer

    Big Data Developer

    USTPune, Maharashtra, India
    The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show moreLast updated: 5 days ago
    • Promoted
    Python Developer

    Python Developer

    SynechronPune, Maharashtra, India
    We have immediate opportunity for Python Developer.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovat...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalpune, maharashtra, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Spark & Scala Developer

    Spark & Scala Developer

    Dinoxo IT ConsultingPune
    Responsibilities : - At least 8+ years of experience and strong knowledge in Scala programming language.Able to write cl...Show moreLast updated: 30+ days ago
    • Promoted
    Spark / Scala Developer

    Spark / Scala Developer

    Cyanous Software Private LimitedPune
    Detailed JD (Roles and Responsibilities) : - At least 8+ years of experience and strong knowledge in Scala programming language.Able to write clean, ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Tata Consultancy ServicesPune, Maharashtra, India
    Relevant Experience (in Yrs) : .Hyderabad, Pune, Chennai, Bangalore, Noida.Technical / Functional Skills Must Have Experience in : . Hands on experience in Spark, Scala and Pyspark.Should be proficient i...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.Pune, Maharashtra, India
    Data Software Engineer - Spark, Python, (Azure Databricks ).Years of in Big Data & Data related technology experience.Expert level understanding of distributed computing principles.Expert level kno...Show moreLast updated: 19 days ago
    • Promoted
    Lead Data Engineer / Solution Architect

    Lead Data Engineer / Solution Architect

    Talent VelocityPune
    Data Engineer / Solution Architect Location : Pune / Nagpur (WFO) Experience Required : 8+ Years <...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer - PySpark

    Senior Data Engineer - PySpark

    Xlr8 Talent SearchPune
    Job Description : We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Python Developer

    Python Developer

    ACL DigitalPune, Maharashtra, India
    Managed Data services such as Kinesis, S3, EMR, AWS Glue.Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Python, Pyspark Developer with Databricks

    Python, Pyspark Developer with Databricks

    InfoBeansPune, Maharashtra, India
    Job title : Python, Pyspark Developer with Databricks.Skills : Python, Pyspark, Databricks, SQL, Azure.Notice Period : Immediate to 15 days, Serving notice. We are seeking a highly skilled Python an...Show moreLast updated: 1 hour ago
    • Promoted
    Data Engineer

    Data Engineer

    TechVeritopune, maharashtra, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 1 day ago
    • Promoted
    PySpark Developer

    PySpark Developer

    Corpxcel ConsultingPune
    Location : Chennai / Bangalore / Hyderabad / Coimbatore / Pune WFO : 3 days Mandatory from the above-mentioned locations.Role Summary : We are...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    Leinex ConsultingPune
    Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders < / p&...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Data Developer (Python)

    Data Developer (Python)

    FlexTradePune, Maharashtra, India
    FlexTrade Systems is a provider of customized multi-asset execution and order management trading solutions for buy- and sell-side financial institutions. Through deep client partnerships with some o...Show moreLast updated: 1 hour ago
    • Promoted
    Coditas - Senior Data Engineer - Python / Apache Spark

    Coditas - Senior Data Engineer - Python / Apache Spark

    Coditas Technologies Pvt. Ltd.Pune
    We are looking for Senior data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning. Build products in the data analytics space.Roles and Responsibil...Show moreLast updated: 11 days ago
    • Promoted
    Lead Cloud Data Engineer - PySpark / SQL

    Lead Cloud Data Engineer - PySpark / SQL

    upGradPune
    About the Job : We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark.Work with Databricks platform using Spark for big data processing and an...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Pyspark

    Data Engineer - Pyspark

    Tata Consultancy ServicesPune, Maharashtra, India
    Job Title : - Data Engineer - Pyspark.Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL. Good Spark, Pyspark,Big Data experience.Spark UI / Optimization / debugging ...Show moreLast updated: 1 day ago