Talent.com
Senior Big Data Engineer - PySpark / Scala

Senior Big Data Engineer - PySpark / Scala

Consulting PanditsPune
30+ days ago
Job description

Exciting Job Opportunity in Pune!

Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic opportunity waiting for you!

Key Requirements :

  • Minimum of 5+ years of experience
  • Proficient in Spark development for batch and streaming applications
  • Skilled in Pyspark and Data Engineering
  • Expert in ETL implementation and migration to Spark
  • Strong programming skills in Scala, Java, and Python
  • Hands-on experience with Kafka and Spark streaming (Dstream and Structured Streaming)
  • Familiar with developer tools like Jupyter notebooks
  • Knowledgeable about Airflow or similar workflow engines

Desirable Skills :

  • Exposure to Flink and Kudu streaming
  • Workflow automation using CI / CD practices
  • Understanding of Nifi streaming and transformation
  • Experience with Informatica workflow migration
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • Pune

    Related jobs
    • Promoted
    Staff Engineer Software-Browser Development

    Staff Engineer Software-Browser Development

    Palo Alto NetworksPune / Pimpri-Chinchwad Area, India
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Solution Architect

    Databricks Solution Architect

    InspireXTPune
    Description : About InspireXT : InspireXT is on a mission to build the most trusted supply chains in the world.Our Connected I...Show moreLast updated: 27 days ago
    • Promoted
    Big Data Engineer - Scala / Spark / Python

    Big Data Engineer - Scala / Spark / Python

    Idyllic Services Pvt LtdPune
    Job Title : Big Data Engineer - Scala Experience : 7 to 10Years (Minimum 3+ years in Scala) Notice Period : ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - ETL / Scala / Python

    Big Data Engineer - ETL / Scala / Python

    HyrEzy Talent SolutionsPune
    Role : Big Data Engineer About Organization : Our Client is an IT consulting organization focused on providing AI Led Digital Transforma...Show moreLast updated: 30+ days ago
    • Promoted
    Python Automation with Power BI Engineer

    Python Automation with Power BI Engineer

    InfoBeansPune, Maharashtra, India
    Job Role - Python Automation with PowerBi Tester.Experience Required : 6 to 10 Years.Immediate joiners are preferred.We are looking for a highly skilled and experienced Senior Python Automation Engi...Show moreLast updated: 19 days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    AscendionPune, Maharashtra, India
    Job Title : Senior Data Engineer.Location : Gurgaon / Pune / Bangalore.Skills : PySpark, SQL, Databricks, AWS.The ideal candidates should have hands-on expertise in building. Databricks and AWS, along w...Show moreLast updated: 30+ days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsPune, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Snowflake Data Engineer (Snowflake+DBT+SQL+Python) Only Immediate Joiners- PAN India

    Snowflake Data Engineer (Snowflake+DBT+SQL+Python) Only Immediate Joiners- PAN India

    Mount Talent Consulting Pvt Ltd.Pune, Maharashtra, India
    As a Snowflake Lead with experience, and additional expertise in ETL tools and DBT, youwill be entrusted with a pivotal role in designing, implementing, and managing Snowflake solutions to driveeff...Show moreLast updated: 30+ days ago
    • Promoted
    Celebal Technologies - Data Engineer - Python / SQL

    Celebal Technologies - Data Engineer - Python / SQL

    Celebal TechnologiesPune
    Responsibilities : Platform Expertise : - Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platfo...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Engineer - ETL / PySpark

    Databricks Engineer - ETL / PySpark

    Talent VelocityPune
    Description : Location Pune & Nagpur Experience 5-7 Years Employment Type Full-Time Jo...Show moreLast updated: 10 days ago
    • Promoted
    Big Data Engineer - SQL / Python

    Big Data Engineer - SQL / Python

    ANB IT Solutions Pvt LtdPune
    Job Description : - Minimum of 7+ years of progressive experience in Data Engineering, with a proven track record in pi...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Cloud Architect

    Big Data Cloud Architect

    RecruinPune
    Big Data Cloud Architect We are seeking an experienced Big Data Cloud Architect with 812 years in designing and implementing scalable big data solutions on Azure and ...Show moreLast updated: 30+ days ago
    • Promoted
    Salesforce CPQ Developer

    Salesforce CPQ Developer

    InfoBeansPune / Pimpri-Chinchwad Area, India
    Position name # 1 : Salesforce CPQ Developer.Location : Pune (Hybrid / Remote).Demonstrate expertise in Salesforce platform architecture, data model, integration. Experience in Salesforce CPQ, Apex cla...Show moreLast updated: 11 days ago
    • Promoted
    Silicon Stack - Python Developer - Data Analytics

    Silicon Stack - Python Developer - Data Analytics

    Silicon stackPune
    About the Role : We are seeking a Python Developer with a strong background in Automation and Data Analytics to join ou...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer (GCP Services (DataProc, Big Query, Composer) (Scala and PySpark))

    GCP Data Engineer (GCP Services (DataProc, Big Query, Composer) (Scala and PySpark))

    Tata Consultancy ServicesPune, Maharashtra, India
    Greetings from TATA Consultancy Services.GCP Services (DataProc, Big Query, Composer) Good knowledge of Spark (Scala and PySpark)). Pls find the Job Description below.Data Engineer will be responsib...Show moreLast updated: 19 days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Persistent SystemsPune, Maharashtra, India
    We are seeking data bricks engineer with hands on experience in Power BI, python, spark and data bricks.Job Type : Full Time Employment. Strong hands-on experience with.Familiarity with cloud platfor...Show moreLast updated: 16 days ago
    • Promoted
    2892- Databricks Engineer

    2892- Databricks Engineer

    EXLPune, Maharashtra, India
    We are seeking a highly skilled.The ideal candidate will have strong expertise in designing, developing, and optimizing large-scale data pipelines and solutions using Databricks, Spark, and cloud p...Show moreLast updated: 19 days ago
    • Promoted
    Salesforce Data Cloud Architect

    Salesforce Data Cloud Architect

    RialtesPune, IN
    Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of. Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago