Talent.com
Senior Cloudera Developer - Apache Spark
Senior Cloudera Developer - Apache SparkDeutsche Telekom • Pune
Senior Cloudera Developer - Apache Spark

Senior Cloudera Developer - Apache Spark

Deutsche Telekom • Pune
30+ days ago
Job description

Your Role :

We are looking for a Senior Cloudera Developer (Data Engineer) with extensive experience in Spark, the Hadoop ecosystem, and GCP services to design and implement data :

  • Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive.
  • Collaborate with data engineers to optimize data pipelines and data processing workflows.
  • Work closely with data analysts and data scientists to ensure data quality and integrity.
  • Troubleshoot and resolve issues with data processing and storage systems.
  • Stay up to date with trends and best practices in Cloudera development.
  • Participate in code reviews and provide feedback to team members.
  • Perform ETL processes using Spark.
  • Integrate Spark Streaming with other technologies like Kafka.
  • Deploy and manage Spark applications on a Hadoop cluster or GCP Dataproc.

Must-Have Criteria :

  • 6- 10 years of experience in data engineering.
  • Expertise in Apache Spark, including architecture and fault-tolerance mechanisms.
  • Proficiency with Spark DataFrames and Spark SQL for querying structured data.
  • Experience with ETL processes using Spark.
  • Strong knowledge of Python.
  • Bachelors degree in Computer Science, IT, or a related field.
  • Proven experience as a Cloudera Developer or similar role.
  • Solid understanding of Cloudera technologies : Hadoop, Spark, Hive.
  • Experience with data modeling, data warehousing, and data integration.
  • Programming skills in Java, Scala, or Python.
  • Excellent problem-solving and communication skills.
  • Ability to work independently and in a team environment.
  • Desired Skills :

  • Experience optimizing Spark execution plans.
  • Experience integrating Spark Streaming with technologies like Kafka.
  • Familiarity with the Hadoop ecosystem including HDFS, Hive, and the Cloudera stack.
  • Experience deploying and managing Spark applications on Hadoop clusters or GCP Dataproc.
  • Experience with Java programming.
  • Knowledge of DevOps tools and practices (CI / CD, Docker).
  • Practical experience with GCP services : Dataproc, Cloud Functions, Cloud Run, Pub / Sub, BigQuery.
  • (ref : hirist.tech)

    Create a job alert for this search

    Developer Spark • Pune

    Related jobs
    Senior Spark Developer - Big Data Technologies

    Senior Spark Developer - Big Data Technologies

    Consulting Pandits • Pune
    Spark Rockstar Wanted! Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact.We&...Show more
    Last updated: 30+ days ago • Promoted
    Senior Backend Developer

    Senior Backend Developer

    Chat360 • Pune, Maharashtra, India
    Chat360 is a fast-growing, Generative AI–powered customer engagement platform backed by a $150M group.We work with 300+ global brands to improve lead generation, customer retention, and automated s...Show more
    Last updated: 11 hours ago • Promoted • New!
    Senior Big Data Engineer - PySpark / Scala

    Senior Big Data Engineer - PySpark / Scala

    Consulting Pandits • Pune
    Exciting Job Opportunity in Pune! Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic opportunity waiting for you!<...Show more
    Last updated: 30+ days ago • Promoted
    Senior Azure Cloud Native Developer

    Senior Azure Cloud Native Developer

    Right Move Staffing Solutions Private Limited • Pune
    Description : Key Responsibilities : - Design, develop, and deploy scalable, se...Show more
    Last updated: 8 days ago • Promoted
    Senior Developer

    Senior Developer

    Tata Consultancy Services • Pune, Maharashtra, India
    Strong knowledge of transportation management processes and industry best practices.Experience with SAP TM configuration and customization. Excellent problem-solving and analytical skills.Effective ...Show more
    Last updated: 23 days ago • Promoted
    Palni - Senior Cloud Developer

    Palni - Senior Cloud Developer

    Palni India Pvt. Ltd. • Pune
    Job Description : We are seeking a Senior Cloud Developer with strong expertise in Java (v17+), Google Cloud Platform (GCP), and data engineering frameworks.The candidate will ...Show more
    Last updated: 30+ days ago • Promoted
    Snowflake Developer - Python / Spark

    Snowflake Developer - Python / Spark

    First merdian • Pune
    Description : We are seeking a highly skilled and experienced Snowflake Lead responsible for leading the design, development, and implementation of Snowflake-based ...Show more
    Last updated: 30+ days ago • Promoted
    Senior SAP Datasphere Developer

    Senior SAP Datasphere Developer

    Quantum Integrators Group, LLC • Pune
    Description : Here is the detailed, premium Job Description for the Senior SAP Datasphere Developer, emphasi...Show more
    Last updated: 23 days ago • Promoted
    Senior Hyperion Developer - Essbase

    Senior Hyperion Developer - Essbase

    Adept Consulting • Pune
    Description : Excellent Opportunity with our Top MNC Client @ Pune We are seeking a highly skilled Senior Hyperion Developer wit...Show more
    Last updated: 30+ days ago • Promoted
    Senior SQL Developer - Azure Cloud

    Senior SQL Developer - Azure Cloud

    Talks About People • Pune
    Description : Domain : Azure Cloud - Data Engineering - Enterprise SQL Are you a data expert who loves building scalable, high-performance syst...Show more
    Last updated: 30+ days ago • Promoted
    Infocepts - Senior Data Engineer - Spark / ETL

    Infocepts - Senior Data Engineer - Spark / ETL

    InfoCepts Technologies Pvt. Ltd. • Pune
    Description : Purpose of the Position : To design, build, and optimize scalable data pipelines and solutions u...Show more
    Last updated: 6 days ago • Promoted
    Big Data Architect - Spark / Hadoop

    Big Data Architect - Spark / Hadoop

    Consulting Pandits • Pune
    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Spark Developer - Big Data Technologies

    Senior Spark Developer - Big Data Technologies

    Ixceed Solutions • Pune
    Description : Job Description : We are looking for an experienced Senior Spark Developer with a strong background in Scala, Java, and Big Data te...Show more
    Last updated: 30+ days ago • Promoted
    Senior Oracle ODI Developer

    Senior Oracle ODI Developer

    SystemBender • Pune, India
    Design and develop ODI interfaces, packages, scenarios, and load plans.Work with stakeholders to gather requirements and translate them into ODI solutions. Implement mappings and transformations to ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Engineer - Google Cloud Platform

    Senior Engineer - Google Cloud Platform

    Han Digital Solution (P) Ltd • Pune
    Client is Top most FINTECH)-Only diversity we required.Your key responsibilities : - You are responsible for the implementation of the new project on GCP (Spark, Dataproc, Data...Show more
    Last updated: 17 days ago • Promoted
    Senior / Lead Developer - DevOps & Cloud

    Senior / Lead Developer - DevOps & Cloud

    HUMANCLOUD TECHNOLOGIES PRIVATE LIMITED • Pune
    Description : Unlock the future of cloud-native engineering.Expertise in CI / CD & DevOps.Powerful growth in FinTech and cloud domains.About the Role : &l...Show more
    Last updated: 16 days ago • Promoted
    Senior Azure / SQL Developer - Big Data / PySpark

    Senior Azure / SQL Developer - Big Data / PySpark

    Lancesoft India Pvt Ltd • Pune
    Description : Position Overview As a Senior Azure / SQL Developer, you will be responsible for the end-to-end development, deployment, a...Show more
    Last updated: 30+ days ago • Promoted
    Senior Salesforce Developer

    Senior Salesforce Developer

    Synechron • Pune, Maharashtra, India
    Good-day, We have immediate opportunity for Salesforce Developer.Job Role : Salesforce Developer Job Location : Synechron : Bengaluru BCIT Experience- 7 to 15 years Notice : Immediate Joiner / Face...Show more
    Last updated: 30+ days ago • Promoted