Talent.com
Senior Cloudera Developer - Apache Spark

Senior Cloudera Developer - Apache Spark

Deutsche TelekomPune
2 days ago
Job description

Your Role :

We are looking for a Senior Cloudera Developer (Data Engineer) with extensive experience in Spark, the Hadoop ecosystem, and GCP services to design and implement data :

  • Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive.
  • Collaborate with data engineers to optimize data pipelines and data processing workflows.
  • Work closely with data analysts and data scientists to ensure data quality and integrity.
  • Troubleshoot and resolve issues with data processing and storage systems.
  • Stay up to date with trends and best practices in Cloudera development.
  • Participate in code reviews and provide feedback to team members.
  • Perform ETL processes using Spark.
  • Integrate Spark Streaming with other technologies like Kafka.
  • Deploy and manage Spark applications on a Hadoop cluster or GCP Dataproc.

Must-Have Criteria :

  • 6- 10 years of experience in data engineering.
  • Expertise in Apache Spark, including architecture and fault-tolerance mechanisms.
  • Proficiency with Spark DataFrames and Spark SQL for querying structured data.
  • Experience with ETL processes using Spark.
  • Strong knowledge of Python.
  • Bachelors degree in Computer Science, IT, or a related field.
  • Proven experience as a Cloudera Developer or similar role.
  • Solid understanding of Cloudera technologies : Hadoop, Spark, Hive.
  • Experience with data modeling, data warehousing, and data integration.
  • Programming skills in Java, Scala, or Python.
  • Excellent problem-solving and communication skills.
  • Ability to work independently and in a team environment.
  • Desired Skills :

  • Experience optimizing Spark execution plans.
  • Experience integrating Spark Streaming with technologies like Kafka.
  • Familiarity with the Hadoop ecosystem including HDFS, Hive, and the Cloudera stack.
  • Experience deploying and managing Spark applications on Hadoop clusters or GCP Dataproc.
  • Experience with Java programming.
  • Knowledge of DevOps tools and practices (CI / CD, Docker).
  • Practical experience with GCP services : Dataproc, Cloud Functions, Cloud Run, Pub / Sub, BigQuery.
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Developer • Pune

    Related jobs
    • Promoted
    SAP Datasphere Developer

    SAP Datasphere Developer

    Quantum IntegratorsPune, Maharashtra, India
    Role : SAP Datasphere Developer.Location : Pune / Nagpur, Maharashtra (Work From Office, Hybrid can be done).Job Type : Full-time with Quantum Integrators. SAP with 1-2 experience in building and impleme...Show moreLast updated: 14 days ago
    • Promoted
    Azure Cloud Developer

    Azure Cloud Developer

    Persistent SystemsPune, Maharashtra, India
    We are looking for candidates with Knowledge and hands on experience with Microsoft Azure, Docker, Kubernetes, Agile or Scrum, Terraform, GitLab and CI / CD pipelines. Job Type : Full Time Employment.R...Show moreLast updated: 17 days ago
    • Promoted
    Senior Spark Developer - Big Data Technologies

    Senior Spark Developer - Big Data Technologies

    Consulting PanditsPune
    Spark Rockstar Wanted! Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact.We&...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data Engineer - PySpark / Scala

    Senior Big Data Engineer - PySpark / Scala

    Consulting PanditsPune
    Exciting Job Opportunity in Pune! Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic opportunity waiting for you!<...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Application Developer

    Senior Application Developer

    Alp Consulting Ltd.Pune, Maharashtra, India
    We are looking for a minimum 8 years experienced Golang Developer to design, develop, and maintain enterprise-level applications. Golang programming language and design patterns expertise in clo...Show moreLast updated: 15 days ago
    • Promoted
    Scala Developer

    Scala Developer

    Tata Consultancy ServicesPune, Maharashtra, India
    Minimum 5+ years of experience in development of Spark Scala.Experience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata compon...Show moreLast updated: 30+ days ago
    • Promoted
    Palni - Senior Cloud Developer

    Palni - Senior Cloud Developer

    Palni India Pvt. Ltd.Pune
    Job Description : We are seeking a Senior Cloud Developer with strong expertise in Java (v17+), Google Cloud Platform (GCP), and data engineering frameworks.The candidate will ...Show moreLast updated: 3 days ago
    • Promoted
    Zensar Technologies - Senior Oracle CPQ Cloud Developer

    Zensar Technologies - Senior Oracle CPQ Cloud Developer

    Zensar TechnologiesPune
    Position : Senior Oracle CPQ Cloud Developer Experience : 7-10 Years Location : PAN Zensar (Hybrid) Notice Period : ImmediateShow moreLast updated: 30+ days ago
    • Promoted
    Senior Cloud Engineer

    Senior Cloud Engineer

    TN BUSINESS SERVICES PRIVATE LIMITEDPune
    We are seeking a seasoned hands-on engineer to be a key contributor in building our next-generation, highly secure, and compliant Cloud Platform. This is a build-and-develop role focused on creating...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - PySpark

    Senior Data Engineer - PySpark

    Xlr8 Talent SearchPune
    Job Description : We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop ...Show moreLast updated: 30+ days ago
    • Promoted
    Google cloud

    Google cloud

    ImpetusPune, Maharashtra, India
    Provides technical leadership in Big Data space (Hadoop Stack like Spark, M / R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies. Must have : Operating knowledge of cloud c...Show moreLast updated: 17 days ago
    • Promoted
    Senior Hyperion Developer - Essbase

    Senior Hyperion Developer - Essbase

    Adept ConsultingPune
    Description : Excellent Opportunity with our Top MNC Client @ Pune We are seeking a highly skilled Senior Hyperion Developer wit...Show moreLast updated: 26 days ago
    • Promoted
    Senior SQL Developer - Azure Cloud

    Senior SQL Developer - Azure Cloud

    Talks About PeoplePune
    Description : Domain : Azure Cloud - Data Engineering - Enterprise SQL Are you a data expert who loves building scalable, high-performance syst...Show moreLast updated: 8 days ago
    • Promoted
    Senior Spark Developer - Big Data Technologies

    Senior Spark Developer - Big Data Technologies

    Ixceed SolutionsPune
    Description : Job Description : We are looking for an experienced Senior Spark Developer with a strong background in Scala, Java, and Big Data te...Show moreLast updated: 10 days ago
    • Promoted
    Coditas - Senior Data Engineer - Python / Apache Spark

    Coditas - Senior Data Engineer - Python / Apache Spark

    Coditas Technologies Pvt. Ltd.Pune
    We are looking for Senior data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning. Build products in the data analytics space.Roles and Responsibil...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure / SQL Developer - Big Data / PySpark

    Senior Azure / SQL Developer - Big Data / PySpark

    Lancesoft India Pvt LtdPune
    Description : Position Overview As a Senior Azure / SQL Developer, you will be responsible for the end-to-end development, deployment, a...Show moreLast updated: 7 days ago
    • Promoted
    • New!
    [High Salary] Scala Developer

    [High Salary] Scala Developer

    Tata Consultancy ServicesPune, Maharashtra, India
    Location : Pune & Powai Must have : 1.Minimum 5+ years of experience in development of Spark Scala 2.Experience in designing and development of solutions for Big Data using Hadoop ecosystem technol...Show moreLast updated: 3 hours ago
    • Promoted
    Spark / Scala Data Engineer

    Spark / Scala Data Engineer

    Tata Consultancy ServicesPune, Maharashtra, India
    Role - Spark / Scala Data Engineer.Location - Bangalore / Chennai / Hyderabad / Delhi / Pune.Must Have- Big Data Hadoop - Hive and Spark / Scala solid experience- SQL advance knowledge - Been able to test ch...Show moreLast updated: 27 days ago