Talent.com
This job offer is not available in your country.
Lead Big Data (Java & Spark)

Lead Big Data (Java & Spark)

ConfidentialPune
22 days ago
Job description

s a Lead Big Data, you will be responsible for translating application storyboards and use cases into functional applications, designing and building efficient and reliable Java code. You will ensure optimal performance, quality, and responsiveness of applications, while also identifying bottlenecks and devising solutions. Your role will involve developing high-performance, low-latency components to run Spark clusters and collaborating with global teams to propose best practices and standards.

Technical Skills :

  • Programming Languages : Strong Java experience (8+ years) with Java 1.8 or higher; solid understanding of object-oriented programming and design patterns.
  • Big Data Technologies : Experience with HDFS, Hive, HBase, Apache Spark, and Kafka.
  • Data Processing : Proficient in processing data using Hive, Impala, and HBase; capable of performing analysis on large data sets.
  • APIs and Architecture : Experience in building self-service platform-agnostic data access APIs; knowledge of service-oriented architecture and data standards like JSON, Avro, and Parquet.
  • Analytical Skills : Experience in building advanced analytical models based on business context; strong analytical and problem-solving skills.
  • Development Practices : Familiarity with Agile / Scrum methodologies, SCMs like Git, and tools like JIRA; strong understanding of unit testing and SDLC activities.
  • Scripting and Databases : Experience with Linux shell scripting and RDBMS / NoSQL databases; good knowledge of database principles, practices, and SQL development (preferably with Oracle).
  • Performance Tuning : Experience in application performance tuning and troubleshooting in the Big Data domain.
  • Other Technologies : Familiarity with cloud and container technologies, build tools such as Maven, and continuous integration tools like Jenkins or Team City is a plus.

Experience :

  • 5-10 years of experience in software development, with strong Java and Big Data technology expertise.
  • Demonstrated ability to design solutions and mentor other developers within the team.
  • Proven experience in working with large data volumes and logical data structures.
  • Day-to-Day Activities :

  • Translate application storyboards and use cases into functional applications.
  • Design, build, and maintain reliable and efficient Java code.
  • Ensure optimal performance, quality, and responsiveness of applications.
  • Identify and resolve bottlenecks and bugs.
  • Develop high-performance components for Spark clusters.
  • Collaborate with global teams to propose best practices and standards.
  • Test software prototypes and facilitate handover to the operations team.
  • Process data using Hive, Impala, and HBase, and conduct analysis on large datasets.
  • Mentor and guide team members in technical skills and best practices.
  • Qualifications :

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Optional : Familiarity with Arcadia Tool for Analytics.
  • Soft Skills :

  • Excellent analytical and problem-solving abilities.
  • Strong communication and collaboration skills to work effectively with cross-functional teams.
  • Ability to mentor and guide junior developers.
  • Strong attention to detail and ability to work under pressure.
  • Creative thinking and initiative in proposing improvements and innovations.
  • Skills Required

    Spark, Big Data, Java

    Create a job alert for this search

    Big Data Lead • Pune

    Related jobs
    • Promoted
    AWS Database Eng

    AWS Database Eng

    Tata Consultancy ServicesPune, Maharashtra, India
    Desired Competencies (Technical / Behavioral Competency).Should have expertise in creating data warehouses in AWS utilizing the following tools : EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake....Show moreLast updated: 15 days ago
    • Promoted
    Scala Developer

    Scala Developer

    Tata Consultancy Servicespune, maharashtra, in
    TCS Hiring !!!! VIRTUAL Interview for AWS Scala (Senior Scala Software Engineer) – Immediate Joiners with 30 Days Notice. Role : Senior Scala Software Engineer (AWS Scala).Primary Skills : Scala, Scal...Show moreLast updated: 30+ days ago
    • Promoted
    Java Kafka Developer - Spring Boot / Microservices Architecture

    Java Kafka Developer - Spring Boot / Microservices Architecture

    HARP Technologies and ServicesPune
    Exp : 5 to 9 years Loc : Pune & Hyderabad only Mode : Hybrid Job Description : ...Show moreLast updated: 27 days ago
    • Promoted
    Big Data Engineer - Scala / Spark / Python

    Big Data Engineer - Scala / Spark / Python

    Idyllic Services Pvt LtdPune
    Job Title : Big Data Engineer - Scala Experience : 7 to 10Years (Minimum 3+ years in Scala) Notice Period : ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Hadoop / Spark / Hive

    Big Data Engineer - Hadoop / Spark / Hive

    True TalentsPune
    Job Title : Big Data Engineer Location : Bangalore / Pune Employment Type : Full Time ...Show moreLast updated: 23 days ago
    • Promoted
    Scala Developer

    Scala Developer

    CliqHRPune
    We are hiring an experienced Scala Developer to build high-performance, cloud-native applications.This role offers the opportunity to work on advanced microservices and event-driven systems that po...Show moreLast updated: 23 days ago
    • Promoted
    Confluence Kafka Engineer

    Confluence Kafka Engineer

    Persistent SystemsPune, Maharashtra, India
    A highly skilled Confluent Kafka Engineer with strong expertise in Ansible and DevOps practices.This role involves designing, deploying, and managing Kafka-based streaming platforms, automating inf...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Scala Software Engineer

    Scala Software Engineer

    Tata Consultancy Servicespune, maharashtra, in
    TCS is looking for Scala Software Engineer.Required technical skill sets : .Working exp as Scala Developer.Working exp in Scala Typelevel development. Experience in Scala backend development.Proficien...Show moreLast updated: 12 hours ago
    • Promoted
    Azure Databricks Engineer

    Azure Databricks Engineer

    TechMantra GlobalPune
    Role : Azure Databricks.Location : Any Hyderabad, Chennai , Bangalore , Pune , Noida, Gurgaon are preferred.Skills : Azure, Notebooks, Spark-Scala, Bigdata, Cloudera P...Show moreLast updated: 15 days ago
    • Promoted
    Spark / Scala Developer

    Spark / Scala Developer

    Cyanous Software Private LimitedPune
    Detailed JD (Roles and Responsibilities) : - At least 8+ years of experience and strong knowledge in Scala programming language.Able to write clean, ...Show moreLast updated: 30+ days ago
    • Promoted
    Delphi Developer - SQL Server

    Delphi Developer - SQL Server

    Corpxcel ConsultingPune
    Location : Chennai / Bangalore / Hyderabad / Coimbatore / Pune WFO- 3 days Mandatory from the above-mentioned locations.ROLE SUMMARY : The D...Show moreLast updated: 30+ days ago
    • Promoted
    OpenGov - Data Solution Engineer III - Python / SQL

    OpenGov - Data Solution Engineer III - Python / SQL

    OpengovPune
    Description : About the job : OpenGov is the leader in AI and ERP solutions for local and state governments in the U.More th...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticspune, maharashtra, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 8 days ago
    • Promoted
    Spark / Scala Developer - Apache NiFi

    Spark / Scala Developer - Apache NiFi

    HARP Technologies and ServicesPune
    Notice Period : Immediate to 30 Days Job Summary : We are looking for experienced Spark Scala Developers to...Show moreLast updated: 30+ days ago
    • Promoted
    Kafka Developer - Java

    Kafka Developer - Java

    Risk Resources LLPPune
    Role : Required Technical Skill Set : - Sound knowledge of Apache Kafka Configuration and Pub / Sub ...Show moreLast updated: 14 days ago
    • Promoted
    Scala Developer

    Scala Developer

    ACL Digitalpune, maharashtra, in
    Acl digital is hiring for remotely for.Senior Scala Software Engineer.Job Title : Senior Scala Software Engineer.Design, develop, test, and document modules / features for Blue Planet Inventory and Or...Show moreLast updated: 23 days ago
    • Promoted
    • New!
    SAP Consultant

    SAP Consultant

    Automatic Infotechbibvewadi, maharashtra, in
    SAP PP Certification / Training is.SAP PP module (through projects, training, or internship).Basic understanding of SAP PP processes such as Material Requirement Planning , Bill of Materials Manage...Show moreLast updated: 12 hours ago
    • Promoted
    MAN - Data Engineer - PySpark / SQL

    MAN - Data Engineer - PySpark / SQL

    MAN TRUCK & BUS INDIA PVT. LTDPune
    Qualification : Degree in Computer Science (or similar), alternatively well-founded professional experience in the desired field. Experience Range : 3 to 5 Years.Roles & Resp...Show moreLast updated: 25 days ago
    • Promoted
    Senior Scala Developer

    Senior Scala Developer

    ACL Digitalpune, maharashtra, in
    ACL Digital is actively hiring for experienced.Job Requirement - Senior Java Developer.Preferred Qualification : 5-10 Years Experience (Remote). Computer Science or a related technical field.Customer...Show moreLast updated: 8 days ago
    • Promoted
    Coditas - Senior Data Engineer - Python / Apache Spark

    Coditas - Senior Data Engineer - Python / Apache Spark

    Coditas Technologies Pvt. Ltd.Pune
    We are looking for Senior data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning. Build products in the data analytics space.Roles and Responsibil...Show moreLast updated: 25 days ago