Talent.com
Senior Big Data Engineer (Java, Spark)
Senior Big Data Engineer (Java, Spark)Confidential • Pune
Senior Big Data Engineer (Java, Spark)

Senior Big Data Engineer (Java, Spark)

Confidential • Pune
24 days ago
Job description

Software Requirements :

  • Proficient in Java (version 1.8 or higher), with a solid understanding of object-oriented programming and design patterns.
  • Experience with Big Data technologies including Hadoop, Spark, Hive, HBase, and Kafka.
  • Strong knowledge of SQL and NoSQL databases with experience in Oracle preferred.
  • Familiarity with data processing frameworks and standards, such as JSON, Avro, and Parquet.
  • Proficiency in Linux shell scripting and basic Unix OS knowledge.
  • Experience with code versioning tools, such as Git, and project management tools like JIRA.
  • Familiarity with CI / CD tools such as Jenkins or Team City, and build tools like Maven.

Overall Responsibilities :

  • Translate application storyboards and use cases into functional applications while ensuring high performance and responsiveness.
  • Design, build, and maintain efficient, reusable, and reliable Java code.
  • Develop high-performance and low-latency components to run Spark clusters and support Big Data platforms.
  • Identify and resolve bottlenecks and bugs, proposing best practices and standards.
  • Collaborate with global teams to ensure project alignment and successful execution.
  • Perform testing of software prototypes and facilitate their transfer to operational teams.
  • Conduct analysis of large data sets to derive actionable insights and contribute to advanced analytical model building.
  • Mentor junior developers and assist in design solution strategies.
  • Category-wise Technical Skills :

    Core Development Skills :

  • Strong Core Java and multithreading experience.
  • Knowledge of concurrency patterns and scalable application design principles.
  • Big Data Technologies :

  • Proficiency in Hadoop ecosystem components (HDFS, Hive, HBase, Apache Spark).
  • Experience in building self-service platform-agnostic data access APIs.
  • Analytical Skills :

  • Demonstrated ability to analyze large data sets and derive insights.
  • Strong systems analysis, design, and architecture fundamentals.
  • Testing and CI / CD :

  • Experience in unit testing and SDLC activities.
  • Familiarity with Agile / Scrum methodologies for project management.
  • Experience :

  • 5 to 9 years of experience in software development, with a strong emphasis on Java and Big Data technologies.
  • Proven experience in performance tuning and troubleshooting applications in a Big Data environment.
  • Experience working in a collaborative global team setting.
  • Day-to-Day Activity :

  • Collaborate with cross-functional teams to understand and translate functional requirements into technical designs.
  • Write and maintain high-quality, performant code while enforcing coding standards.
  • Conduct regular code reviews and provide constructive feedback to team members.
  • Monitor application performance and address issues proactively.
  • Engage in daily stand-ups and sprint planning sessions to ensure alignment with team goals.
  • Qualifications :

  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
  • Relevant certifications in Big Data technologies or Java development are a plus.
  • Soft Skills :

  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team.
  • Ability to mentor others and share knowledge within the team.
  • Strong organizational skills and attention to detail, with the ability to manage multiple priorities.
  • Skills Required

    Sql, Linux Shell Scripting, Sdlc, Kafka

    Create a job alert for this search

    Big Data Engineer • Pune

    Related jobs
    Senior Big Data Engineer - PySpark / Scala

    Senior Big Data Engineer - PySpark / Scala

    Consulting Pandits • Pune
    Exciting Job Opportunity in Pune! Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic opportunity waiting for you!<...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Pune, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Arenema • Pune, IN
    India (remote – Bangalore / Karnataka area preferred).Full-time contractor / employee.You will be a core member of the team building a data platform that maps economic, advertising and real-estate ac...Show more
    Last updated: 1 day ago • Promoted
    Big Data Developer

    Big Data Developer

    UST • Pune, Maharashtra, India
    The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Persistent Systems • Pune, India
    We are seeking Data Engineer with hands-on experience in Spark, Pyspark, AWS, Java, Python etc.Location : All Persistent Locations. Job Type : Full Time Employment.Design, build, and maintain data pip...Show more
    Last updated: 30+ days ago • Promoted
    Senior Cloudera Developer - Apache Spark

    Senior Cloudera Developer - Apache Spark

    Deutsche Telekom • Pune
    Your Role : We are looking for a Senior Cloudera Developer (Data Engineer) with extensive experience in Spark, the Hadoop ecosystem, and GC...Show more
    Last updated: 30+ days ago • Promoted
    Senior Spark Developer - Big Data Technologies

    Senior Spark Developer - Big Data Technologies

    Consulting Pandits • Pune
    Spark Rockstar Wanted! Imagine a world where big data is not just a buzzword, but a playground where you get to build innovative solutions that make a real impact.We&...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • Pune, IN
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Infocepts - Senior Data Engineer - Spark / ETL

    Infocepts - Senior Data Engineer - Spark / ETL

    InfoCepts Technologies Pvt. Ltd. • Pune
    Description : Purpose of the Position : To design, build, and optimize scalable data pipelines and solutions u...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Pune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Maharashtra, India
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 24 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune, Maharashtra, India
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 21 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    vConstruct Private Limited • Pune, Maharashtra, India
    Construct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data a...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Trinity Technology Solutions LLC • Pune, India
    Location : Pune preferred / remote.Programming Python, PySpark / Spark.Operating Systems Linux (RedHat).Databases Hive, MSSQL, MySQL, PostgreSQL. Big Data Hadoop ecosystem (HDFS, YARN, Sqoop).Version Co...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Pune, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Pune, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 8 days ago • Promoted