Talent.com
This job offer is not available in your country.
Senior Software Engineer_ Bigdata (Java / Scala, Spark, AWS )

Senior Software Engineer_ Bigdata (Java / Scala, Spark, AWS )

The Nielsen CompanyBengaluru, Karnataka, India
16 hours ago
Job description

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. As a Senior Software Developer, you will be a contributor of a Scrum / DevOps team focusing on analyzing, developing, testing, and supporting highly complex application software build on Big Data Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with your Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies.

Responsibilities

  • Stay informed about the latest technology and methodology by participating in industry forums, having an active peer network, and engaging actively with customers
  • Cultivate a team environment focused on continuous learning, where innovative technologies are developed and refined through collaborative effort
  • Build scalable, reliable, cost-effective solutions for both the Cloud and on-premises with an emphasis on quality, best-practice coding standards, and cost-effectiveness
  • Build and test Cloud-based applications for new and existing backend systems to help facilitate development teams to migrate to the cloud.
  • Build platform reusable code and components that could be used by multiple project teams.
  • Understand the enterprise architecture within the context of existing platforms, services and strategic direction.
  • Implement end-to-end solutions with sound technical architecture, in Big Data analytics framework along with customized solutions that are scalable, with primary focus on performance, quality, maintainability, cost and testability.
  • Drive innovative solutions within the platform to establish common components, while allowing customization of solutions for different products.
  • Develop design specifications, continuous build and deployment strategy to drive Agile methodology
  • Setup and manage expectations with consultants engaged in the projects.
  • Provide cloud integration development support to various project teams.
  • Build rapid technical prototypes for early customer validation of new technologies
  • Collaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelines
  • Collaborate with product owners to translate complex business requirements into technical solutions, providing leadership in the design and architecture processes.
  • Provide expert apprenticeship to project teams on technology strategy, cultivating advanced skill sets in application engineering and implementing modern software engineering practices
  • Mentor junior team members, providing guidance and support in their professional development

Key Skills

  • Domain Expertise
  • Bachelor’s degree in computer science, engineering plus 5-8 years of experience in information technology solutions development.
  • Must have strong cloud Implementation expertise in cloud architecture.
  • Must have strong analytical and technical skills in troubleshooting and problem resolution.
  • Must have the ability to provide solutions utilizing best practices for resilience, scalability, cloud optimization and security.
  • 3+ years of experience : big data using Apache Spark in developing distributed processing. applications; building applications with immutable infrastructure in the AWS Cloud with automation technologies like Terraform or Ansible or CloudFormation.
  • A quick learner, who can pick up new technologies, program languages and frameworks in a short span of time
  • Technical Skills

  • Experience in Service-oriented architecture, Spark Streaming, and Git.
  • Experience in software development using programming languages & tools / services : Java or Scala, Big Data, Hadoop, Spark, Spark SQL, Presto \ Hive, Cloud (preferably AWS), Docker, RDBMS (such as Postgres and / or Oracle), Linux, Shell scripting, GitLab, Airflow.
  • Experience in big data processing tools / languages using Apache Spark Scala.
  • Experience with orchestration tools : Apache Airflow or similar tools.
  • Strong knowledge on Unix / Linux OS, commands, shell scripting, python, JSON, YAML.
  • Agile scrum experience in application development is required.
  • Strong knowledge in AWS S3, PostgreSQL or MySQL.
  • Strong knowledge in AWS Compute : EC2, EMR, AWS Lambda.
  • Strong knowledge in Gitlab / Bitbucket .
  • AWS Certification is a plus.
  • Mindset and attributes

  • Very strong verbal and written communication skills
  • Advanced analytical and technical skills in troubleshooting and problem resolution
  • Ability to coach, mentor and provide guidance to junior colleagues
  • Create a job alert for this search

    Senior Software Engineer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionshosur, tamil nadu, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 28 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Veltrishosur, tamil nadu, in
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticshosur, tamil nadu, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLhosur, tamil nadu, in
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 29 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubeshosur, tamil nadu, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 18 days ago
    • Promoted
    Senior / Lead Backend Engineer Java & Cloud

    Senior / Lead Backend Engineer Java & Cloud

    adesso Indiahosur, tamil nadu, in
    We are looking for a highly experienced.Senior or Lead Backend Engineer.Java software development, cloud architecture, and DevOps practices. The ideal candidate will have deep hands-on experience in...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIhosur, tamil nadu, in
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 21 days ago
    • Promoted
    Senior Backend Engineer

    Senior Backend Engineer

    Eltropyhosur, tamil nadu, in
    Remote | Senior Backend Engineer | Eltropy (fintech SaaS Firm).You’ll work with Golang or Java, modern cloud infrastructure, and robust data systems to deliver reliable, high-performance solutions ...Show moreLast updated: 30+ days ago
    • Promoted
    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    USThosur, tamil nadu, in
    CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with. Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.hosur, tamil nadu, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    TechVeritohosur, tamil nadu, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 3 days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USAhosur, tamil nadu, in
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 8 days ago
    • Promoted
    Senior Product Engineer (Backend)

    Senior Product Engineer (Backend)

    Cityflohosur, tamil nadu, in
    We are looking for a Senior Product Engineer (Backend) who thrives at the intersection of product, design, and engineering. You’ll be responsible for building end-to-end features from ideation to de...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ImpetusBangalore Urban, Karnataka, India
    Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive.Good hands-on experience of python and Bash Scripts. Good understanding of SQL and data warehouse concepts.Strong analytic...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 11 days ago
    • Promoted
    Firmware Engineer – IoT Gateway Development

    Firmware Engineer – IoT Gateway Development

    Capgemini EngineeringBangalore Rural, Karnataka, India
    Firmware Engineer – IoT Gateway Development.Bachelor’s or Master’s degree in.Electronics & Communication Engineering.As a Firmware Engineer, you’ll contribute to embedded application development in...Show moreLast updated: 29 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Evolenthosur, tamil nadu, in
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CEShosur, tamil nadu, in
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalhosur, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Java - Senior Backend Engineer

    Java - Senior Backend Engineer

    InCommonhosur, tamil nadu, in
    US-based healthcare company on a mission to fix care for low-income patients with complex needs.They combine primary, behavioral, and social care into a single, continuous experience—powered by ele...Show moreLast updated: 3 days ago