Talent.com
This job offer is not available in your country.
Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS)

Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS)

The Nielsen CompanyBengaluru, Karnataka, India
8 hours ago
Job description

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. As a Senior Software Developer, you will be a contributor of a Scrum / DevOps team focusing on analyzing, developing, testing, and supporting highly complex application software build on Big Data Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with your Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies.

Responsibilities

  • Build scalable, reliable, cost-effective solutions for both the Cloud and on-premises with an emphasis on quality, best-practice coding standards, and cost-effectiveness
  • Build and test Cloud-based applications for new and existing backend systems to help facilitate development teams to migrate to the cloud.
  • Build platform reusable code and components that could be used by multiple project teams.
  • Understand the enterprise architecture within the context of existing platforms, services and strategic direction.
  • Implement end-to-end solutions with sound technical architecture, in Big Data analytics framework along with customized solutions that are scalable, with primary focus on performance, quality, maintainability, cost and testability.
  • Drive innovative solutions within the platform to establish common components, while allowing customization of solutions for different products.
  • Develop design specifications, continuous build and deployment strategy to drive Agile methodology
  • Setup and manage expectations with consultants engaged in the projects.
  • Provide cloud integration development support to various project teams.
  • Build rapid technical prototypes for early customer validation of new technologies
  • Collaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelines
  • Collaborate with product owners to translate complex business requirements into technical solutions, providing leadership in the design and architecture processes.
  • Provide expert apprenticeship to project teams on technology strategy, cultivating advanced skill sets in application engineering and implementing modern software engineering practices
  • Mentor junior team members, providing guidance and support in their professional development
  • Stay informed about the latest technology and methodology by participating in industry forums, having an active peer network, and engaging actively with customers
  • Cultivate a team environment focused on continuous learning, where innovative technologies are developed and refined through collaborative effort

Key Skills

  • Domain Expertise :
  • Bachelor’s degree in computer science, engineering plus 4-8 years of experience in information technology solutions development.
  • Must have strong cloud Implementation expertise in cloud architecture.
  • Must have strong analytical and technical skills in troubleshooting and problem resolution.
  • Must have the ability to provide solutions utilizing best practices for resilience, scalability, cloud optimization and security.
  • 3+ years of experience : big data using Apache Spark in developing distributed processing. applications; building applications with immutable infrastructure in the AWS Cloud with automation technologies like Terraform or Ansible or CloudFormation.
  • A quick learner, who can pick up new technologies, program languages and frameworks in a short span of time
  • Technical Skills :

  • Experience in Service-oriented architecture, Spark Streaming, and Git.
  • Experience in software development using programming languages & tools / services : Java or Scala, Big Data, Hadoop, Spark, Spark SQL, Presto \ Hive, Cloud (preferably AWS), Docker, RDBMS (such as Postgres and / or Oracle), Linux, Shell scripting, GitLab, Airflow.
  • Experience in big data processing tools / languages using Apache Spark Scala.
  • Experience with orchestration tools : Apache Airflow or similar tools.
  • Strong knowledge on Unix / Linux OS, commands, shell scripting, python, JSON, YAML.
  • Agile scrum experience in application development is required.
  • Strong knowledge in AWS S3, PostgreSQL or MySQL.
  • Strong knowledge in AWS Compute : EC2, EMR, AWS Lambda.
  • Strong knowledge in GitLab / Bitbucket .
  • AWS Certification is a plus.
  • Mindset and attributes

  • Very strong verbal and written communication skills
  • Advanced analytical and technical skills in troubleshooting and problem resolution
  • Ability to coach, mentor and provide guidance to junior colleagues
  • Create a job alert for this search

    Senior Software Engineer Java • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    • New!
    Software Engineer - Bigdata ( Java or Scala or Python, Spark, SQL, AWS )

    Software Engineer - Bigdata ( Java or Scala or Python, Spark, SQL, AWS )

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Software Engineer - Bigdata ( Java / Scala,Python, Spark, SQL, AWS )

    Software Engineer - Bigdata ( Java / Scala,Python, Spark, SQL, AWS )

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Software Engineer - Bigdata (Java / Scala / Python,SQL, AWS)

    Software Engineer - Bigdata (Java / Scala / Python,SQL, AWS)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer (Bigdata)

    Senior Software Engineer (Bigdata)

    RokuBengaluru, Karnataka, India
    Roku is in the process of modernizing its Big Data Platform.We are working on defining the new architecture to improve user experience, minimize the cost and increase efficiency.Are you interested ...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Software Engineer - Bigdata (Java / Scala and SQL)

    Software Engineer - Bigdata (Java / Scala and SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Hadoop / Bigdata Engineer

    Senior Hadoop / Bigdata Engineer

    Anicalls (Pty) LtdBengaluru, Karnataka, India
    Work closely with our QA Team to ensure data integrity and overall system quality.Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and ...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Bigdata ( Java / Scala, Spark, SQL, AWS)

    Senior Software Engineer - Bigdata ( Java / Scala, Spark, SQL, AWS)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Big Data Software Engineer

    Senior Big Data Software Engineer

    EpamBengaluru, Karnataka, India
    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer- Data Platform

    Senior Software Engineer- Data Platform

    MoEngage Inc.Bengaluru, Karnataka, India
    Responsible for systems end to end - development to delivery.Keep scalability / availability / resilience in mind while building. Interfacing with multiple stakeholders to understand the requirements an...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer ( Java, Python, SQL, AWS / Oracle)

    Senior Software Engineer ( Java, Python, SQL, AWS / Oracle)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Software Engineer - Bigdata (Java / Scala / Python,SQL, AWS)

    Software Engineer - Bigdata (Java / Scala / Python,SQL, AWS)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior / Lead Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    Senior / Lead Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer_ Bigdata (Java / Scala, Spark, AWS )

    Senior Software Engineer_ Bigdata (Java / Scala, Spark, AWS )

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Data Engineer - (Big Data, Spark, Scala, Java, Python, Cassandra, Elasticserach, AWS, Airflow, RDBMS, SQL)

    Senior Data Engineer - (Big Data, Spark, Scala, Java, Python, Cassandra, Elasticserach, AWS, Airflow, RDBMS, SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Analytics

    Senior Software Engineer - Analytics

    Zeta GlobalBengaluru, Karnataka, India
    As a member of this team, the data engineer will be responsible for designing and expanding our existing data infrastructure, enabling easy access to data, supporting complex data analyses, and aut...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS).

    Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS).

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Big Data

    Senior Software Engineer - Big Data

    PayPalBengaluru, Karnataka, India
    Develop and optimize machine learning models for various applications.Preprocess and analyze large datasets to extract meaningful insights. Deploy ML solutions into production environments using app...Show moreLast updated: 8 hours ago