Talent.com
This job offer is not available in your country.
Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS).

Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark, SQL, AWS).

The Nielsen CompanyBengaluru, Karnataka, India
6 hours ago
Job description

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. As a Senior Software Developer, you will be a contributor of a Scrum / DevOps team focusing on analyzing, developing, testing, and supporting highly complex application software build on Big Data Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with your Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies.

Responsibilities

  • Build scalable, reliable, cost-effective solutions for both the Cloud and on-premises with an emphasis on quality, best-practice coding standards, and cost-effectiveness
  • Build and test Cloud-based applications for new and existing backend systems to help facilitate development teams to migrate to the cloud.
  • Build platform reusable code and components that could be used by multiple project teams.
  • Understand the enterprise architecture within the context of existing platforms, services and strategic direction.
  • Implement end-to-end solutions with sound technical architecture, in Big Data analytics framework along with customized solutions that are scalable, with primary focus on performance, quality, maintainability, cost and testability.
  • Drive innovative solutions within the platform to establish common components, while allowing customization of solutions for different products.
  • Develop design specifications, continuous build and deployment strategy to drive Agile methodology
  • Setup and manage expectations with consultants engaged in the projects.
  • Provide cloud integration development support to various project teams.
  • Build rapid technical prototypes for early customer validation of new technologies
  • Collaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelines
  • Collaborate with product owners to translate complex business requirements into technical solutions, providing leadership in the design and architecture processes.
  • Provide expert apprenticeship to project teams on technology strategy, cultivating advanced skill sets in application engineering and implementing modern software engineering practices
  • Mentor junior team members, providing guidance and support in their professional development
  • Stay informed about the latest technology and methodology by participating in industry forums, having an active peer network, and engaging actively with customers
  • Cultivate a team environment focused on continuous learning, where innovative technologies are developed and refined through collaborative effort

Key Skills

  • Domain Expertise :
  • Bachelor’s degree in computer science, engineering plus 4-8 years of experience in information technology solutions development.
  • Must have strong cloud Implementation expertise in cloud architecture.
  • Must have strong analytical and technical skills in troubleshooting and problem resolution.
  • Must have the ability to provide solutions utilizing best practices for resilience, scalability, cloud optimization and security.
  • 3+ years of experience : big data using Apache Spark in developing distributed processing. applications; building applications with immutable infrastructure in the AWS Cloud with automation technologies like Terraform or Ansible or CloudFormation.
  • A quick learner, who can pick up new technologies, program languages and frameworks in a short span of time
  • Technical Skills :

  • Experience in Service-oriented architecture, Spark Streaming, and Git.
  • Experience in software development using programming languages & tools / services : Java or Scala, Big Data, Hadoop, Spark, Spark SQL, Presto \ Hive, Cloud (preferably AWS), Docker, RDBMS (such as Postgres and / or Oracle), Linux, Shell scripting, GitLab, Airflow.
  • Experience in big data processing tools / languages using Apache Spark Scala.
  • Experience with orchestration tools : Apache Airflow or similar tools.
  • Strong knowledge on Unix / Linux OS, commands, shell scripting, python, JSON, YAML.
  • Agile scrum experience in application development is required.
  • Strong knowledge in AWS S3, PostgreSQL or MySQL.
  • Strong knowledge in AWS Compute : EC2, EMR, AWS Lambda.
  • Strong knowledge in GitLab / Bitbucket .
  • AWS Certification is a plus.
  • Mindset and attributes

  • Very strong verbal and written communication skills
  • Advanced analytical and technical skills in troubleshooting and problem resolution
  • Ability to coach, mentor and provide guidance to junior colleagues
  • Create a job alert for this search

    Senior Software Engineer Java • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    • New!
    Software Engineer - Bigdata ( Java / Scala,Python, Spark, SQL, AWS )

    Software Engineer - Bigdata ( Java / Scala,Python, Spark, SQL, AWS )

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Software Engineer - Big Data Engineer (Java / Python.)

    Software Engineer - Big Data Engineer (Java / Python.)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Software Engineer (Bigdata)

    Senior Software Engineer (Bigdata)

    RokuBengaluru, Karnataka, India
    Roku is in the process of modernizing its Big Data Platform.We are working on defining the new architecture to improve user experience, minimize the cost and increase efficiency.Are you interested ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Software Engineer - Bigdata (Java / Scala and SQL)

    Software Engineer - Bigdata (Java / Scala and SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    ETL Data Engineer – AWS & Python Specialist

    ETL Data Engineer – AWS & Python Specialist

    EastvantageBangalore Rural, Karnataka, India
    We're Hiring : ETL Data Engineer – AWS & Python Specialist!.We are seeking an experienced ETL Data Engineer to design, develop, and maintain robust data pipelines using AWS cloud services and Python...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Volvo CarsNandhagudi, Karnataka, India
    We bring bold digital visions to life.So we’re on the lookout for more curious and creative engineers who want to create change – one line of high-quality code at a time. Our transformation isn't fo...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Hadoop / Bigdata Engineer

    Senior Hadoop / Bigdata Engineer

    Anicalls (Pty) LtdBengaluru, Karnataka, India
    Work closely with our QA Team to ensure data integrity and overall system quality.Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Big Data Engineer ( Java / Scala and SQL)

    Big Data Engineer ( Java / Scala and SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Bigdata ( Java / Scala, Spark, SQL, AWS)

    Senior Software Engineer - Bigdata ( Java / Scala, Spark, SQL, AWS)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Software Engineer- Data Platform

    Senior Software Engineer- Data Platform

    MoEngage Inc.Bengaluru, Karnataka, India
    Responsible for systems end to end - development to delivery.Keep scalability / availability / resilience in mind while building. Interfacing with multiple stakeholders to understand the requirements an...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Data

    Senior Software Engineer - Data

    Zeta GlobalBengaluru, Karnataka, India
    Senior Software Engineer – Data.We’re seeking a Senior Software Engineer or a Lead Software Engineer to join one of our Data Layer teams. As the name implies, the Data Layer is at the core of all th...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Software Engineer - Bigdata (Java / Scala / Python,SQL, AWS)

    Software Engineer - Bigdata (Java / Scala / Python,SQL, AWS)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior / Lead Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    Senior / Lead Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Blend360Bengaluru, Karnataka, India
    Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client. This role is part of a strategic initiative to enable ro...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead Big Data Software Engineer

    Lead Big Data Software Engineer

    EpamBengaluru, Karnataka, India
    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIBengaluru, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Senior Software Engineer_ Bigdata (Java / Scala, Spark, AWS )

    Senior Software Engineer_ Bigdata (Java / Scala, Spark, AWS )

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Data + AI Observability

    Senior Software Engineer - Data + AI Observability

    DatabricksBengaluru, Karnataka, India
    Companies are investing billions of dollars into developing and deploying AI and the data platforms that enable it.But do they know what is happening? . At Databricks, we are passionate about enabli...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ImpetusBangalore Urban, Karnataka, India
    Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive.Good hands-on experience of python and Bash Scripts. Good understanding of SQL and data warehouse concepts.Strong analytic...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Software Engineer (Java / Scala, Spark, Kubernetes, AWS)

    Senior Software Engineer (Java / Scala, Spark, Kubernetes, AWS)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago