Talent.com
This job offer is not available in your country.
Senior Software Engineer - Bigdata (Java / Scala, Spark, Python, AWS )

Senior Software Engineer - Bigdata (Java / Scala, Spark, Python, AWS )

The Nielsen CompanyGurgaon, India
6 hours ago
Job description

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. As a Senior Software Developer, you will be a contributor of a Scrum / DevOps team focusing on analyzing, developing, testing, and supporting highly complex application software build on Big Data Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with your Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies.

Responsibilities

  • Stay informed about the latest technology and methodology by participating in industry forums, having an active peer network, and engaging actively with customers
  • Cultivate a team environment focused on continuous learning, where innovative technologies are developed and refined through collaborative effort
  • Build scalable, reliable, cost-effective solutions for both the Cloud and on-premises with an emphasis on quality, best-practice coding standards, and cost-effectiveness
  • Build and test Cloud-based applications for new and existing backend systems to help facilitate development teams to migrate to the cloud.
  • Build platform reusable code and components that could be used by multiple project teams.
  • Understand the enterprise architecture within the context of existing platforms, services and strategic direction.
  • Implement end-to-end solutions with sound technical architecture, in Big Data analytics framework along with customized solutions that are scalable, with primary focus on performance, quality, maintainability, cost and testability.
  • Drive innovative solutions within the platform to establish common components, while allowing customization of solutions for different products.
  • Develop design specifications, continuous build and deployment strategy to drive Agile methodology
  • Setup and manage expectations with consultants engaged in the projects.
  • Provide cloud integration development support to various project teams.
  • Build rapid technical prototypes for early customer validation of new technologies
  • Collaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelines
  • Collaborate with product owners to translate complex business requirements into technical solutions, providing leadership in the design and architecture processes.
  • Provide expert apprenticeship to project teams on technology strategy, cultivating advanced skill sets in application engineering and implementing modern software engineering practices
  • Mentor junior team members, providing guidance and support in their professional development

Key Skills

  • Domain Expertise
  • Bachelor’s degree in computer science, engineering plus 5-8 years of experience in information technology solutions development.
  • Must have strong cloud Implementation expertise in cloud architecture.
  • Must have strong analytical and technical skills in troubleshooting and problem resolution.
  • Must have the ability to provide solutions utilizing best practices for resilience, scalability, cloud optimization and security.
  • 3+ years of experience : big data using Apache Spark in developing distributed processing. applications; building applications with immutable infrastructure in the AWS Cloud with automation technologies like Terraform or Ansible or CloudFormation.
  • A quick learner, who can pick up new technologies, program languages and frameworks in a short span of time
  • Technical Skills
  • Experience in Service-oriented architecture, Spark Streaming, and Git.
  • Experience in software development using programming languages & tools / services : Java or Scala, Big Data, Hadoop, Spark, Spark SQL, Presto \ Hive, Cloud (preferably AWS), Docker, RDBMS (such as Postgres and / or Oracle), Linux, Shell scripting, GitLab, Airflow.
  • Experience in big data processing tools / languages using Apache Spark Scala.
  • Experience with orchestration tools : Apache Airflow or similar tools.
  • Strong knowledge on Unix / Linux OS, commands, shell scripting, python, JSON, YAML.
  • Agile scrum experience in application development is required.
  • Strong knowledge in AWS S3, PostgreSQL or MySQL.
  • Strong knowledge in AWS Compute : EC2, EMR, AWS Lambda.
  • Strong knowledge in Gitlab / Bitbucket .
  • AWS Certification is a plus.
  • Mindset and attributes
  • Very strong verbal and written communication skills
  • Advanced analytical and technical skills in troubleshooting and problem resolution
  • Ability to coach, mentor and provide guidance to junior colleagues
  • Create a job alert for this search

    Senior Software Engineer • Gurgaon, India

    Related jobs
    • Promoted
    Senior Cloud Engineer

    Senior Cloud Engineer

    Dexian IndiaDelhi, IN
    Title : Senior Cloud Engineer / FullStack Developer (with Cloud Experience).Notice Period : Immediate to Currently serving. Proficiency in modern programming languages such as Java, Python, JavaScript,...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLDelhi, IN
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    The Mastermind GroupDelhi, IN
    Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG). Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EvolentDelhi, IN
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIDelhi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Senior Software Engineer - Bigdata (Java / Scala, Spark, Python, AWS )

    Senior Software Engineer - Bigdata (Java / Scala, Spark, Python, AWS )

    The Nielsen Companygurgaon, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Software Engineer (Java / Scala, Spark, Kubernetes, AWS)

    Senior Software Engineer (Java / Scala, Spark, Kubernetes, AWS)

    The Nielsen Companygurgaon, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Software Engineer

    Senior Software Engineer

    BrightEdgeDelhi, IN
    Senior Software Engineer, Remote.The Software Engineer, Data Ingestion will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust ...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Sr. Software Engineer

    Sr. Software Engineer

    IntraEdgeDelhi, IN
    Senior Data Engineer – Pyspark | AWS Lambda | AWS Glue | Snowflake.The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring seamless data integration a...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Senior Software Engineer- Python

    Senior Software Engineer- Python

    BirdeyeGurugram, Haryana, India
    Senior Software Engineer- Python.Birdeye is the highest-rated platform for reputation, social media, and customer experience management for local businesses and brands. Over 150,000 businesses use B...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    The Nielsen CompanyGurgaon, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USADelhi, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Senior Big Data Software Engineer

    Senior Big Data Software Engineer

    Epamgurugram, India
    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesDelhi, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Senior Software Engineer

    Senior Software Engineer

    CredHiveDelhi, India, India
    We are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry.Our team consists of experts in machine learning and software engineers who have ...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Senior / Lead Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    Senior / Lead Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    The Nielsen CompanyGurgaon, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIDelhi, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    Senior Python Engineer / AWS

    Senior Python Engineer / AWS

    Anicalls (Pty) Ltdnoida, India
    Candidate with 5+ years of Experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.Ex...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisDelhi, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Delhi, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago