Talent.com
This job offer is not available in your country.
Hadoop Data Engineer / Senior Software Engineer

Hadoop Data Engineer / Senior Software Engineer

HSBCPune, Maharashtra, India
12 hours ago
Job description

Some careers shine brighter than others.

If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Senior Software Engineer

In this role you will be

  • Expertise in Scala-Spark / Python-Spark development and should be able to Work with Agile application dev team to implement data strategies.
  • Design and implement scalable data architectures to support the bank's data needs.
  • Develop and maintain ETL (Extract, Transform, Load) processes.
  • Ensure the data infrastructure is reliable, scalable, and secure.
  • Oversee the integration of diverse data sources into a cohesive data platform.
  • Ensure data quality, data governance, and compliance with regulatory requirements.
  • Monitor and optimize data pipeline performance.
  • Troubleshoot and resolve data-related issues promptly.
  • Implement monitoring and alerting systems for data processes.
  • Troubleshoot and resolve technical issues optimizing system performance ensuring reliability.
  • Create and maintain technical documentation for new and existing system ensuring that information is accessible to the team.
  • Implementing and monitoring solutions that identify both system bottlenecks and production issues.

Requirements

To be successful in this role, you should meet the following requirements :

  • Experience in data engineering or related field and hands-on experience of building and maintenance of ETL Data pipelines
  • Good experience in Designing and Developing Spark Applications using Scala or Python.
  • Good experience with database technologies (SQL, NoSQL), data warehousing solutions, and big data technologies (Hadoop, Spark)
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Optimization and Performance Tuning of Spark Applications
  • GIT Experience on creating, merging and managing Repos.
  • Perform unit testing and performance testing.
  • Good understanding of ETL processes and data pipeline orchestration tools like Airflow, Control-M.
  • Strong problem-solving skills and ability to work under pressure.
  • Excellent communication and interpersonal skills.
  • Create a job alert for this search

    Data Engineer • Pune, Maharashtra, India

    Related jobs
    • Promoted
    • New!
    Senior Big Data Software Engineer

    Senior Big Data Software Engineer

    EpamPune, Maharashtra, India
    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    BigData-Hadoop / Scala Engineer, AVP

    BigData-Hadoop / Scala Engineer, AVP

    Deutsche BankPune, Maharashtra, India
    An Associate Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of th...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Software Engineer - Data

    Senior Software Engineer - Data

    ZendeskPune, Maharashtra, India
    We’re looking for a smart, adaptable.You’ll work at the intersection of software engineering and data infrastructure, designing and maintaining scalable systems that stream high-quality, trusted ...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Officer- Data Engineer (Big Data, Hadoop, Hive, PySpark)

    Officer- Data Engineer (Big Data, Hadoop, Hive, PySpark)

    CitiPune, Maharashtra, India
    Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with lase...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Rockwell AutomationPune, Maharashtra, India
    Rockwell Automation is a global technology leader focused on helping the world’s manufacturers be more productive, sustainable, and agile. With more than 28,000 employees who make the world better e...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    BigData-Hadoop / Scala Engineer. AS

    BigData-Hadoop / Scala Engineer. AS

    Deutsche BankPune, Maharashtra, India
    An Associate Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of th...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Braves TechnologiesPune, Maharashtra, India
    The ideal candidate will have extensive experience with Python, Databricks, AWS platforms, and strong hands-on skills Docker. You will play a key role in integrating data with client’s vendors, spec...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Engineer _ Cloud Data Engineer

    Senior Engineer _ Cloud Data Engineer

    ZSPune, Maharashtra, India
    As a management consulting and technology firm focused on improving life and how we live it, we transform ideas into impact by. Here you’ll work side-by-side with a powerful collective of thinkers a...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Software Engineer- Data Engineer

    Senior Software Engineer- Data Engineer

    Nitor InfotechPune, Maharashtra, India
    Software Developer in Schaumburg, IL : .Hours / Week, Permanent position, Full time.Work closely with business stakeholders to translate business requirements into technical tasks and review the same...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    RiskInsight Consulting Pvt LtdPune, Maharashtra, India
    Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.Build and maintain scalable data pipelines for effective data ingestion, trans...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Platform Engineer

    Senior Platform Engineer

    AutodeskPune, Maharashtra, India
    We are seeking a highly skilled and experienced Senior Platform Engineer to join our Data Platform team.The ideal candidate will have a strong background in data platforms, data warehousing, and da...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Saaki Argus & Averil ConsultingPune, Maharashtra, India
    Hiring Senior Data Engineer for an IT Product Company.Minimum 4+Yrs of Relevant Experience.Mandatory Skills : Strong expertise in Python ( Class methods), OOPS in Python, SQL , Databricks , AWS or A...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Data Architect / Engineer

    Senior Data Architect / Engineer

    Crazy SolutionsPune, Maharashtra, India
    Senior Data Architect / Engineer.Role : Senior Data Engineer / Architect Location : Chennai / Pune Company : Sunware Technologies Private Limited Position Overview : We are hiring an experienced Senior D...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Big Data Engineer

    Big Data Engineer

    Hexaware TechnologiesPune, Maharashtra, India
    Hands on experience working in a public cloud environment and on-prem infrastructure.Specialty on Columnar Databases like. AWS cloud infrastructure services (Redshift, S3, Lambda).Experience with a ...Show moreLast updated: 12 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SailPointPune, Maharashtra, India
    SailPoint is the leader in identity security for the cloud enterprise.Our identity security solutions secure and enable thousands of companies worldwide, giving our customers unmatched visibility i...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer (Snowflake)

    Senior Data Engineer (Snowflake)

    Crazy SolutionsPune, Maharashtra, India
    Senior Data Engineer (Snowflake).Agivant is seeking a talented and passionate.In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-m...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Software Engineer (Big Data)

    Senior Software Engineer (Big Data)

    BPK Tech Services India Private LimitedPune, Maharashtra, India
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Big Data Lead

    Big Data Lead

    Populace World SolutionsPune, Maharashtra, India
    Reports To Product Engineering Head.We are looking to hire a talented big data engineer to develop and manage our companys Big Data solutions. In this role, you will be required to design and imple...Show moreLast updated: 12 hours ago