Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

MSBC GroupPune, Maharashtra, India
8 hours ago
Job description

As a Data Engineer, your primary role is to create and maintain high-performance data pipelines, warehouses, and cloud-based systems. This includes creating efficient batch and streaming pipelines, using Snowflake for scalable data warehousing, and leveraging AWS for cloud development. You will work with an agile team to ensure the reliability and accuracy of data applications through rigorous testing. In addition, you will contribute to documentation and stay current on upcoming technologies in order to promote continuous development.

Role Responsibilities

  • As a Data Engineer, you will be responsible for a range of duties related to the development and maintenance of data pipelines, data warehouses, and cloud-based systems. Some of the key job duties are :
  • Building performant batch and streaming data pipelines : You will be responsible for designing and building efficient data pipelines that can handle large volumes of data, both in batch and real-time formats
  • Data warehouse development, using Snowflake to build scalable and reliable data warehousing solutions
  • Cloud-based development using Amazon Web Services (AWS) to build scalable and reliable systems
  • Maintenance of various data applications, pipelines, and databases
  • You will be part of an agile development team, participating in daily stand-ups and other team meetings to collaborate and coordinate on development efforts
  • Writing and executing various types of tests to ensure the quality, accuracy, and reliability of the data pipelines and data applications that you develop
  • Contributing to documentation and best practice guidelines
  • Staying up-to-date with new technology and techniques

Skills & Requirements

  • Experience working with Python and SQL
  • Snowflake, Kubernetes, Amazon Web Services (AWS) and Airflow experience is desirable
  • Experience in BI tools like ThoughtSpot, Power BI would be beneficial.
  • Able to write clean, scalable and performant code
  • Some knowledge of Linux and the command line
  • Strong written and verbal communication skills including an ability to effectively communicate with both business and technical teams
  • Basic knowledge of data science topics like machine learning, data mining, statistics, and visualisation
  • Note

    This role follows UK shift timings and is based in Ahmedabad. Candidates from other locations can apply, as remote and hybrid work options are available.

    About us

    With over 20 years of experience, MSBC Group delivers cutting-edge technology solutions across industries like financial services, manufacturing, logistics, and startups. Our expertise spans AI, custom software, staff augmentation, and managed services. Operating globally, we drive innovation in trading platforms, application migrations, and real-time analytics, making us a trusted AI and automation partner.

    Create a job alert for this search

    Senior Data Engineer • Pune, Maharashtra, India

    Related jobs
    • Promoted
    Big Data Developer

    Big Data Developer

    USTPune, Maharashtra, India
    The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show moreLast updated: 18 days ago
    • Promoted
    Qualys - Big Data Engineer / Lead

    Qualys - Big Data Engineer / Lead

    QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
    About the job : Come work at a place where innovation and teamwork come together to support the most exciting missions in the world! Job...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    ImpetusPune, Maharashtra, India
    Year of Experience - 1 to 3 years.Location - Indore, Pune, Noida, Hyderabad, Bangalore, Gurugram.Strong ability to write clean and efficient code. Good understanding of Spark SQL for distributed dat...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect - GCP

    Data Architect - GCP

    Pixeldust TechnologiesPune, Maharashtra, India
    We are seeking a highly skilled Data Architect - GCP with 6–8 years of experience in designing, developing, and managing enterprise data solutions on Google Cloud Platform (GCP) along with Data Gov...Show moreLast updated: 30+ days ago
    • Promoted
    LIMS Master Data Specialist

    LIMS Master Data Specialist

    Systems PlusPune, Maharashtra, India
    SystemsPlus is hiring for LIMS Master Data Specialist.What You’ll Do As a LIMS Master Data Specialist you will : .Review source documentation for master data objects such as laboratory methods and an...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    WorkiFicientPune
    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy ServicesPune, Maharashtra, India
    Years of Experience : 6 - 8 years.Location : Pune / Mumbai / Chennai.Exposure in data ingestion from disparate sources onto Big Data platform.Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    SAP Master data Specialist

    SAP Master data Specialist

    IT Services & ConsultingPune, Maharashtra, India
    SAP Expert / Master Data Specialist.SAP S / 4HANA Cloud MDG (Master Data Governance).Master Data across complex, global environments. The ideal candidate will have successfully delivered.Lead and supp...Show moreLast updated: 8 hours ago
    • Promoted
    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Tata Consultancy ServicesPune, Maharashtra, India
    Job Title : Bigdata Developer Relevant Experience (in Yrs) : 4+ Location : Hyderabad, Pune, Chennai, Bangalore, Noida Technical / Functional Skills Must Have Experience in : 1.Hands on experience ...Show moreLast updated: 30+ days ago
    • Promoted
    Reveille Technologies - Big Data Engineer

    Reveille Technologies - Big Data Engineer

    Reveille TechnologiesPune
    Description : We are looking for highly skilled and motivated Big Data Engineers / Leads to join our team and drive the development of our next-generation data plat...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    SAP Consultant

    SAP Consultant

    Automatic Infotechbibvewadi, maharashtra, in
    SAP PP Certification / Training is.SAP PP module (through projects, training, or internship).Basic understanding of SAP PP processes such as Material Requirement Planning , Bill of Materials Manage...Show moreLast updated: 9 hours ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITEDPune
    Job Description : We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediate...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticspune, maharashtra, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineering Role

    Data Engineering Role

    100x.incpune, maharashtra, in
    At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 10 days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    Leinex ConsultingPune
    Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders < / p&...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Servicespune, maharashtra, in
    Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 9 hours ago
    • Promoted
    Data Architect

    Data Architect

    Mindfire SolutionsPune, IN
    We are seeking a highly skilled and strategic Data Architect to design, develop, and manage the organisation’s data architecture. The ideal candidate will ensure that data assets are structured, int...Show moreLast updated: 10 days ago
    • Promoted
    Master Data Management

    Master Data Management

    Persistent SystemsPune, Maharashtra, India
    We are seeking a highly skilled professional to define, establish, and manage governance processes around Master Data Management (MDM) for Accounts and related systems of record.Role : Master Data M...Show moreLast updated: 15 days ago
    • Promoted
    Qualys - Senior Big Data Engineer

    Qualys - Senior Big Data Engineer

    QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
    Description : We are seeking a talented Sr.Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Commun...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    4Bell TechnologyPune
    Job Description : Core Responsibilities : - Design, build, and maintain robust d...Show moreLast updated: 30+ days ago