Talent.com
Senior Data Engineer

Senior Data Engineer

MSBC GroupPune (district)
6 days ago
Job description

As a Data Engineer, your primary role is to create and maintain high-performance data pipelines, warehouses, and cloud-based systems. This includes creating efficient batch and streaming pipelines, using Snowflake for scalable data warehousing, and leveraging AWS for cloud development. You will work with an agile team to ensure the reliability and accuracy of data applications through rigorous testing. In addition, you will contribute to documentation and stay current on upcoming technologies in order to promote continuous development.

Role Responsibilities

  • As a Data Engineer, you will be responsible for a range of duties related to the development and maintenance of data pipelines, data warehouses, and cloud-based systems. Some of the key job duties are :
  • Building performant batch and streaming data pipelines : You will be responsible for designing and building efficient data pipelines that can handle large volumes of data, both in batch and real-time formats
  • Data warehouse development, using Snowflake to build scalable and reliable data warehousing solutions
  • Cloud-based development using Amazon Web Services (AWS) to build scalable and reliable systems
  • Maintenance of various data applications, pipelines, and databases
  • You will be part of an agile development team, participating in daily stand-ups and other team meetings to collaborate and coordinate on development efforts
  • Writing and executing various types of tests to ensure the quality, accuracy, and reliability of the data pipelines and data applications that you develop
  • Contributing to documentation and best practice guidelines
  • Staying up-to-date with new technology and techniques

Skills & Requirements

  • Experience working with Python and SQL
  • Snowflake, Kubernetes, Amazon Web Services (AWS) and Airflow experience is desirable
  • Experience in BI tools like ThoughtSpot, Power BI would be beneficial.
  • Able to write clean, scalable and performant code
  • Some knowledge of Linux and the command line
  • Strong written and verbal communication skills including an ability to effectively communicate with both business and technical teams
  • Basic knowledge of data science topics like machine learning, data mining, statistics, and visualisation
  • Note

    This role follows UK shift timings and is based in Ahmedabad. Candidates from other locations can apply, as remote and hybrid work options are available.

    About us

    With over 20 years of experience, MSBC Group delivers cutting-edge technology solutions across industries like financial services, manufacturing, logistics, and startups. Our expertise spans AI, custom software, staff augmentation, and managed services. Operating globally, we drive innovation in trading platforms, application migrations, and real-time analytics, making us a trusted AI and automation partner.

    Create a job alert for this search

    Senior Data Engineer • Pune (district)

    Related jobs
    • Promoted
    Senior Big Data Engineer - PySpark / Scala

    Senior Big Data Engineer - PySpark / Scala

    Consulting PanditsPune
    Exciting Job Opportunity in Pune! Are you an experienced Senior Big Data Engineer with over 5 years of expertise? We have a fantastic opportunity waiting for you!<...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Information TechnologyPune
    Big Data Engineer Key Responsibilities : - Build and manage highly scalable Big Data pipelines for large structured datasets.C...Show moreLast updated: 30+ days ago
    • Promoted
    Accion Labs - Senior Data Architect - Generative AI

    Accion Labs - Senior Data Architect - Generative AI

    ACCION TECHNOLOGIES PRIVATE LIMITEDPune
    Job Title : Senior Data Architect - GenAI, Snowflake & Azure Experience : 10+ Years Job Type : Full-time based &l...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    [15h Left] Data Architect

    [15h Left] Data Architect

    Persistent SystemsPune, Maharashtra, India
    About Position : We are seeking a highly skilled and experienced Azure Databricks Architect to lead the design, development, and implementation of scalable data solutions using Azure Databricks.Thi...Show moreLast updated: 9 hours ago
    • Promoted
    Data Architect - Google Cloud Platform

    Data Architect - Google Cloud Platform

    HyrEzy Talent SolutionsPune
    Position : GCP Data : 8-15 Years Budget : 20-35 LPA Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Tata Consultancy ServicesPune, Maharashtra, India
    Relevant Experience (in Yrs) : .Hyderabad, Pune, Chennai, Bangalore, Noida.Technical / Functional Skills Must Have Experience in : . Hands on experience in Spark, Scala and Pyspark.Should be proficient i...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    WorkiFicientPune
    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and...Show moreLast updated: 30+ days ago
    • Promoted
    Reveille Technologies - Big Data Engineer

    Reveille Technologies - Big Data Engineer

    Reveille TechnologiesPune
    Description : We are looking for highly skilled and motivated Big Data Engineers / Leads to join our team and drive the development of our next-generation data plat...Show moreLast updated: 28 days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    AaysPune, IN
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Architect

    Azure Data Architect

    Programmers.ioPune, Maharashtra, India
    Job Description : Job Title : Azure Data Architect Location : Hyderabad, pune (hybrid) Experience required : 12+ years Role Overview : We are seeking a highly experienced S enior Azure data architect ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Architect - Spark / Hadoop

    Big Data Architect - Spark / Hadoop

    Consulting PanditsPune
    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    Persistent SystemsPune, Maharashtra, India
    About Position : We are seeking a highly skilled and experienced Azure Databricks Architect to lead the design, development, and implementation of scalable data solutions using Azure Databricks.Thi...Show moreLast updated: 17 days ago
    • Promoted
    Softpath Technologies - Senior Big Data Engineer - Hive & Unix Scripting

    Softpath Technologies - Senior Big Data Engineer - Hive & Unix Scripting

    Softpath Technologies LLCPune
    Description : Job Title : Senior Big Data Engineer Hive & Unix Scripting Location : P...Show moreLast updated: 4 days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    Leinex ConsultingPune
    Role & responsibilities : - Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders < / p&...Show moreLast updated: 30+ days ago
    • Promoted
    airisData - Microstrategy Engineer - SQL / Linux

    airisData - Microstrategy Engineer - SQL / Linux

    Airis data India Private LimitedPune
    Job Description : We are seeking a seasoned MicroStrategy Engineer with over 4 years of experience in data and reporting technologies to jo...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Big Data Engineer - Spark

    Lead Big Data Engineer - Spark

    QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune
    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.Description : We are seeking a talented Lead Big ...Show moreLast updated: 30+ days ago
    • Promoted
    Oracle AGIS Implementation Specialist

    Oracle AGIS Implementation Specialist

    Jade GlobalPune,Hyderabad
    Role Overview : We are seeking an experienced Oracle Finance techno-functional consultant to lead the implementation of Oracle Advanced Global Intercompany Sy...Show moreLast updated: 30+ days ago
    • Promoted
    Fabric Platform Data Architect (Remote)

    Fabric Platform Data Architect (Remote)

    Thinkgrid LabsPune, IN
    Remote
    Thinkgrid Labs is at the forefront of innovation and technology.Our expert team of software engineers, architects, and UI / UX designers specialises in crafting bespoke web, mobile, cloud application...Show moreLast updated: 30+ days ago