Talent.com
Senior Data Infrastructure Engineer
Senior Data Infrastructure EngineerMSBC Group • Ahmedabad, Republic Of India, IN
Senior Data Infrastructure Engineer

Senior Data Infrastructure Engineer

MSBC Group • Ahmedabad, Republic Of India, IN
6 days ago
Job description

Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, build, and optimize AWS-native ingestion and enrichment of high-volume communications (Bloomberg, ICE, LSEG / Refinitiv, Symphony, etc.). Ensure robust retention, security, and data integrity, and deliver reliable, analytics- and AI-ready datasets for downstream platforms.

Role Responsibilities :

  • Build AWS infrastructure using Terraform or CDK
  • Develop, maintain, test and optimize data pipelines and workflows between the source data points and target destinations.
  • Implement data management and governance frameworks to ensure compliance with regulatory and legal requirements, and security protocols.
  • Collaborate with other team members such as the Project Manager and Business Analysts to identify and address risks and challenges in real time.
  • Write unit, integration, and infrastructure tests
  • Monitor, troubleshoot and resolve issues.
  • Automate the data pipeline where possible to reduce manual risk and improve efficiency.
  • Work closely with stakeholders and subject matter experts to ensure success criterion and definition of done is met.
  • Stay updated on industry trends and emerging tech to ensure continuous improvement.

Experience / Competences

Essential :

  • 10+ years of hands-on AWS development and infrastructure experience with a financial services background.
  • Proficiency in programming Python and / or Java.
  • Proficient with Terraform or CDK (infrastructure-as-code).
  • Experience with EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, and Transfer Family.
  • Solid understanding of CI / CD pipelines, ideally with a background in software engineering, product management or data analytics.
  • Experience with market data ingestion, metadata extraction, and event-driven architectures.
  • Experience in Business Communications Technology e.G. Bloomberg, ICE, Symphony, Teams Chat, etc.
  • Familiarity with security best practices, IAM, and VPN configuration.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or related field.
  • Strong communication and collaboration skills to engage with technical and non-technical stakeholders.
  • Strong experience with Agile software delivery and proven ability to take initiative.
  • Passionate about data and being the best in class.
  • Desired :

  • Experience with regulatory compliance and data security in financial services.
  • Familiarity with Alation, Snowflake, or other analytics platforms
  • Knowledge of financial markets and trading platforms.
  • Certifications in DataOps, cloud platforms, or related areas.
  • MSBC Group has been a trusted technology partner for over 20 years, delivering the latest systems and software solutions for financial services, manufacturing, logistics, construction, and startup ecosystems. Our expertise includes Accessible AI, Custom Software Solutions, Staff Augmentation, Managed Services, and Business Process Outsourcing.

    We are at the forefront of developing advanced AI-enabled services and supporting transformative projects, such as state-of-the-art trading platforms, seamless application migrations, and integrating real-time data analytics. With offices in London, California, and Ahmedabad, and operating in every time-zone, MSBC Group is your AI and automation partner.

    Create a job alert for this search

    Senior Data Engineer • Ahmedabad, Republic Of India, IN

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Ahmedabad, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 14 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Ahmedabad, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    HNR Tech • Ahmedabad, IN
    We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show more
    Last updated: 16 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Ahmedabad, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 9 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Ahmedabad, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 9 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Ahmedabad, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Ahmedabad, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Ahmedabad, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Senior DataOps Engineer (AWS)

    Senior DataOps Engineer (AWS)

    MSBC Group • Ahmedabad, Gujarat, India
    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    Analytix Business Solutions (India) Pvt. Ltd. • Ahmedabad, Gujarat, India
    Businesses of all sizes are faced with a rapidly changing competitive environment.Companies that possess both the ability to successfully navigate obstacles and the agility to react to market condi...Show more
    Last updated: 10 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Ahmedabad, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Arenema • Ahmedabad, IN
    India (remote – Bangalore / Karnataka area preferred).Full-time contractor / employee.You will be a core member of the team building a data platform that maps economic, advertising and real-estate ac...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek Consulting • Ahmedabad, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show more
    Last updated: 9 days ago • Promoted
    Senior Data Engineer (AWS / GCP)

    Senior Data Engineer (AWS / GCP)

    Armakuni • Ahmedabad, Gujarat, India
    We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Ahmedabad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • Ahmedabad, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 9 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Advantmed • Ahmedabad, Gujarat, India
    Lead Data Engineer – Azure Cloud.We are looking for an experienced.The ideal candidate will design, develop, and maintain scalable data pipelines, ensure data quality, and leverage cloud technologi...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Ahmedabad, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 15 days ago • Promoted