Talent.com
Senior DataOps Engineer (AWS)
Senior DataOps Engineer (AWS)MSBC Group • panchkula, India
No longer accepting applications
Senior DataOps Engineer (AWS)

Senior DataOps Engineer (AWS)

MSBC Group • panchkula, India
4 days ago
Job description

Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, build, and optimize AWS-native ingestion and enrichment of high-volume communications (Bloomberg, ICE, LSEG / Refinitiv, Symphony, etc.). Ensure robust retention, security, and data integrity, and deliver reliable, analytics- and AI-ready datasets for downstream platforms.

Role Responsibilities :

  • Build AWS infrastructure using Terraform or CDK
  • Develop, maintain, test and optimize data pipelines and workflows between the source data points and target destinations.
  • Implement data management and governance frameworks to ensure compliance with regulatory and legal requirements, and security protocols.
  • Collaborate with other team members such as the Project Manager and Business Analysts to identify and address risks and challenges in real time.
  • Write unit, integration, and infrastructure tests
  • Monitor, troubleshoot and resolve issues.
  • Automate the data pipeline where possible to reduce manual risk and improve efficiency.
  • Work closely with stakeholders and subject matter experts to ensure success criterion and definition of done is met.
  • Stay updated on industry trends and emerging tech to ensure continuous improvement.

Experience / Competences

Essential :

  • 10+ years of hands-on AWS development and infrastructure experience with a financial services background.
  • Proficiency in programming Python and / or Java.
  • Proficient with Terraform or CDK (infrastructure-as-code).
  • Experience with EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, and Transfer Family.
  • Solid understanding of CI / CD pipelines, ideally with a background in software engineering, product management or data analytics.
  • Experience with market data ingestion, metadata extraction, and event-driven architectures.
  • Experience in Business Communications Technology e.g. Bloomberg, ICE, Symphony, Teams Chat, etc.
  • Familiarity with security best practices, IAM, and VPN configuration.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or related field.
  • Strong communication and collaboration skills to engage with technical and non-technical stakeholders.
  • Strong experience with Agile software delivery and proven ability to take initiative.
  • Passionate about data and being the best in class.
  • Desired :

  • Experience with regulatory compliance and data security in financial services.
  • Familiarity with Alation, Snowflake, or other analytics platforms
  • Knowledge of financial markets and trading platforms.
  • Certifications in DataOps, cloud platforms, or related areas.
  • MSBC Group has been a trusted technology partner for over 20 years, delivering the latest systems and software solutions for financial services, manufacturing, logistics, construction, and startup ecosystems. Our expertise includes Accessible AI, Custom Software Solutions, Staff Augmentation, Managed Services, and Business Process Outsourcing.

    We are at the forefront of developing advanced AI-enabled services and supporting transformative projects, such as state-of-the-art trading platforms, seamless application migrations, and integrating real-time data analytics. With offices in London, California, and Ahmedabad, and operating in every time-zone, MSBC Group is your AI and automation partner.

    Create a job alert for this search

    Engineer Aws • panchkula, India

    Related jobs
    DevOps Engineer

    DevOps Engineer

    AptEdge • baddi, himachal pradesh, in
    AptEdge delivers Agentic Technical Support for B2B Enterprises.Our AI-powered Answer Engine, unlike traditional search engines, utilizes natural language processing to provide contextually relevant...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Co • panchkula, haryana, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more
    Last updated: 21 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellias • baddi, himachal pradesh, in
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 21 days ago • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inc • baddi, himachal pradesh, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more
    Last updated: 20 days ago • Promoted
    Senior CloudOps Engineer

    Senior CloudOps Engineer

    stackway • panchkula, haryana, in
    Senior CloudOps Engineer | REMOTE | Experience : Minimum 5+ Years.At stackway, we help international enterprise software companies hire exceptional software engineers in India.Our mission is to buil...Show more
    Last updated: 19 hours ago • Promoted • New!
    Azure Cloud Engineer

    Azure Cloud Engineer

    Talink • Chandigarh, India, India
    We are seeking a skilled and experienced Senior Azure Cloud Engineer to architect, implement, and maintain mission-critical Azure cloud infrastructure for strategic initiatives of our clients.This ...Show more
    Last updated: 11 days ago • Promoted
    Senior Devops Engineer

    Senior Devops Engineer

    Datavid • panchkula, haryana, in
    Datavid provides enterprise-ready software solutions designed to help businesses extract, enrich, and utilize their most valuable knowledge. Our focus is on delivering cutting-edge data engineering ...Show more
    Last updated: 5 days ago • Promoted
    Data Engineer AWS ( Full-time at a Fortune 500 tech MNC )

    Data Engineer AWS ( Full-time at a Fortune 500 tech MNC )

    HARP • baddi, himachal pradesh, in
    Kubernetes (Moderate level knowledge).Technical Skills – Nice to Have.Technical Skills – Ok to Train Later.Monitor the health status of applications using Datadog or similar monitoring tools.Check ...Show more
    Last updated: 13 days ago • Promoted
    Senior DevOps Engineer (SRE)

    Senior DevOps Engineer (SRE)

    MightyBot • panchkula, haryana, in
    Title : Senior DevOps Engineer (SRE).Join our team as a Senior DevOps Engineer, where we're focused on graduating AI from interesting demos to indispensable products. You will build and maintain the ...Show more
    Last updated: 11 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • panchkula, haryana, in
    TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services). Strong expertise in Azure Data Engineering & ETL Co...Show more
    Last updated: 30+ days ago • Promoted
    DevOps Engineer

    DevOps Engineer

    DBiz.ai • panchkula, haryana, in
    We are seeking a skilled Analyst - DevOps to join our team at DBiz AI Solutions Pvt.The ideal candidate will be responsible for implementing and managing DevOps practices, ensuring seamless integra...Show more
    Last updated: 4 days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • panchkula, haryana, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 19 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AI • baddi, himachal pradesh, in
    DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more
    Last updated: 1 day ago • Promoted
    Databricks Engineer

    Databricks Engineer

    DataE2E Technologies • baddi, himachal pradesh, in
    We are looking for an experienced.The ideal candidate has hands-on experience in Databricks production environments, along with. You will collaborate with cross-functional teams to create robust dat...Show more
    Last updated: 30+ days ago • Promoted
    DevOps Engineer

    DevOps Engineer

    CES • baddi, himachal pradesh, in
    We are seeking a highly skilled.Site Reliability Engineer (SRE) / DevOps Engineer.In this role, you will partner across engineering teams to enhance platform reliability, accelerate delivery, and e...Show more
    Last updated: 19 hours ago • Promoted • New!
    DevOps Engineer

    DevOps Engineer

    Staffingine LLC • panchkula, haryana, in
    We are looking for DevOps Engineers with strong hands-on experience in cloud infrastructure, automation, and CI / CD for microservices-based applications. In this role, you will design and manage clou...Show more
    Last updated: 1 day ago • Promoted
    Senior DevOps Engineer

    Senior DevOps Engineer

    Vidhema Technologies • baddi, himachal pradesh, in
    Notice Period : Immediate Joiners Preferred.Cloud Platforms : Proficiency in AWS’s compute, storage, and networking services. Infrastructure as Code (IaC) and Configuration Management : .IaC Tools : Expe...Show more
    Last updated: 18 days ago • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • panchkula, haryana, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 6 days ago • Promoted