Talent.com
Senior DataOps Engineer (AWS)

Senior DataOps Engineer (AWS)

MSBC GroupKanpur, IN
13 hours ago
Job description

Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, build, and optimize AWS-native ingestion and enrichment of high-volume communications (Bloomberg, ICE, LSEG / Refinitiv, Symphony, etc.). Ensure robust retention, security, and data integrity, and deliver reliable, analytics- and AI-ready datasets for downstream platforms.

Role Responsibilities :

  • Build AWS infrastructure using Terraform or CDK
  • Develop, maintain, test and optimize data pipelines and workflows between the source data points and target destinations.
  • Implement data management and governance frameworks to ensure compliance with regulatory and legal requirements, and security protocols.
  • Collaborate with other team members such as the Project Manager and Business Analysts to identify and address risks and challenges in real time.
  • Write unit, integration, and infrastructure tests
  • Monitor, troubleshoot and resolve issues.
  • Automate the data pipeline where possible to reduce manual risk and improve efficiency.
  • Work closely with stakeholders and subject matter experts to ensure success criterion and definition of done is met.
  • Stay updated on industry trends and emerging tech to ensure continuous improvement.

Experience / Competences

Essential :

  • 10+ years of hands-on AWS development and infrastructure experience with a financial services background.
  • Proficiency in programming Python and / or Java.
  • Proficient with Terraform or CDK (infrastructure-as-code).
  • Experience with EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, and Transfer Family.
  • Solid understanding of CI / CD pipelines, ideally with a background in software engineering, product management or data analytics.
  • Experience with market data ingestion, metadata extraction, and event-driven architectures.
  • Experience in Business Communications Technology e.g. Bloomberg, ICE, Symphony, Teams Chat, etc.
  • Familiarity with security best practices, IAM, and VPN configuration.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or related field.
  • Strong communication and collaboration skills to engage with technical and non-technical stakeholders.
  • Strong experience with Agile software delivery and proven ability to take initiative.
  • Passionate about data and being the best in class.
  • Desired :

  • Experience with regulatory compliance and data security in financial services.
  • Familiarity with Alation, Snowflake, or other analytics platforms
  • Knowledge of financial markets and trading platforms.
  • Certifications in DataOps, cloud platforms, or related areas.
  • MSBC Group has been a trusted technology partner for over 20 years, delivering the latest systems and software solutions for financial services, manufacturing, logistics, construction, and startup ecosystems. Our expertise includes Accessible AI, Custom Software Solutions, Staff Augmentation, Managed Services, and Business Process Outsourcing.

    We are at the forefront of developing advanced AI-enabled services and supporting transformative projects, such as state-of-the-art trading platforms, seamless application migrations, and integrating real-time data analytics. With offices in London, California, and Ahmedabad, and operating in every time-zone, MSBC Group is your AI and automation partner.

    Create a job alert for this search

    Engineer Aws • Kanpur, IN

    Related jobs
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    FornaxKanpur, IN
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 11 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKanpur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Engineer

    AWS Engineer

    Spryc SystemsKanpur, IN
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 16 days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersKanpur, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 2 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Serviceskanpur, uttar pradesh, in
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show moreLast updated: 25 days ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    ProgliteKanpur, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdKanpur, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Adaptive Technology InsightsKanpur, IN
    We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show moreLast updated: 12 hours ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Kanpur, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European CareersKanpur, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Senior DevOps Engineer

    Senior DevOps Engineer

    Amura Healthkanpur, uttar pradesh, in
    We are seeking a highly skilled.AWS cloud infrastructure, automation, and modern DevOps practices.You will be responsible for architecting, implementing, and optimizing scalable, secure, and cost-e...Show moreLast updated: 6 hours ago
    • Promoted
    Lead Engineer

    Lead Engineer

    HyqooKanpur, IN
    Design, deploy, and manage AWS cloud infrastructure, including EC2 instances, S3 buckets, VPCs, RDS databases, and Lambda functions. Assist in the design, implementation, and maintenance of backup, ...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    TEKsystems Global Services in IndiaKanpur, IN
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    People Prime WorldwideKanpur, IN
    Important Note (Please Read Before Applying).You have less than 8 years or more than 10 years of total experience.You do NOT have strong Python + AWS Data Engineering experience.You are NOT hands-o...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    AWS devops engineer

    AWS devops engineer

    techifyappskanpur, uttar pradesh, in
    We are looking for a skilled AWS DevOps Engineer to join our growing engineering team.The ideal candidate should have strong hands-on experience in designing CI / CD pipelines, containerized deployme...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    AWS data engineer

    AWS data engineer

    Tata Consultancy ServicesKanpur, IN
    TCS is looking for AWS data engineer.Location : Kolkata, Hyderabad, Bangalore, Chennai, Pune, Gurgaon.Strong hands-on experience with AWS Data Services : . Amazon S3, Glue, Redshift, Athena, Kinesis, E...Show moreLast updated: 12 hours ago
    • Promoted
    Senior Kubernetes Platform Engineer

    Senior Kubernetes Platform Engineer

    People Prime WorldwideKanpur, IN
    Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide.Our Engineering First approach ensures we can execute all ideas and creatively ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AWS Developer

    AWS Developer

    InfosysKanpur, IN
    A day in the life of an Infoscion,.As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our cl...Show moreLast updated: 13 hours ago