Talent.com
No longer accepting applications
Senior Dataops Engineer

Senior Dataops Engineer

MSBC GroupSāngli, Republic Of India, IN
23 hours ago
Job description

Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, build, and optimize AWS-native ingestion and enrichment of high-volume communications (Bloomberg, ICE, LSEG / Refinitiv, Symphony, etc.). Ensure robust retention, security, and data integrity, and deliver reliable, analytics- and AI-ready datasets for downstream platforms.

Role Responsibilities :

  • Build AWS infrastructure using Terraform or CDK
  • Develop, maintain, test and optimize data pipelines and workflows between the source data points and target destinations.
  • Implement data management and governance frameworks to ensure compliance with regulatory and legal requirements, and security protocols.
  • Collaborate with other team members such as the Project Manager and Business Analysts to identify and address risks and challenges in real time.
  • Write unit, integration, and infrastructure tests
  • Monitor, troubleshoot and resolve issues.
  • Automate the data pipeline where possible to reduce manual risk and improve efficiency.
  • Work closely with stakeholders and subject matter experts to ensure success criterion and definition of done is met.
  • Stay updated on industry trends and emerging tech to ensure continuous improvement.

Experience / Competences

Essential :

  • 10+ years of hands-on AWS development and infrastructure experience with a financial services background.
  • Proficiency in programming Python and / or Java.
  • Proficient with Terraform or CDK (infrastructure-as-code).
  • Experience with EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, and Transfer Family.
  • Solid understanding of CI / CD pipelines, ideally with a background in software engineering, product management or data analytics.
  • Experience with market data ingestion, metadata extraction, and event-driven architectures.
  • Experience in Business Communications Technology e.G. Bloomberg, ICE, Symphony, Teams Chat, etc.
  • Familiarity with security best practices, IAM, and VPN configuration.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or related field.
  • Strong communication and collaboration skills to engage with technical and non-technical stakeholders.
  • Strong experience with Agile software delivery and proven ability to take initiative.
  • Passionate about data and being the best in class.
  • Desired :

  • Experience with regulatory compliance and data security in financial services.
  • Familiarity with Alation, Snowflake, or other analytics platforms
  • Knowledge of financial markets and trading platforms.
  • Certifications in DataOps, cloud platforms, or related areas.
  • MSBC Group has been a trusted technology partner for over 20 years, delivering the latest systems and software solutions for financial services, manufacturing, logistics, construction, and startup ecosystems. Our expertise includes Accessible AI, Custom Software Solutions, Staff Augmentation, Managed Services, and Business Process Outsourcing.

    We are at the forefront of developing advanced AI-enabled services and supporting transformative projects, such as state-of-the-art trading platforms, seamless application migrations, and integrating real-time data analytics. With offices in London, California, and Ahmedabad, and operating in every time-zone, MSBC Group is your AI and automation partner.

    Create a job alert for this search

    Senior Engineer • Sāngli, Republic Of India, IN

    Related jobs
    • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeansKolhapur, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdKolhapur, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Amicon Hub Serviceskolhapur, maharashtra, in
    Required Skills & Qualifications.Delta Lake, Spark, PySpark, SQL).SQL Server, MongoDB, InfluxDB).Kafka, Azure Event Hubs, or similar). Excellent problem-solving skills and the ability to work in a f...Show moreLast updated: 30+ days ago
    • Promoted
    Senior DevOps & Database Reliability Engineer – 100% Remote

    Senior DevOps & Database Reliability Engineer – 100% Remote

    Hyly.AIKolhapur, IN
    Remote
    AI, we’re building the first AI + Data Fabric for the multifamily industry, transforming how clients manage, secure, and scale their marketing and operational data. As the industry moves toward a co...Show moreLast updated: 9 days ago
    • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek ConsultingKolhapur, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 3 days ago
    • Promoted
    Senior Devops Engineer

    Senior Devops Engineer

    Datavidsangli, maharashtra, in
    Datavid provides enterprise-ready software solutions designed to help businesses extract, enrich, and utilize their most valuable knowledge. Our focus is on delivering cutting-edge data engineering ...Show moreLast updated: 2 days ago
    • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Incsangli, maharashtra, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKolhapur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European CareersKolhapur, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 1 day ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC GroupKolhapur, IN
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneKolhapur, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroKolhapur, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Kolhapur, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior GenAI Engineer

    Senior GenAI Engineer

    Mitra AIKolhapur, IN
    AI System Design & Development : .Architect, develop, and deploy large-scale Generative AI, LLM-based systems, including intelligent agents and automation workflows. LLM Integration & Optimization : .In...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Data Engineer- Freelance

    Senior Data Engineer- Freelance

    Quapton AI SolutionsKolhapur, IN
    Quapton AI Solutions is an innovative tech startup dedicated to providing advanced IT services within the field of artificial intelligence. We aim to empower businesses with tailored AI-driven solut...Show moreLast updated: 4 hours ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersKolhapur, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlanceKolhapur, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiKolhapur, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 3 days ago