Talent.com
Data Pipeline Engineer

Data Pipeline Engineer

LuxoftRepublic Of India, IN
1 day ago
Job description

We are currently hiring for the position of Python Developer at DXC Technology, Mumbai. This role involves working closely with global teams in London and Hong Kong, contributing to high-impact projects within the Public Markets Technology space.

Location : Mumbai

Position : Python Developer

Experience : 5+ Years

Notice Period : 15-30 days

Key Responsibilities

PMWB / Cosmos

  • Provide operational support for Project Managers in London and Hong Kong for Order Entry and Position Management (EPM, SSG, AE).
  • Support future system expansion for LRA in London and Australia.

EPM Validator

  • Onboard, enhance, and maintain fund performance data for users in London and Hong Kong.
  • EPM Explorer

  • Manage NAV and performance loading configurations, including Python code and configuration updates.
  • Batch Operations

  • Support Cosmos and PMWB start-of-day (SOD) operations.
  • Handle EPM risk data and Data Fabric CMF pipelines.
  • Expand monitoring to anticipate abnormal run times and ensure smooth batch execution.
  • Support & Collaboration

  • Partner with London ARS-FICC and FCT teams to troubleshoot and resolve issues independently of the Toronto office.
  • Mandatory Skills

  • Bachelor’s degree in Engineering or Computer Science (preferred).
  • 5+ years of experience in software development.
  • Strong proficiency in Python – hands-on experience required.
  • Experience with Relational and Non-Relational Databases .
  • Proven experience developing applications on AWS (AWS certification preferred).
  • Exposure to Agile methodologies.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration skills.
  • Experience with production support , including :
  • Monitoring and maintaining data pipelines, APIs, and applications built using Python and AWS services (e.G., Lambda, Glue, EMR, Redshift, S3).
  • Identifying and resolving production issues such as failed jobs, broken pipelines, and performance bottlenecks.
  • Experience with incident management and troubleshooting , including :
  • Debugging Python scripts, Spark jobs, and AWS service issues.
  • Performing root cause analysis and implementing long-term fixes.
  • Managing on-call or escalation situations.
  • Nice-to-Have Skills

  • Experience with Java .
  • Capital Markets domain experience (knowledge of financial products and derivatives).
  • Prior exposure to Public Markets Technology .
  • Create a job alert for this search

    Data Pipeline Engineer • Republic Of India, IN

    Related jobs
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsIndia, India
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneNagpur, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeIndia, India
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    CozzeraNagpur, IN
    Senior Data Engineer – AI / ML & Cloud.Hybrid (1–2 days / week at any location – Noida, Gurgaon, Pune, Chennai, Bangalore, Hyderabad). We are looking for a highly skilled.AI / ML and cloud data ecosystems...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsnagpur, maharashtra, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    AIMLEAPIndia, India
    Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 3 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.Nagpur, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladenagpur, maharashtra, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsnagpur, maharashtra, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Servicesnagpur, maharashtra, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroNagpur, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyNagpur, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantNagpur, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indianagpur, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    ClearDemandNagpur, IN
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 3 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell ResourcesNagpur, IN
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 2 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradNagpur, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalNagpur, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago