Talent.com
Data Pipeline and Workflow Automation Engineer
Data Pipeline and Workflow Automation EngineerPhi Partners • Republic Of India, IN
Data Pipeline and Workflow Automation Engineer

Data Pipeline and Workflow Automation Engineer

Phi Partners • Republic Of India, IN
5 days ago
Job description

About the Company : Phi Partners is a global capital markets technology consultancy, offering a range of services, technology solutions, and advisory support to investment banks, hedge funds, and asset managers. Since its founding in 2004, Phi has expanded its presence worldwide, with headquarters in London and offices across North America, EMEA, and APAC. Our specialisation in Front Office, Cloud and Risk and Data Analytics Technologies applied to capital markets has been a gateway into the world’s renowned financial institutions. Our ability to provide end to end solutions, from strategy development to technology implementation and ongoing support helps us provide tailored solutions that meet client’s unique needs.

About the Role : Phi Partners is supporting one of our major clients. With a strong emphasis on data and AI-driven insights, they are investing heavily in the Palantir Foundry ecosystem and Palantir’s Artificial Intelligence Platform (AIP) to unlock new efficiencies and decision-making capabilities. The programme focuses on designing, building, and operationalising AI-powered workflows, agents, and applications that are deeply integrated into critical business domains. These solutions will leverage retrieval-augmented generation (RAG), ontology-augmented generation (OAG), and advanced data engineering pipelines to transform how the fund captures, processes, and uses information at scale. Backed by strong sponsorship from senior stakeholders, the Foundry and AIP platforms are central to the fund’s ambition to drive innovation, efficiency, and competitive advantage.

Responsibilities :

  • Design, build, and maintain scalable data pipelines, transformations, and applications within the Palantir Foundry ecosystem.
  • Develop and operationalise AI-powered workflows, copilots, and decision-support agents using Palantir AIP.
  • Implement retrieval-augmented generation (RAG) and ontology-augmented generation (OAG) to connect agents to data sources, ontologies, and business logic.
  • Partner with stakeholders to gather requirements, translate business needs into technical solutions, and deliver production-ready applications.
  • Collaborate with senior engineers on the design, configuration, and evaluation of AIP agents and logic flows.
  • Provide guidance, training, and support to business users adopting Foundry and AIP applications.
  • Ensure solutions meet data governance, quality, and responsible AI standards.
  • Continuously identify opportunities to improve workflow automation and expand AIP adoption across business areas.

Qualifications :

  • Professional experience within the Palantir Foundry ecosystem (data integration, ontology, pipelines, applications).
  • Must have practical experience working with Palantir AIP features such as RAG workflows, copilots, or agent-based applications.
  • Strong technical proficiency in Python, PySpark, SQL, and data modelling.
  • Ability to work independently while engaging directly with stakeholders and business users.
  • Strong problem-solving mindset with ownership of delivery.
  • Required Skills :

  • Professional experience within the Palantir Foundry ecosystem (data integration, ontology, pipelines, applications).
  • Strong technical proficiency in Python, PySpark, SQL, and data modelling.
  • Practical experience working with Palantir AIP features such as RAG workflows, copilots, or agent-based applications.
  • Ability to work independently while engaging directly with stakeholders and business users.
  • Strong problem-solving mindset with ownership of delivery.
  • Preferred Skills :

  • Familiarity with AIP Agent Studio concepts (agents, instructions, tools, testing).
  • Exposure to AIP Evals and test-driven evaluation approaches.
  • Experience with integration patterns (APIs, MCP, cloud services).
  • Background in consulting or applied AI / ML projects.
  • This is a fantastic opportunity for a talented individual to join a leading capital markets technology consultancy and work on a pivotal project. The successful candidate will have the opportunity to deliver high-impact data and AI solutions using Palantir Foundry and AIP.

    Create a job alert for this search

    Data Pipeline Engineer • Republic Of India, IN

    Related jobs
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    HNR Tech • Republic Of India, IN
    We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show more
    Last updated: 5 days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    MyData Insights Pvt Ltd • Republic Of India, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 5 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Vriba Solutions • Republic Of India, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    EXL • Chennai, Republic Of India, IN
    Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead the data validation...Show more
    Last updated: 2 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Tata Consultancy Services • Chennai, Republic Of India, IN
    Pyspark and Azure Synapse Analytics / Azure Databricks.Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.Good experience in SQL or...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    EXL • Pune, Republic Of India, IN
    We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Workflow Automation Engineer

    Senior Data Workflow Automation Engineer

    AIMLEAP • Republic Of India, IN
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 2 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Luxoft • Chennai, Republic Of India, IN
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 1 day ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    UST • Pune, Republic Of India, IN
    The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Eucloid Data Solutions • Chennai, Republic Of India, IN
    Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    airtel • Pune, Republic Of India, IN
    Big Data Developer (Senior Manager).We are seeking a highly skilled.The ideal candidate will have extensive experience in building and leading end-to-end big data pipelines, with deep expertise in ...Show more
    Last updated: 22 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    EXL • Pune, Republic Of India, IN
    DWH / ETL Developer : Strong experience in ETL development and data warehousing (SQL, Informatica).Responsibilities for Candidates. Design, develop, and maintain ETL workflows ( Informatica ).Optimize ...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Pipeline Engineer

    Azure Data Pipeline Engineer

    EXL • Pune, Republic Of India, IN
    Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more
    Last updated: 7 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    HCLTech • Pune, Republic Of India, IN
    We’re Expanding Our Digital & Data Talent Pool.Are you a professional ready to take on enterprise-scale transformation journey? We are on a mass hiring drive and looking for experts who can bring i...Show more
    Last updated: 5 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    MakeMyTrip • Republic Of India, IN
    At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
    Last updated: 22 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Yubi • Republic Of India, IN
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    System Soft Technologies • Republic Of India, IN
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    SGS & Co • Chennai, Republic Of India, IN
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more
    Last updated: 22 days ago • Promoted