Talent.com
Lead Data Pipeline Engineer

Lead Data Pipeline Engineer

IndsafriRepublic Of India, IN
25 days ago
Job description

Job Title - Senior Data Integration Engineer

Experience - 6+Years

Job Summary

We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intelligence ecosystem. In this critical role, you will be the subject matter expert responsible for designing and implementing robust integrations between our core platforms : Salesforce Data Cloud, Databricks, and MuleSoft.

You will be responsible for creating a seamless flow of data, enabling advanced analytics, and empowering our business to activate real-time customer insights. The ideal candidate is a hands-on expert who can translate complex business requirements into scalable, secure, and high-performance technical solutions.

Key Responsibilities

  • Architect Integration Solutions : Lead the design and architecture of data integration patterns and end-to-end data flows between source systems, MuleSoft, Databricks, and Salesforce Data Cloud.
  • Develop MuleSoft APIs : Design, develop, and deploy reusable, API-led integration solutions using MuleSoft's Anypoint Platform to ingest data into the ecosystem and to syndicate data to downstream systems.
  • Build Advanced Data Pipelines in Databricks : Implement complex data transformation, cleansing, and enrichment pipelines using PySpark and SQL within the Databricks Lakehouse Platform. Prepare and model data for ingestion into Salesforce Data Cloud and for advanced analytics use cases.
  • Master Salesforce Data Cloud : Configure and manage Salesforce Data Cloud, including setting up data streams, performing data mapping and harmonization, defining identity resolution rules, and creating insightful calculated metrics.
  • Enable Data Activation : Collaborate with marketing, sales, and service teams to build and activate complex audience segments from Salesforce Data Cloud for use in personalization and campaign execution.
  • Ensure Governance and Performance : Implement data quality checks, error handling, and performance monitoring across all platforms. Ensure solutions adhere to data governance policies, security standards, and privacy regulations.
  • Mentorship and Best Practices : Act as a senior technical resource for the team, establishing best practices for integration and data engineering. Provide guidance and mentorship to junior team members.
  • Stakeholder Collaboration : Work closely with business analysts, data scientists, and platform owners to gather requirements and deliver solutions that provide tangible business value.

Required Skills & Experience

  • 6+ years of professional experience in a data engineering, integration development, or data architecture role.
  • Proven hands-on experience with MuleSoft : Demonstrable expertise in designing, building, and managing APIs using the Anypoint Platform (API-led connectivity, DataWeave, connectors).
  • Strong proficiency in Databricks : Hands-on experience developing data pipelines using PySpark , SQL, Delta Lake, and job orchestration.
  • Demonstrable experience with Salesforce Data Cloud : In-depth knowledge of its data model, ingestion methods (Connectors, Ingestion API), identity resolution, segmentation, and activation capabilities.
  • Expert SQL & Python Skills : Ability to write complex, efficient SQL queries and Python code for data manipulation and automation.
  • Solid understanding of data modeling principles and experience designing and working with ETL / ELT processes.
  • Experience working with major cloud platforms ( AWS, Azure, or GCP ).
  • Preferred Qualifications

  • Certifications :
  • Salesforce Data Cloud Consultant
  • MuleSoft Certified Developer / Architect
  • Databricks Certified Data Engineer Professional
  • Experience with other Salesforce clouds (e.G., Marketing Cloud, Sales Cloud).
  • Knowledge of CI / CD and DevOps practices in a data context.
  • Familiarity with streaming data technologies (e.G., Kafka).
  • Company Description-

    Indsafri believes in the limitless potential of individuals to create and build anything imaginable. They leverage their deep industry experience and cutting-edge technology to help organizations transform for growth. They work with some of the best organizations around the world and have a global network of partners and talents. Indsafri believes that technology is at its best when it makes people smile. This is a place where with passion and intelligence, anything is possible.

    Interested candidates can reach out to sowjanya.dommaraju@indsafri.com

    Create a job alert for this search

    Data Pipeline Engineer • Republic Of India, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasNagpur, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 5 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsIndia, India
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneNagpur, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Intuition IT – Intuitive Technology RecruitmentNagpur, IN
    JD Role – SQL, SSIS, SSAS + Databricks or Snowflake – Should have more than 10-12 yrs of hands-on experience.Maintain, enhance, and support existing Microsoft. SQL Server, SSIS, and SSAS solutions.W...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    AIMLEAPIndia, India
    Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpressnagpur, maharashtra, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DraconXNagpur, IN
    DraconX specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises. As pioneers in AI business automation and SaaS platforms, we ex...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeNagpur, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.Nagpur, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 18 days ago
    • Promoted
    • New!
    Data Engineer – ETL & Pipeline Development (5 to 10 yrs)

    Data Engineer – ETL & Pipeline Development (5 to 10 yrs)

    AIMLEAPIndia, India
    Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL workflows — not just ...Show moreLast updated: less than 1 hour ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroNagpur, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyNagpur, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGNagpur, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 16 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantNagpur, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AINagpur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer – Azure & AWS

    Data Engineer – Azure & AWS

    Yoda TechNagpur, IN
    We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 14 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradNagpur, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 24 days ago
    • Promoted
    Data & Analytics Engineer

    Data & Analytics Engineer

    APPIT Software IncNagpur, IN
    Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience. Data Modelling & Data Warehouse -Mandatory -Hands...Show moreLast updated: 3 days ago