Talent.com
Founding Data Engineer

Founding Data Engineer

InSiteVersemangalore, India
1 day ago
Job description

Equity Only (No Monetary Compensation) | Pre-Seed Stage Startup

About Us

We are building a next-generation  AI-driven trading platform  that ingests massive streams of financial, alternative, and sentiment data and transforms them into actionable insights. Our mission is to combine  robust data engineering pipelines  with  Generative AI and advanced ML models  to democratize access to sophisticated trading strategies.

As part of our  founding technical team , you will play a crucial role in ensuring our platform's data backbone is reliable, scalable, and production-ready.

The Role

We are looking for a  Founding Data Pipeline Engineer  passionate about designing and building scalable data pipelines in the cloud. You will work closely with the  Founding Gen AI Engineer  to ensure clean, validated, and well-structured data is available for model training, inference, and strategy generation.

You will be hands-on with  custom Python development , running data ingestion and transformation jobs in  Azure Functions  and similar serverless / cloud-native environments. You will also architect and optimize  data storage and analytics pipelines,  leveraging  Azure OLAP services such as Kusto (KQL) and Data Lake, as well as Databricks.

What You’ll Do

Data Pipeline Development :

  • Design and implement scalable ingestion pipelines to handle high-volume, real-time, and batch data feeds.
  • Write  custom Python code  to run within Azure Function Apps for event-driven and scheduled ingestion tasks.
  • Integrate APIs, event streams, and unstructured data into unified pipelines.

Data Transformation & Storage : Implement preprocessing, validation, and enrichment logic to prepare datasets for AI / ML models.

  • Leverage  Azure Data Lake, Synapse Analytics, and Kusto (KQL)  for efficient querying, storage, and OLAP-style analytics.
  • Ensure data quality, consistency, and schema evolution in a fast-changing environment.
  • Collaboration with AI / ML : Partner with the  Founding Gen AI Engineer  to ensure AI-ready datasets (structured, time-series, textual, and alternative data).

  • Enable backtesting and live trading workflows by delivering low-latency, reliable data pipelines.
  • Operations & Observability :

  • Establish monitoring, alerting, and logging for all pipelines to ensure reliability.
  • Design pipelines that can adapt to  scaling needs, failure recovery, and cost efficiency  in the cloud.
  • Startup Contribution :

  • Take ownership of the  entire data lifecycle , from ingestion to OLAP.
  • Contribute to technical decisions and long-term architecture.
  • Operate in a  pre-funding, equity-only environment  with full ownership of outcomes.
  • What We’re Looking For

  • 5–8 years of experience  in  data engineering or pipeline development , with strong proficiency in  Python .
  • Hands-on experience building  serverless / cloud-native pipelines  (Azure Functions, AWS Lambda, or similar).
  • Strong expertise with  Azure Data stack  (Kusto / KQL, Synapse, Data Lake, Event Hubs, Data Factory).
  • Proven ability to design and manage  data ingestion, transformation, and storage pipelines  at scale.
  • Solid understanding of  batch vs. streaming data processing  and how to optimize for low-latency use cases.
  • Bonus : familiarity with  financial data structures or trading systems  (but not required).
  • Entrepreneurial, self-starter mindset with the ability to  deliver hands-on solutions in an early-stage startup .
  • Bring your own device / laptop - but need to sign up for strict Confidentiality / NDA / Non-Compete Agreements
  • Why Join Us

  • Be a  founding technical member , building the  data backbone  of a disruptive AI trading platform.
  • Collaborate closely with the  Founding Gen AI Engineer  to power cutting-edge ML models with high-quality data.
  • Work with modern,  cloud-native, and serverless data pipelines  in Azure.
  • Full  equity-based compensation  at pre-angel stage – a high-risk, high-reward journey.
  • Shape the  core infrastructure  of a company at the ground floor.
  • Create a job alert for this search

    Data Engineer • mangalore, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalMangalore, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneMangalore, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 7 days ago
    • Promoted
    Data & Analytics Engineer

    Data & Analytics Engineer

    APPIT Software IncMangalore, IN
    Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience. Data Modelling & Data Warehouse -Mandatory -Hands...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    SystemBenderMangalore, IN
    Advance SQL Azure Data Factory (ADF) Databricks with PySpark Azure Synapse (added advantage).Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and know...Show moreLast updated: 19 hours ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accolademangalore, karnataka, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras Analyticsmangalore, karnataka, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer – Azure & AWS

    Data Engineer – Azure & AWS

    Yoda Techmangalore, karnataka, in
    We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Ironbook AImangalore, karnataka, in
    Data Engineer (Microsoft Fabric & Azure) - Relocation to KL.The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and modern data lakehouse architectures...Show moreLast updated: 15 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsmangalore, karnataka, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreemangalore, karnataka, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgemangalore, karnataka, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroMangalore, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionmangalore, karnataka, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Servicesmangalore, karnataka, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indiamangalore, karnataka, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 6 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtreemangalore, karnataka, in
    Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradMangalore, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeMangalore, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago