Lead Data Pipeline Architect

Equity Only (No Monetary Compensation) | Pre-Seed Stage Startup

About Us

We are building a next-generation AI-driven trading platform that ingests massive streams of financial, alternative, and sentiment data and transforms them into actionable insights. Our mission is to combine robust data engineering pipelines with Generative AI and advanced ML models to democratize access to sophisticated trading strategies.

As part of our founding technical team , you will play a crucial role in ensuring our platform's data backbone is reliable, scalable, and production-ready.

The Role

We are looking for a Founding Data Pipeline Engineer passionate about designing and building scalable data pipelines in the cloud. You will work closely with the Founding Gen AI Engineer to ensure clean, validated, and well-structured data is available for model training, inference, and strategy generation.

You will be hands-on with custom Python development , running data ingestion and transformation jobs in Azure Functions and similar serverless / cloud-native environments. You will also architect and optimize data storage and analytics pipelines, leveraging Azure OLAP services such as Kusto (KQL) and Data Lake, as well as Databricks.

What You’ll Do

Data Pipeline Development :

• Design and implement scalable ingestion pipelines to handle high-volume, real-time, and batch data feeds.
• Write custom Python code to run within Azure Function Apps for event-driven and scheduled ingestion tasks.
• Integrate APIs, event streams, and unstructured data into unified pipelines.

Data Transformation & Storage : Implement preprocessing, validation, and enrichment logic to prepare datasets for AI / ML models.

Collaboration with AI / ML : Partner with the Founding Gen AI Engineer to ensure AI-ready datasets (structured, time-series, textual, and alternative data).

Operations & Observability :

Startup Contribution :

What We’re Looking For

Why Join Us