Talent.com
Data Platform Engineering Lead

Data Platform Engineering Lead

YourTribeChennai, Republic Of India, IN
30+ days ago
Job description

The Role

We're seeking an Engineering Manager for Data & Platform who thrives at the intersection of real-time data architecture and people leadership. Reporting directly to our CTO, you'll lead a high-performing team of high-performance engineers while driving the technical vision for our real-time streaming platform that powers critical trading infrastructure.

Your team will be responsible for building the backbone of our trading ecosystem, from scalable data ingestion systems to sophisticated trading modules, including PAMM (Percentage Allocation Management Module), MAMM (Multi-Account Manager Module), Copy Trading platforms, and Introducing Broker systems. This is where data engineering meets financial trading at scale.

What You'll Do :

Lead and scale a specialized data & platform engineering team of talented developers

Drive architecture decisions for real-time streaming platforms and trading infrastructure

Spearhead the development of PAMM, MAMM, and Introducing Broker systems, etc.

Design and implement scalable data ingestion pipelines handling high-volume trade and market data

Collaborate cross-functionally with Product, QA, and Support teams

Implement and optimize platform reliability metrics and data quality standards

Mentor engineers in distributed systems, stream processing, and financial domain expertise

Champion best practices in real-time data processing, monitoring, and incident response

What We're Looking For

Experience That Matters :

Industry Depth : 10+ years of progressive software engineering experience with significant focus on data platforms, streaming systems, or high-throughput distributed architectures

Data Platform Expertise : 5+ years building and scaling real-time data platforms, streaming architectures, or event-driven systems, with a deep understanding of data consistency, backpressure handling, and fault tolerance patterns

Team Leadership : 4+ years successfully managing and growing engineering teams of 8-10 developers, with experience hiring specialized data engineers and platform architects during rapid scaling phases

System Complexity : Proven track record of architecting and delivering mission-critical data infrastructure that processes high-volume, low-latency data streams with strict reliability and accuracy requirements

Financial Domain Impact : Experience working with trading systems, financial data feeds, risk management platforms, or other latency-sensitive financial infrastructure where data accuracy and timing are paramount

Technical Excellence :

Streaming & Event Processing : Expert-level experience with Apache Kafka, Apache Flink, and modern stream processing frameworks, including complex event processing, windowing operations, and exactly-once semantics

Data Engineering Mastery : Deep expertise in building data pipelines, ETL / ELT processes, data modeling for real-time analytics, and handling both structured and unstructured data at scale

Java & JVM Ecosystem : Advanced proficiency in Java (11+) and JVM performance tuning, with experience building high-throughput applications that handle thousands of transactions per second

Cloud-Native Data Architecture : Extensive hands-on experience with FOSS data stack as well as cloud data, containerization of stateful services, and cloud-native data storage solutions

Database & Storage Systems : Expert knowledge of both SQL and NoSQL databases, time-series databases, distributed caching, and storage optimization for high-frequency data

Microservices & APIs : Strong experience in designing event-driven microservices, implementing robust API gateways, handling service mesh complexity, and managing inter-service communication patterns in distributed data systems

Platform Reliability : Deep understanding of observability frameworks, distributed tracing, metrics collection, alerting strategies, and building self-healing systems that maintain high availability

AI-Assisted Development : Experience leveraging modern AI coding tools (GitHub Copilot, Cursor, ChatGPT, Claude, Tabnine) to accelerate development workflows, improve code quality, and enhance team productivity while maintaining security and best practices

Leadership & Process :

Agile for Data Teams : Deep expertise in Agile / Scrum methodologies adapted for data and platform teams, with experience managing complex dependencies between data pipelines, platform services, and downstream consumers

Data Engineering Culture : Proven ability to establish engineering best practices specific to data platforms including comprehensive testing strategies for streaming applications, data quality validation, schema evolution management, and effective incident response for data outages

Metrics-Driven Platform Management : Experience implementing platform-specific metrics such as data processing latency, throughput rates, error rates, data quality scores, SLA adherence for data availability, and consumer satisfaction metrics

Quality & Reliability : Strong focus on building reliability into data systems through automated testing, chaos engineering, data validation frameworks, and collaborative practices that ensure data accuracy and system resilience

Cross-Functional Process Optimization : Track record of identifying bottlenecks in data workflows and implementing solutions that improve data delivery speed, reduce pipeline complexity, and enable faster time-to-insight for business stakeholders

Mentorship-Driven Development : Strong background in pair programming, code mentoring, guided development sessions, and creating structured learning paths that help junior developers grow into senior contributors and future technical leads

Cultural Fit :

Data-Driven Customer Focus : Genuine passion for understanding how data serves end-users and translating business requirements into scalable data solutions, with experience gathering feedback from traders, analysts, and business users

Platform Ownership & Accountability : Demonstrated history of taking end-to-end ownership of data platforms and trading systems, from initial architecture through production operations, with a "you build it, you run it" mentality for critical infrastructure

Innovation with Reliability : Ability to balance cutting-edge data technologies with the stability requirements of financial systems, making thoughtful decisions about when to adopt new streaming technologies versus proven solutions

Cross-Domain Collaboration : Natural ability to build consensus between engineering, trading, risk management, compliance, and business intelligence teams while maintaining technical standards and data governance requirements

Continuous Learning Mindset : Passionate about staying current with evolving data engineering landscape, financial technology trends, and regulatory requirements, while

creating an environment where team members experiment with new tools and methodologies

Bias for Action with Precision : Comfortable making architectural decisions with incomplete information while maintaining the precision and accuracy required for financial data processing, and skilled at balancing innovation speed with regulatory compliance.

Nice to Have

Domain & Industry :

Fintech Trading Systems : Deep understanding of trading infrastructure, market data feeds, order management systems, risk management platforms, and the unique challenges of building real-time financial data processing systems

PAMM / MAMM Experience : Direct experience building or maintaining Percentage Allocation Management Modules, Multi-Account Manager systems, Copy Trading platforms, or Introducing Broker infrastructure

High-Frequency Data Processing : Experience with ultra-low-latency systems, real-time market data processing, algorithmic trading support, or other performance-critical applications where microseconds matter

Regulatory & Compliance : Understanding of financial services regulations (MiFID II, EMIR, Dodd-Frank), data governance requirements, audit trails, and compliance reporting for trading platforms

Global Trading Infrastructure : Experience building systems that handle multiple asset classes, serve international markets, manage complex regulatory requirements across jurisdictions, and handle diverse market data formats

Create a job alert for this search

Data Engineering Lead • Chennai, Republic Of India, IN

Related jobs
  • Promoted
Founding Data Engineer

Founding Data Engineer

SalaryGuideNagpur, IN
Today, job seekers rely on outdated and biased tools to evaluate employers.We’re changing that by collecting and structuring messy public data — jobs, salaries, org structures, tech stacks, and gro...Show moreLast updated: 1 day ago
  • Promoted
Director of Engineering

Director of Engineering

Intellectyx, Inc.nagpur, maharashtra, in
AI-native, digital innovation company.We enable organizations to evolve from traditional digital systems to.AI-driven decision intelligence. AI-native product ecosystem across.This role requires a s...Show moreLast updated: 1 day ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

Guidanz IncNagpur, IN
BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 1 day ago
  • Promoted
Data Engineering Role

Data Engineering Role

100x.incIndia, India
At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 30+ days ago
  • Promoted
Azure Data Lead / Architect

Azure Data Lead / Architect

TEKsystems Global Services in IndiaNagpur, IN
Notice Period : Immediate to15 Days.Please find the below Azure Data Lead / Architect JD.Azure AI skills, Azure Open AI, AI Foundry. Excellent communication and interpersonal skills, with the ability t...Show moreLast updated: 1 day ago
  • Promoted
Lead Data Engineer

Lead Data Engineer

Cimpressnagpur, maharashtra, in
Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 1 day ago
  • Promoted
Data Engineer

Data Engineer

Response Informaticsnagpur, maharashtra, in
AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
  • Promoted
Co-Founder and Tech lead

Co-Founder and Tech lead

Vioron Internet Private Limitednagpur, maharashtra, in
We’re building a next-gen automotive start-up aimed at disrupting the current paradigm.We’re not looking for an employee. we’re looking for a visionary who wants to co-create a company that leaves ...Show moreLast updated: 30+ days ago
  • Promoted
Principal Data Engineer

Principal Data Engineer

CodeMyMobileNagpur, IN
Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show moreLast updated: 1 day ago
  • Promoted
Senior Cloud Data Fusion

Senior Cloud Data Fusion

Technocrats Domain IncNagpur, IN
Migration from DataStage to Cloud Data Fusion.Visual Studio (Wrangler, Joiner, GroupBy, Aggregator, etc.Compare results between source and target (output from DataStage).Show moreLast updated: 1 day ago
  • Promoted
Data Engineer

Data Engineer

RecroNagpur, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
  • Promoted
AI - Lead Founding Engineer

AI - Lead Founding Engineer

BPMLinksnagpur, maharashtra, in
Deep experience with LLMs, embeddings, vector search, knowledge graphs, and RAG / GraphRAG pipelines.Strong programming expertise in Python (LangChain, Haystack, FastAPI), and modern backend framewor...Show moreLast updated: 21 days ago
  • Promoted
Reltio Lead / Architect

Reltio Lead / Architect

Mastech DigitalNagpur, IN
Chennai / Bangalore / Hyderabad / Noida / Remote with quarterly visit.LPA (Depending on level of expertise).Immediate joiner / Currently serving notice / Notice is less than 60 days.We are looking for a hands...Show moreLast updated: 22 days ago
  • Promoted
  • New!
Team Lead – Software Engineering

Team Lead – Software Engineering

Yodaplusnagpur, maharashtra, in
At Yodaplus, we build innovative, secure, and scalable technology solutions that power the future of FinTech, Enterprise Blockchain, and Supply Chain industries worldwide.Since 2016, we’ve partnere...Show moreLast updated: 20 hours ago
  • Promoted
Technical Lead

Technical Lead

Thumonagpur, maharashtra, in
Founding Engineer @ Thumo (Africa’s first super-app).We’re building Africa’s super-app, starting with food delivery.M funding round led by Soma Capital with top Silicon Valley angels, we’re hiring ...Show moreLast updated: 30+ days ago
  • Promoted
AI Lead Engineer - Agentic Platforms

AI Lead Engineer - Agentic Platforms

OrbitShift.AINagpur, IN
AI-native Sales Operating System.Our multi-agent AI system enables actionable account insights, RFP response generation, targeted nudges, and sales content. Peak XV (formerly Sequoia Capital), Stell...Show moreLast updated: 30+ days ago
  • Promoted
Engineering Manager - II, Data Engineering Platform

Engineering Manager - II, Data Engineering Platform

TamaraIndia, India
Data Engineering Manager II : Real-Time Data & Experimentation Platform (Remote, India).Saudi Arabia's first fintech unicorn. GCC, with a mission to empower dreams through customer-centric financial ...Show moreLast updated: 1 day ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

Saransh Incnagpur, maharashtra, in
Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 22 days ago