Principal Data Engineer
ConfidentialChennai, India8 days ago
Job descriptionProven ability to communicate effectively with both technical and non-technical audiences, including customers, executives, and cross-functional teams. Experience tracking and clearly reporting project progress, milestones, and blockers to internal stakeholders and external partners. Technical depth to personally contribute to codebases and architecture discussions, while helping set standards across teams. A proactive and collaborative mindset focused on transparency, stakeholder engagement, and shared ownership of outcomes. Commitment to quality, scalability, and maintainability of systems through thoughtful design and testing. 8-12 years of development experience in data engineering, including direct contribution to 24x7 production systems. Advanced skills in Python and / or Golang, SQL, and current cloud data platforms (e.g., Databricks, BigQuery, Snowflake, or other). Strong experience in communicating complex project plans and deliverables to both technical and business audiences. Track record of developing and operating scalable data pipelines, APIs, and data platform components in real-world environments. Experience working directly with external stakeholders or customers, either in consulting, enterprise data delivery, or technical leadership roles. Deep understanding of batch and real-time data architectures, data modeling, and data warehousing. Hands-on experience with cloud-native ecosystems (GCP, AWS, or Azure), CI / CD pipelines, and infrastructure as code. Experience with a broad range of cloud technologies, including : Containerization & deployment : Docker, Kubernetes, Cloud Run, Cloud Functions, GKE, ECS Data integration and orchestration : n8n, Cloud Scheduler, Airflow, Cloud Composer, Step Functions, dbt, Dataform Messaging : Kafka, Pub / Sub Analytics & BI : Looker, Tableau AI / ML : Vertex AI, SageMaker, MLflow Cloud storage integration : S3, GCS Proficiency in setting up data observability, quality frameworks, and governance controls in distributed systems. Strong ability to translate ambiguous business needs into scoped, deliverable projects. Demonstrated success in stakeholder engagement, influencing outcomes, and building long-term trust. Technical leadership in prior roles with clear individual contributions to architecture, development, and delivery. Mentoring experience and a passion for helping others grow technically and professionally. Exceptional communication skills with the ability to articulate technical ideas and project updates clearly to both internal teams and customer stakeholders. Ability to distill complex data and architecture challenges into simple, actionable plans that align with stakeholder goals. Experience in client-facing roles, technical consulting, or enterprise delivery where direct communication with business or product partners was essential. A strong personal track record of hands-on coding and technical design, including ownership of critical systems and services. Demonstrated ability to build trust and alignment across teams, especially in fast-moving, high-stakes environments. Familiarity with cross-functional planning, scoping, and milestone delivery in agile or hybrid development environments. A commitment to mentoring and knowledge sharing, helping level up peers while continuing to grow as an individual contributor.
Your Role and Impact
Your Contribution
About The Role
As a Principal Software Engineer - Data, you will play a role as a hands-on technical leader and a key communicator with stakeholders as part of the Data Products team. You will contribute directly to the design and development of enterprise-grade data systems while also acting as a bridge between engineering teams and business partners.
Primarily Focused On
- Driving development efforts by contributing high-quality, scalable, and maintainable code across data pipelines, APIs, and platform components.
- Owning the communication of project deliverables, timelines, and risks to internal and external stakeholders, ensuring alignment at every step.
- Understanding customer needs and translating them into technical solutions, partnering closely with product, analytics, and engineering teams to deliver end-to-end value.
- Designing and delivering robust and future-proof data architectures that support analytics, APIs, and machine learning initiatives.
- Leading the technical execution of key projects, ensuring progress is clearly communicated and roadblocks are proactively addressed.
- Partnering cross-functionally to co-develop architectural roadmaps, implementation plans, and go-live strategies that meet business requirements.
- Participating in stakeholder reviews and providing clear, actionable updates on technical progress, dependencies, and constraints.
- Guide platform-level optimization, including cost efficiency, performance, reliability, and maintainability.
- Set best practices for data governance, lineage, quality, and security in a distributed data environment.
- Mentor engineers, fostering a strong technical culture and continuous learning environment.
Success In This Role Requires
About You
Experience & Technical Requirements :
Highly Favorable Skills
Skills Required
Airflow, S3, Golang, Kafka, Tableau, Pub Sub, Docker, snowflake , Python, Aws, BigQuery, Step Functions, Sql, Gcp, dbt, ECS, gcs , Databricks, Azure, Kubernetes
Create a job alert for this search
Principal Data Engineer • Chennai, India
Related jobs
- Promoted
Data Engineer
DigitalzoneChennai, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 4 days ago
- Promoted
Senior Data Engineer
Eucloid Data SolutionsChennai, Tamil Nadu, India Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show moreLast updated: 30+ days ago
- Promoted
Big Data Engineer
Alef EducationChennai, IN Alef Education began with a bold idea : that every learner deserves a personalised and meaningful education experience.What started in 2016 as a small pilot programme in Abu Dhabi has evolved into o...Show moreLast updated: 24 days ago
- Promoted
Data Engineer
RecroChennai, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
- New!
Data Engineer
DraconXChennai, IN DraconX specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises.
As pioneers in AI business automation and SaaS platforms, we ex...Show moreLast updated: 6 hours ago
- Promoted
Data Engineer
EXLChennai, India Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
- Promoted
athenahealth - Principal Staff Engineer - Generative AI
athenaHealth Technology Private Limited.Chennai Join us as we work to create a thriving ecosystem that delivers accessible, high-quality, and sustainable healthcare for all.
This position requires expertise in designing, developing, debugging, an...Show moreLast updated: 30+ days ago
- Promoted
Founding Data Engineer
InSiteVerseChennai, IN We are building a next-generation .Generative AI and advanced ML models.Founding Data Pipeline Engineer.You will work closely with the .
You will also architect and optimize .Azure OLAP services suc...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer II
ClearDemandChennai, IN Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership.
You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 4 days ago
- Promoted
Data Engineer
JMAN GroupChennai, Tamil Nadu, India JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 30+ days ago
- Promoted
Principal Data Engineer
CodeMyMobileChennai, IN Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show moreLast updated: 4 days ago
- Promoted
Principal Engineer - Data Science
Pull LogicChennai, IN Pull Logic is transforming the retail supply chain with a revolutionary availability-oriented paradigm that directly links customer preferences with real-time inventory.
Backed by cutting-edge resea...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
Insight GlobalChennai, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
thinkbridgechennai, tamil nadu, in We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
JMAN GroupChennai, Tamil Nadu, India JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
VAANTECHChennai, Tamil Nadu, India Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
IntraEdgeChennai, IN We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
Cimpressmount, India Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 3 days ago