Lead Software Engineer-Data Engineering
CaterpillarChennai, Tamil Nadu, India18 days ago
Job descriptionArchitect and oversee the development of scalable secure and resilient data platforms. Design and implement near real-time data movement and streaming architectures using tools like Kafka Spark and cloud-native services. Establish best practices in data modelling ETL / ELT data governance and metadata management. Lead the development of robust data pipelines for ingestion transformation and delivery using Snowflake dbt and cloud-native tools. Optimize data storage retrieval and processing for performance reliability and cost-efficiency. Implement data quality frameworks lineage tracking and schema evolution strategies. Build and maintain large-scale data lakes and data warehouses for structured and unstructured data. Design scalable data architectures to support manufacturing analytics predictive maintenance and supply chain optimization. Leverage Azure and AWS services for data ingestion transformation and analytics. Deploy software using CI / CD tools (Azure DevOps preferred Jenkins AWS CloudFormation). Ensure platform scalability security and operational readiness across global deployments. Collaborate with Data Science and AI teams to operationalize ML models and analytics workflows. Promote integration of AI capabilities into data engineering pipelines (e.g. GenAI MCP ATA). Support real-time analytics and edge AI use cases in manufacturing environments. Partner with product managers manufacturing SMEs and business leaders to understand requirements and deliver impactful data solutions. Communicate technical concepts to non-technical audiences and influence strategic decisions. Proven experience in Big Data processing and Data Warehousing. Expertise in building end-to-end near real-time data pipelines for OLTP & OLAP. Strong architecture exposure for building robust scalable Data Platforms. Deep expertise in Snowflake SQL NoSQL and distributed data systems. Experience with data transformation tools (dbt Apache Spark Azure Data Factory). Strong analytical skills and solid knowledge of computer science fundamentals. Deep exposure to Azure and AWS cloud platforms. Good understanding of AI concepts and latest developments (Gen AI MCP ATA etc.). Knowledge of the NVIDIA ecosystem and its applications in data and AI. Experience building production-ready AI solutions and integrating with MLOps workflows. Familiarity with modern data visualization and BI tools (e.g. Power BI Tableau Looker). Bachelors or masters degree in computer science Engineering or related field. 10 years of experience in data engineering with at least 2 as team lead Demonstrated success in managing engineering teams and delivering complex data solutions. Excellent communication leadership and stakeholder management skills. This position requires working onsite five days a week.
Career Area :
Technology Digital and Data
Job Description :
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar yourejoining a global team who cares not just about the work we do but also about each other. We are the makers problem solvers and future world builders who are creating stronger more sustainable communities. We dontjust talk about progress and innovation here we make it happen with our customers where we work and live. Together we are building a better world so we can all enjoy living in it.
About the Role
We are seeking a highly skilled Software Engineering Lead to lead a team of engineers in building Caterpillars next-generation Digital Manufacturing Data Platform. This platform is central to our Future of Manufacturing initiativedesigned to unify and operationalize data across design engineering production and supply chain operations.
The ideal candidate will possess deep expertise in Big Data Data Warehousing real-time data movement and Snowflake-based architectures. You will architect and deliver scalable secure and intelligent data platforms that enable advanced analytics AI and digital twin capabilities across global manufacturing ecosystems.
Key Responsibilities
Team Leadership & Management
- Lead mentor and manage a team of data engineers and platform developers.
- Foster a culture of technical excellence collaboration and continuous learning.
- Drive Agile practices and ensure timely delivery of high-quality solutions.
Technical Strategy & Architecture
Data Engineering & Snowflake Expertise
Big Data & Data Warehousing
Cloud & Platform Engineering
AI & Advanced Analytics Enablement
Stakeholder Engagement
Must-Have Skills
Nice-to-Have Skills
Qualifications
Posting Dates :
November 13 2025 - November 27 2025
Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply
Not ready to apply Join our Talent Community.
Key Skills
Anti Money Laundering,Employee Relations,Actuarial,Attorney At Law,Big Data,Filing
Employment Type : Full-Time
Experience : years
Vacancy : 1
Create a job alert for this search
Software Engineering Lead • Chennai, Tamil Nadu, India
Related jobs
- Promoted
Data Engineering Role
100x.incChennai, IN At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer - AWS RedShift
ResourcetreeChennai Job Description : We are seeking a highly skilled and motivated Lead / Senior Data Engineer to join our.Data Integration a...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer - Azure Cloud
ResourcetreeChennai Description : Job Description : We are looking for a skilled and experienced Senior Azure Developer to join our team! As part of the team, you will be involve...Show moreLast updated: 30+ days ago
- Promoted
Senior Software Engineer Technical Lead
iCliniqChennai, Tamil Nadu, India We are currently seeking talented and passionate senior tech lead engineers to join our dynamic team with a culture of collaboration and continuous learning.
If you are driven by innovation and eage...Show moreLast updated: 30+ days ago
- Promoted
Lead Engineer
HyqooChennai, IN Design, deploy, and manage AWS cloud infrastructure, including EC2 instances, S3 buckets, VPCs, RDS databases, and Lambda functions.
Assist in the design, implementation, and maintenance of backup, ...Show moreLast updated: 13 days ago
- Promoted
Developer - Data Engineering & Cloud Analytics
Geakminds Technologies Private LimitedChennai Developer - Data Engineering & Cloud Analytics.Role Overview : Responsible for building, maintaining, and optimizing large-scale data pipelines and analytics solutions lev...Show moreLast updated: 30+ days ago
- Promoted
Logitech - Lead Software Engineer - Algorithm & Data Structure
LogitechChennai Description : Logitech is the Sweet Spot for people who want their actions to have a positive global impact while having the flexibility to do it in their own way.Log...Show moreLast updated: 13 days ago
- Promoted
Neoware Technology Solutions - Azure Data Engineer
Neoware Technology SolutionsChennai Role : Azure Data Engineer Location : Chennai / Bangalore Exp : 3 to 8 years Jo...Show moreLast updated: 3 days ago
- Promoted
Principal Software Engineer - Data Engineering
ConfidentialChennai, India Your Work Shapes the World at Caterpillar Inc.When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.
We are the makers, problem ...Show moreLast updated: 2 days ago
- Promoted
Software Engineer- Data Engineering
ConfidentialChennai, India Your Work Shapes the World at Caterpillar Inc.When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.
We are the makers, problem ...Show moreLast updated: 13 days ago
- Promoted
Data Engineer
MyData Insights Pvt LtdChennai, IN The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Insight GlobalChennai, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Lead Software Engineer
ChargebeeChennai, Tamil Nadu, India You will be a key member of the CRM Integration team, driving initiatives to integrate Chargebee with leading CRM platforms seamlessly.
Additionally, you will own and evolve the current CRM integrat...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
Resourcetree Global ServicesChennai Job Description : We are seeking a highly skilled and motivated Lead Data Engineer to join our Data Integration and Anal...Show moreLast updated: 30+ days ago
- Promoted
Software Engineer-Data Engineering
ConfidentialChennai, India Your Work Shapes the World at Caterpillar Inc.When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.
We are the makers, problem ...Show moreLast updated: 14 days ago
- Promoted
Lead Data Engineer
JMAN GroupChennai, Tamil Nadu, India JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 24 days ago
- Promoted
Lead Data Engineer - AWS Redshift
Resource Tree Global ServicesChennai Job Name : Lead Data Engineer - AWS RedShift Years of Experience : 8 Job Description : Show moreLast updated: 30+ days ago
- Promoted
Firstwave Technologies - Lead Data Engineer - Snowflake
FIRSTWAVE TECHNOLOGIES PRIVATE LIMITEDChennai Description : Job Summary : We are seeking an experienced Lead Snowflake Data Engineer to join our Data &...Show moreLast updated: 1 day ago