No longer accepting applications
AWS Lead Data engineer
Tata Consultancy Serviceschennai, tamil nadu, in22 hours ago
Job descriptionKnowledge of additional programming languages and development tools to provide flexibility and adaptability across varied data engineering projects A master’s degree or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous Lead complex projects autonomously, fostering an inclusive and open culture within development teams. Mentor team members and lead technical discussions. Provides strategic guidance on best practices in design, development, and implementation. Leads the development of high-quality, efficient code and develops necessary tools and applications to address complex business needs Collaborates closely with architects, Product Owners, and Dev team members to decompose solutions into Epics, leading the design and planning of these components. Drive the migration of existing data processing workflows to a Lakehouse architecture, leveraging Iceberg capabilities. Serves as an internal subject matter expert in software development, advising stakeholders on best practices in design, development, and implementation Deep technical knowledge of data engineering solutions and practices. Expert in AWS services and cloud solutions, particularly as they pertain to data engineering practices Extensive experience in software architecture and solution design Specialized expertise in Python and Spark Ability to provide technical direction, set high standards for code quality and optimize performance in data-intensive environments. Skilled in leveraging automation tools and Continuous Integration / Continuous Deployment (CI / CD) pipelines to streamline development, testing, and deployment. Exceptional communicator who can translate complex technical concepts for diverse stakeholders, including engineers, product managers, and senior executives. Provides thought leadership within the engineering team, setting high standards for quality, efficiency, and collaboration. Experienced in mentoring engineers, guiding them in advanced coding practices, architecture, and strategic problem-solving to enhance team capabilities. Bachelor’s degree in computer science, Software Engineering, or a related field is essential. Financial Services expertise preferred, working with Equity and Fixed Income asset classes and a working knowledge of Indices.
Job Summary : In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue and Glue Data Catalog. The main goal of this position is to ensure successful migration and establish robust data quality governance across the new platform, enabling reliable and efficient data processing. Success in this role requires deep technical expertise, exceptional problem-solving skills, and the ability to lead and mentor within an agile team.
Must Have Tech Skills :
- Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a culture of continuous learning and innovation
- Extensive experience in software architecture and solution design, including microservices, distributed systems, and cloud-native architectures.
- Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices.
- Deep technical knowledge of AWS data services and engineering practices, with demonstrable experience of implementing data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena
- Experience of delivering Lakehouse solutions / architectures
Nice To Have Tech Skills :
Key Accountabilities :
Key Skills :
Educational Background :
Bonus Skills :
Create a job alert for this search
Aws Data Engineer • chennai, tamil nadu, in
Related jobs
Immediate / 10 Days To 15 days NP.The ideal candidate should have a solid background in data engineering, strong programming skills, and deep experience working with AWS cloud services.Optimize and...Show moreLast updated: 24 days ago
- Promoted
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Incchennai, tamil nadu, in Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticschennai, tamil nadu, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
- Promoted
TVS Next - Lead AWS Data Engineer - SQL / ETL / Data Warehousing
TVS NEXT LIMITEDChennai Description : We are looking for Lead AWS Data Engineer Guindy, Chennai.This is a fulltime permanent position.Must have Skills : Designing and optimizing large-sca...Show moreLast updated: 11 days ago
- Promoted
Data Engineer – Azure & AWS
Yoda TechChennai, IN We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms.
The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 12 days ago
- Promoted
Senior Data Engineer with AWS_ Exp : 6+ Years
Atyeti IncChennai, IN Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago
- Promoted
Lead Data Engineer - AWS RedShift
ResourcetreeChennai Job Description : We are seeking a highly skilled and motivated Lead / Senior Data Engineer to join our.Data Integration a...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Cynosure Corporate SolutionsChennai Key Responsibilities : - Design, develop, and maintain robust data pipelines to enable seamless data flow into Snowflake and other storage ...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
TerraGiGChennai, IN Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 14 days ago
- Promoted
AWS Engineer
Spryc SystemsChennai, IN We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment.
The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 3 days ago
- Promoted
Accenture - AWS Data Engineer
Accenture OperationChennai Management Level : 9- Consultant Location : Open Must-have skills : Data Engineering, AWS(mandate) Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
Tata Consultancy Serviceschennai, tamil nadu, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer / Snowflake Data Engineer
Numeric Technologieschennai, tamil nadu, in Please apply only if you are comfortable to work in rotational shift.Apply only if you are an immediate to 15 days joiner.
Work Mode - Monthly once to office in Bangalore.Years of experience - 2 to ...Show moreLast updated: 1 day ago
- Promoted
- New!
AWS Data Engineer
Insight Globalchennai, tamil nadu, in We are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud.
The ideal candidate will have experie...Show moreLast updated: 22 hours ago
- Promoted
AWS Data engineer
ConfidentialChennai, India We are looking for a passionate Senior Data Engineer with deep expertise in AWS-based data solutions.In this role, you will design, deploy, and optimize cloud-native data pipelines and frameworks t...Show moreLast updated: 6 days ago
- Promoted
Senior Data Engineer - Snowflake / AWS
ResourcetreeChennai About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer (AWS / Databricks)
Accoladechennai, tamil nadu, in The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer - AWS Redshift
Resource Tree Global ServicesChennai Job Name : Lead Data Engineer - AWS RedShift Years of Experience : 8 Job Description : Show moreLast updated: 30+ days ago
Senior AWS Data Engineer
Epergne SolutionsChennai, Tamil Nadu, IndiaQuick Apply