AWS Data Pipeline EngineerTata Consultancy Services • Pune, Republic Of India, IN
AWS Data Pipeline Engineer
Tata Consultancy Services • Pune, Republic Of India, IN
23 days ago
Job descriptionGood understanding of Data warehouse and Data Lakes Familiarize ETL tools like Netezza or Informatica. Experience working with NoSQL databases like DynamoDB or MongoDB. Good to have exposure to AWS services (Step Functions, Athena) Data Modelling exposure Familiarity with Investment Banking domain
Role AWS Data Engineer
Required Technical Skill Set AWS Redshift, Glue, PySpark
Desired Experience Range 4-10 Years
Location of Requirement Chennai / Pune
Desired Competencies (Technical / Behavioral Competency)
Must-Have
- Strong hands-on experience in Python programming and PySpark
- Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda)
- Experience working with Apache Spark and Hadoop ecosystem.
- Experience in writing and optimizing SQL for data manipulations
- Good Exposure to scheduling tools. Airflow is preferable.
- Must Have Data Warehouse Experience with AWS Redshift or Hive
- Experience in implementing security measures for data protection.
- Expertise to build / test complex data pipelines for ETL processes (batch and near real time)
- Readable documentation of all the components being developed.
- Knowledge of Database technologies for OLTP and OLAP workloads
Good-to-Have
Create a job alert for this search
Data Pipeline Engineer • Pune, Republic Of India, IN
Similar jobs
Principal Data Pipeline Engineer
SAIVA AI • Republic Of India, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
AWS Data Engineer
LTIMindtree • India
Greetings from LTIMindtree !!!.We are really impressed by your AWS experience.We are having multiple opportunities and projects which are based on AWS, Glue, Lamda.
I’d love to tell you a little mor...Show more
Last updated: 14 days ago • Promoted
AWS Data Engineer
Coforge • India
We are seeking a highly skilled and experienced.The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and framew...Show more
Last updated: 14 days ago • Promoted
Cloud Data Pipeline Specialist
ACL Digital • Republic Of India, IN
We have urgent openings for AWS Data Engineer.The ideal candidate will have a strong background in designing, deploying, and maintaining data pipelines using industry-leading tools such as.Familiar...Show more
Last updated: 21 days ago • Promoted
Azure Data Pipeline Engineer
MRF • Chennai, Republic Of India, IN
Azure / SQL / Application - Data Engineer.Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc.
Responsible for user access mana...Show more
Last updated: 6 days ago • Promoted
Lead Data Pipeline Engineer
Koantek • Republic Of India, IN
The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors.
He / she will play a key role in developing and maintaining scal...Show more
Last updated: 2 days ago • Promoted
AWS Data Pipeline Developer
Fulminare IT Sol • Republic Of India, IN
Our direct client is looking for Data Engineer with Python, AWS, SQL - Fully remote in India.Timings : Mostly 2 : 30 PM to 10 : 30 PM IST.
Required experience with Python, AWS, SQL, Resumes should reflec...Show more
Last updated: 2 days ago • Promoted
Data Pipeline Engineer
Luxoft • Chennai, Republic Of India, IN
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show more
Last updated: 13 days ago • Promoted
AWS Data Engineer (PySpark)
Atyeti Inc • India
Proficient with Python, PySpark and Airflow.Strong understanding of Object-Oriented Programming and Functional Programming paradigm.
Must have experience working with Spark and its architecture.Know...Show more
Last updated: 14 days ago • Promoted
Data Engineer
IntraEdge • India, India
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
AWS Data Engineer
Atyeti Inc • India
Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform.
Build and maintain all facets of Data Pipel...Show more
Last updated: 14 days ago • Promoted
Azure Data Pipeline Engineer
EXL • Pune, Republic Of India, IN
Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more
Last updated: 19 days ago • Promoted
AWS Data Pipeline Specialist
Tata Consultancy Services • Pune, Republic Of India, IN
Job Title : Data Engineer (AWS, Redshift, PySpark, Glue).Location : Chennai / Pune ( Onsite ).The candidate will work on building data pipelines, optimizing data warehouses, and handling large datase...Show more
Last updated: 2 days ago • Promoted
Data Pipeline Engineer
Yubi • Republic Of India, IN
As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show more
Last updated: 30+ days ago • Promoted
AWS Data Engineer
Capgemini Invent • India
At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
Last updated: 14 days ago • Promoted
AWS Data Engineer
Emids • India
We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team.
The ideal candidate will be responsible fo...Show more
Last updated: 13 days ago • Promoted
Data Engineer – AWS
Recruin • India
Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, Kinesis, and S3.
Build and optimize data warehouses and data lakes on AWS (Redshift, Lake F...Show more
Last updated: 14 days ago • Promoted
AWS Data Engineer B
Confidential • India
Experience At least 5 years of experience in AWS based projects.Technical skills Proficiency in Python and PySpark for data engineering tasks.
Big Data Strong knowledge of Big Data technologies and ...Show more
Last updated: 27 days ago • Promoted