Data Engineer Scala / Spark

I hope you're doing well! I came across your profile and was impressed by your extensive experience as an / a (mention role / skill). We have a similar opportunity to join our dynamic team at TCS.

Job Title : Data Engineer Scala / Spark

Locations : Bangalore

Mode : Full Time

8-16 Years Experience

About the Role :

We are seeking a skilled and passionate Back-End Engineer with a strong background in data engineering to join our growing team. In this role, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines and back-end systems. You will work with large datasets, leverage cloud technologies, and collaborate with data scientists and other engineers to deliver impactful data-driven solutions. This position is available in both the United States and India.

Responsibilities :

• Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
• Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.
• Work with Data Frames to manipulate and analyse large datasets.
• Implement data storage and processing solutions using cloud technologies (preferably AWS or GCP).
• Build and maintain real-time data streaming pipelines using MSK / Kafka.
• Utilize S3 for data storage and retrieval.

Required Skills :