Intern-Big Data

Role Summary :

We are seeking a skilled Data Engineer to join our dynamic team. In this role, you'll play a critical part in developing and maintaining Big Data platforms (Data Lake, Data Warehouse, and Data Integration) and advanced analytics solutions. You'll collaborate with application architects, business SMEs, and cross-functional teams to design scalable data pipelines and support innovative data-driven projects.

Key Responsibilities :

• Platform Development : Design, develop, and maintain Big Data platforms including Data Lakes, Data Warehouses, and advanced analytics infrastructures.
• Big Data Architecture : Apply hands-on expertise in data architecture, focusing on Data Warehouse Appliances, Open Data Lakes (AWS EMR, HortonWorks), and Data Lake Technologies (AWS S3, Databricks).
• Data Engineering : Develop and manage Spark ETL frameworks, orchestrate data pipelines using Airflow, and support Presto / Trino query development for stakeholders.
• Machine Learning Pipelines : Design, scale, and deploy ML pipelines for advanced analytics use cases.
• Collaboration : Work closely with application architects, data scientists, and business leaders to deliver end-to-end data solutions.
• Mentorship : Lead code and design reviews, promote technical excellence, and mentor junior engineers.
• Continuous Improvement : Identify opportunities to enhance system performance, scalability, and reliability.

Qualifications & Skills :

Personal Attributes :

Skills Required

Big Data, Azure, Aws