Big Data Engineer

About the Company

Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.

Title : Senior Data Engineer

Location : Hyderabad,Chennai

Experience : 6 - 12 years

Employment Type : Permanent

Notice Period : Immediate Joiners

Key Responsibilities :

• Big Data Processing :
• Design, develop, and maintain scalable ETL / ELT pipelines using PySpark, Scala, or Java.
• Implement data transformation workflows to ensure clean and reliable datasets.
• Cloud Integration :
• Work extensively with AWS services such as EMR, S3, Glue, Lambda, Redshift, DynamoDB, and RDS to build and manage data solutions.
• Data Modeling & Optimization :
• Develop and optimize data models in Hadoop and Spark environments.
• Ensure performance tuning and cost optimization of cloud-based data platforms.
• Data Ingestion & Integration :
• Ingest data from various sources including APIs, RDBMS, and NoSQL databases.
• Implement data pipelines for batch and real-time processing.
• Collaboration & Documentation :
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Document data models, transformation logic, and technical specifications.
• Automation & Monitoring :
• Automate data workflows and ensure data pipelines are reliable, scalable, and error-free.
• Implement data monitoring, logging, and alerting to ensure pipeline reliability.

Required Skills & Qualifications :

Preferred Skills (Good to Have) :