Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.
Must Have Skills : - AWS, Spark & Scala.
Experience Required : 3 to 6 Years
Job Locations : Pune, Hyderabad, Greater Noida Only.
Send your CV to : Gaurav.2.Kumar@coforge.com
For queries, contact via WhatsApp : 9667427662
Key Responsibilities : -
- Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex data processing.
- Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
- Architect and operationalize data engineering and analytics platforms (AWS preferred; Hortonworks, Cloudera, or MapR experience a plus).
- Implement and manage AWS services including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
- Work on real-time streaming solutions using Kafka and AWS Kinesis.
- Support ML model operationalization on AWS (deployment, scheduling, and monitoring).
- Analyze source system data and data flows to ensure high-quality, reliable data delivery for business needs.
- Write highly efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.
- Collaborate with cross-functional teams to provide technical leadership, mentor team members, and strengthen the data engineering capability.
- Troubleshoot and resolve complex technical issues, ensuring scalability, performance, and security of data solutions.
Mandatory Skills & Qualifications : -
Solid hands-on experience in Big Data Technologies (AWS, Scala, Hadoop, and Spark Mandatory)Proven expertise in Spark with ScalaHands-on experience with : AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)