Job Title : Senior Data Engineer
We are seeking a skilled data engineer to join our organization. The ideal candidate will have extensive experience in designing, developing, and deploying end-to-end data pipelines on cloud infrastructure.
Key Responsibilities :
- Design and develop data pipelines using services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.
- Implement data processing and transformation workflows using Apache Spark and SQL.
- Build and maintain orchestration workflows to automate data pipeline execution, scheduling, and monitoring.
- Collaborate with analysts and stakeholders to understand data requirements and deliver scalable data solutions.
- Optimize data pipelines for performance, reliability, and cost-effectiveness by leveraging best practices and cloud-native technologies.
Requirements :
Minimum 8+ years of experience building and deploying large-scale data processing pipelines in a production environment.Hands-on experience in designing and building data pipelines on cloud infrastructure.Strong proficiency in AWS services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.Strong experience with Apache Spark for data processing and analytics.Hands-on experience on orchestrating and scheduling data pipelines using AppFlow, Event Bridge, and Lambda.Solid understanding of data modeling, database design principles, and SQL and Spark SQL.Benefits :
Opportunity to work with cutting-edge technology.Collaborative and dynamic work environment.Professional growth and development opportunities.