Position : Senior Data Engineer
Location : Remote – Pan India
Experience : 8–12 Years
Work Hours : 12 PM – 9 PM IST (US overlap)
Type : Full-time
Job Description
We're looking for an experienced Data Engineer who can design, develop, and optimize large-scale data pipelines and analytics solutions on AWS . You'll be working on end-to-end data flows - from ingestion and transformation to storage and analytics - ensuring performance, scalability, and cost efficiency.
Key Responsibilities
- Design and implement end-to-end data pipelines (ingestion → transformation → storage → consumption).
- Build and optimize ETL / ELT workflows using AWS Glue (PySpark) , Python , and SQL .
- Develop cloud-native pipelines using AWS services such as Glue, Athena, Redshift, Lambda, and S3.
- Optimize Redshift queries and Glue jobs for performance and cost.
- Implement data governance and security using IAM, KMS, and AWS Secrets Manager.
- Automate and orchestrate data pipelines via Lambda, Step Functions, or CI / CD pipelines .
- Collaborate with cross-functional teams including BI and Data Science.
Required Skills & Experience
8–12 years total experience, with 4+ years on AWS data engineering.Hands-on with AWS Glue (PySpark) , Athena , Redshift , S3 , and Lambda .Strong in Python (data transformations, ETL scripting).Advanced SQL – CTEs, window functions, optimization.Good understanding of data modeling (Star / Snowflake schemas).Experience with cost optimization, monitoring, and CI / CD for data pipelines.AWS ArchitectureNice to Have
Airflow / Step Functions / Terraform / CloudFormation.
Experience with data lake architecture and performance tuning.
Skills Required
S3, Pyspark, AWS Glue, Data Modeling, Monitoring, Redshift, Sql, Lambda, Cost Optimization, Python, Aws, Etl