Description :
Seeking an experienced ETL Developer to design, build, and maintain data pipelines and integrations across cloud-native environments.
The role focuses on developing robust ETL processes, ensuring data quality, performance, and scalability using AWS services and Python.
Priority Skills :
- ETL knowledge
- AWS tech stack (AWS Lambda, AWS S3, AWS Terraform)
- AWS Glue
- Python
Secondary Skills (Good to Have) :
GraphQLPostgreSQLGitHub ActionsKey Responsibilities :
Design, develop, test, and deploy ETL pipelines to ingest, transform, and load data from multiple sourcesImplement cloud-native data solutions leveraging AWS services and Maintain and optimize AWS Glue jobs, Lambda functions, and S3-based data lakesWrite clean, maintainable Python code for data processing and orchestrationCollaborate with data engineers, analysts, and stakeholders to translate requirements intotechnical solutions
Monitor, troubleshoot, and tune ETL performance and data quality issuesCreate and maintain pipeline documentation, data lineage, and operational runbooksImplement CI / CD for data pipelines and automation around deployments and testingEnsure security, governance, and cost-efficiency of data processing workflowsRequired Qualifications :
Bachelors degree in Computer Science, Engineering, Information Systems, or equivalent experienceProven experience designing and building ETL / data pipelines in productionStrong Python development skills and experience with data libraries (e.g., pandas, pyarrow)Hands-on experience with AWS services listed in Priority SkillsFamiliarity with infrastructure-as-code (Terraform) and deployment automationSolid understanding of data modeling, data warehousing concepts, and data quality bestpractices
Desired Experience & Traits :
Experience with AWS Glue job authoring, debugging, and performance tuningExperience working with data lakes, partitioning strategies, and S3 lifecycle / cost managementKnowledge of API integrations and GraphQL endpointsComfortable working in agile teams and collaborating across engineering and data functionsStrong problem-solving, communication, and documentation skills(ref : hirist.tech)