Application Developer - AWS Glue (3-8 yrs)
Location : Others / Bengaluru, Karnataka, India
Job Description :
We are seeking a highly motivated and experienced Application Developer with a strong background in AWS Glue and ETL processes to join our growing team. In this role, you will be responsible for designing, developing, and maintaining data pipelines using AWS Glue and other AWS services. You will work closely with data engineers, data scientists, and business stakeholders to understand data requirements and build scalable and reliable solutions.
Responsibilities :
- Design, develop, and maintain ETL pipelines using AWS Glue, Python, and Spark.
- Develop and implement data quality checks and validation processes.
- Optimize Glue jobs for performance and cost efficiency.
- Work with various data sources, including relational databases, data warehouses, and cloud storage.
- Collaborate with data engineers to build and maintain data lakes and data warehouses.
- Implement data governance and security best practices.
- Troubleshoot and resolve data pipeline issues.
- Write clear and concise technical documentation.
- Participate in code reviews and contribute to team knowledge sharing.
- Stay up-to-date with the latest AWS Glue features and best practices.
- Work in an Agile development environment.
- Contribute to the design and architecture of data solutions.
- Automate data pipeline deployment and monitoring.
Qualifications :
Bachelor's degree in Computer Science or a related : 3-8 years of experience in data engineering or application development.Strong understanding of ETL concepts and data warehousing principles.Proficiency in Python and Spark.Hands-on experience with AWS Glue, including Glue Data Catalog, Glue ETL, and Glue Crawlers.Experience with other AWS services such as S3, Redshift, Athena, Lambda, and IAM.Experience with SQL and relational databases (e.g., MySQL, PostgreSQL).Experience with data modeling and schema design.Experience with data quality and data governance principles.Experience with version control systems (e.g., Git).Excellent problem-solving and analytical skills.Strong communication and collaboration skills.Preferred Qualifications :
AWS Certified Developer or AWS Certified Solutions Architect certification.Experience with data visualization tools (e.g., Tableau, Power BI).Experience with DevOps practices and tools (e.g., Jenkins, Terraform).Experience with big data technologies (e.g., Hadoop, Hive).Experience with NoSQL databases (e.g., MongoDB, Cassandra).(ref : hirist.tech)