SecureKloud Technologies - Senior Data Engineer - ETL / Talend

About the Role :

We are seeking a highly skilled Senior Data Engineer to join our dynamic team. In this role, you will be instrumental in designing, building, and maintaining scalable, efficient, and reliable data pipelines and solutions. You will work closely with cross-functional teams to enable data-driven decision-making by ensuring the availability, accuracy, and performance of data infrastructure.

Key Responsibilities :

• Design, develop, and maintain scalable ETL / ELT data pipelines for batch and near real-time processing using tools such as Talend, AWS Glue, Lambda, and SQS.
• Develop and optimize SQL queries and perform data modeling, cleansing, transformation, and validation to ensure data quality and accuracy.
• Write efficient, reusable, and scalable ETL scripts primarily using Python, PySpark, and SQL. Utilize AWS SDK for Python (Boto3) for automation and integration with AWS services.
• Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver actionable insights.
• Build and orchestrate workflows using Talend and AWS Step Functions to automate complex data processes.
• Monitor and troubleshoot data pipelines and infrastructure using AWS CloudWatch and other monitoring tools to ensure optimal performance and availability.
• Implement best practices for data security, access control (using AWS IAM), and compliance in cloud environments.
• Participate in the design and architecture of data storage solutions using AWS services such as S3, Redshift, DynamoDB, and EC2.
• Stay current with emerging technologies and industry trends, recommending and implementing improvements to our data engineering practices.
• Mentor junior data engineers and contribute to team knowledge sharing.

Required Skills & Technologies :

Cloud Platforms & Services :

Compute and networking :

Messaging and orchestration :

Programming & Scripting :

ETL & Workflow Orchestration :

(ref : hirist.tech)