Sr. Software Engineer

Job Title : Senior Data Engineer – Pyspark | AWS Lambda | AWS Glue | Snowflake

Experience Required : 5 to 9 years

Location : Remote

Joining Timeline : Immediate to 20 Days

Job Summary :

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Pyspark , AWS Lambda , AWS Glue , and Snowflake . The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring seamless data integration and transformation across platforms, and delivering high-performance solutions in a cloud-native environment.

This is a remote position , open only to candidates who can join immediately or within 15 days .

Key Responsibilities :

Design, build, and maintain robust and scalable ETL / ELT pipelines using AWS Glue and AWS Lambda .

Integrate and manage Pyspark-based solutions , ensuring secure and compliant data flow.

Work with large datasets and implement complex data transformation logic within AWS and Snowflake environments.

Optimize Snowflake queries, warehouse performance, and data architecture.

Automate data ingestion, cleansing, transformation, and loading processes.

Monitor and troubleshoot data pipeline failures and performance issues.

Collaborate with cross-functional teams including data analysts, data scientists, and DevOps.

Ensure adherence to data governance, quality, and security standards.

Provide technical leadership and mentorship to junior data engineers as needed.

Required Skills & Qualifications :

5 to 9 years of overall experience in data engineering and cloud-based data solutions.

Hands-on expertise in Payspark platform and integrations.

Strong experience with AWS Glue (Job creation, Crawlers, Catalog, PySpark / Scala scripts).

Solid knowledge of AWS Lambda for serverless compute and data automation.

Proven expertise in Snowflake (data modeling, performance tuning, secure data sharing, etc.).

Proficient in SQL, Python , and working knowledge of PySpark or Scala .

Experience with CI / CD practices for data pipelines (e.g., using Git, CodePipeline, or similar tools).

Excellent problem-solving skills and the ability to work independently in a remote setup.

Good to Have :

Exposure to AWS services such as S3, Athena, Redshift, CloudWatch, Step Functions.

Familiarity with data security and compliance best practices (e.g., GDPR, HIPAA).

Experience with Agile / Scrum methodologies.

Employment Type : Full-time : Remote

Notice Period : Immediate Joiners preferred or maximum 15 days .

How to Apply : share it to mkore1@intraedge.com