This job offer is not available in your country.

Software Engineer-(AWS Databricks +Mongo DB) (Full-time at a Fortune 500 tech MNC)

HARPdelhi, delhi, in

1 day ago

Job description

Job Description

Profile Summary

Data Engineer with 5 years of experience in Big Data technologies.
Proven expertise in designing and developing scalable data pipelines using Apache Spark and PySpark.
Proficient in Python programming.
Hands-on experience with Databricks, MongoDB, Docker, and Kubernetes.
Solid understanding of DevOps practices and tools.

Primary Skills

Design, develop, and maintain scalable and reliable data pipelines.

Translate business requirements and data models into efficient ETL code.

Work independently on Spark-based data processing workflows.

Skilled in writing complex business logic using PySpark and Spark SQL.

Strong understanding of Spark clusters, distributed computing, and parallel processing.

Capable of writing unit test cases to validate ETL logic.

Experience in building reusable functions and applying modular programming approaches.

Worked with AWS Athena for table creation, indexing, and writing complex SQL queries.

Experience working with both relational databases (e.g., Oracle, SQL Server) and NoSQL databases (e.g., MongoDB) for data extraction and loading.

Secondary Skills

Experience in creating AWS IAM roles and defining access policies.

Familiar with Docker image creation and customization.

Experience with Camunda for workflow orchestration and automation.

Additional Expectations

Strong communication skills.

Proficient in troubleshooting and problem-solving.

Demonstrates a continuous learning mindset.

Focused on automating manual tasks through coding wherever feasible.

Technical Skills

Mandatory Skills :

Python for Data, Apache Spark, Java, Python, Scala, Spark SQL, Databricks

Create a job alert for this search

Software • delhi, delhi, in

Related jobs

Promoted

Cloud Engineer Lead (AWS)

Datapel SystemsMeerut, IN

The Senior Cloud Engineer (AWS) will be responsible for developing, maintaining, optimising and supporting the cloud infrastructure that supports Datapel’s Warehouse Management System (WMS) and rel...Show moreLast updated: 25 days ago

Promoted

Sr. Software Engineer

IntraEdgegurugram, uttar pradesh, in

Senior Data Engineer – Pyspark | AWS Lambda | AWS Glue | Snowflake.The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring seamless data integration a...Show moreLast updated: 1 day ago

Promoted

Senior Software Engineer

CredHiveDelhi, India, India

We are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry.Our team consists of experts in machine learning and software engineers who have ...Show moreLast updated: 6 days ago

Promoted

Platform Engineer - Docker / Kubernetes

D Square Consulting Services Pvt. Ltd.Delhi, IN

Remote

Platform Engineer Working Model : Remote Duration : 3 to 6 Months Experience Required : 5 to 6 years &l...Show moreLast updated: 12 days ago

Promoted

Cloud Engineer

RAVSoft Solutions Inc.gurugram, uttar pradesh, in

Job Title : Mid-Level AWS Cloud Engineer (AWS Lambda + TypeScript).You will be responsible for building scalable, secure, and high-performance backend systems and infrastructure that power our core ...Show moreLast updated: 15 days ago

Promoted

AWS Cloud Engineer

ProgliteMeerut, IN

Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 15 days ago

Promoted

AWS Support Engineer

BirlasoftNoida, Uttar Pradesh, India

Experience with AWS Services, RDS, Aurora, VPC, IAM.Experience with database PostgreSQL, MySQL and Oracle.Experience in Maintaining documentation for operational processes, runbooks, and SOPs.Exper...Show moreLast updated: 2 days ago

Promoted
New!

Data Engineer ( AWS / Azure)

Natlov Technologies Pvt LtdDelhi, India, India

Location : Remote | Shift : 6 PM – 3 AM IST.Build and optimize scalable data pipelines & models.Ensure data quality, security, and performance. Collaborate across teams & mentor juniors.Work with mode...Show moreLast updated: 15 hours ago

Promoted

Data Platform Engineer - AWS SysOps

True Tech ProfessionalsGurgaon

About The Role : We are seeking a skilled Data Platform Engineer with strong expertise in AWS SysOps, Data Migration Service (DMS), data p...Show moreLast updated: 30+ days ago

Promoted

Senior DevOps Engineer - Azure / AWS

HR Huddle ConsutancyGurugram

Requirements : - Minimum 5+ years of experience in DevOps roles managing production-grade systems - Implement CI / CD pipelines using Jenkins, GitH...Show moreLast updated: 30+ days ago

Promoted

Senior DevOps Engineer - Azure / AWS

FinJoGurugram

Requirements : - Minimum 5+ years of experience in DevOps roles managing production-grade systems.Implement CI / CD pipelines using Jenkins, GitHub Actions, CircleCI, o...Show moreLast updated: 30+ days ago

Promoted

Senior Software Engineer - Full Stack Development

IronPeak Staffing SolutionsGurgaon

About KwikMedi : KwikMedi is a fast-growing health-tech startup on a mission to revolutionize healthcare delivery in India. We ensure medicines are delivered within 3...Show moreLast updated: 28 days ago

Promoted

Amazatic - DevOps Engineer - AWS Platform

AMAZATIC SOLUTIONS LLPGurugram

Job Title : DevOps Engineer Location : Gurgaon, Pune (Hybrid) Experience : 5 to 8 yrs ...Show moreLast updated: 8 days ago

Promoted

Cloud Engineer AWS

Tata Consultancy ServicesDelhi, India, India

Required Technical Skill Set - Excellent knowledge of VPC, AWS Direct Connect, AWS's utility computing services (such as Amazon Elastic Compute Cloud (EC2), Amazon Simple Storage Service (S3), Amaz...Show moreLast updated: 12 days ago

Promoted

AWS DevOps Engineer

TRDFIN Support Services Pvt LtdGurugram, Haryana, India

We are looking for a highly skilled AWS DevOps Engineer with strong expertise in building, automating, and managing cloud-native applications and infrastructure. The ideal candidate should have prov...Show moreLast updated: 6 days ago

Promoted

Freight Tiger - DevOps Engineer - AWS

Freight TigerGurugram

DevOps Engineer As a DevOps Engineer at Freight Tiger, you will play a crucial role in managing and enhancing our cloud infrastructure. You will work closely with cros...Show moreLast updated: 30+ days ago

Promoted

Senior Cloud Engineer AWS

Matrix USAMeerut, IN

We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 12 days ago

Promoted

AWS Lead Engineer - Terraform / Kubernetes

Jigya Software Services (P) LtdDelhi, IN

Experience : 9+ years Location : Remote Skills Required : Terraform ,AWS Services ,CloudWatch, DNS, Application Load Balancer, CICD PIEPLINE, <...Show moreLast updated: 12 days ago

Promoted

Software Engineer-(AWS Databricks +Mongo DB) (Full-time at a Fortune 500 tech MNC)

HARPMeerut, IN

Data Engineer with 5 years of experience in Big Data technologies.Proven expertise in designing and developing scalable data pipelines using Apache Spark and PySpark. Proficient in Python programmin...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer - AWS / Python

TGS The Global SkillsNew Delhi,Delhi

Responsibilities : - Hands on experience in data related activities such as data parsing, cleansing quality definition data pipe...Show moreLast updated: 30+ days ago