This job offer is not available in your country.

Software Engineer-(AWS Databricks +Mongo DB) (Full-time at a Fortune 500 tech MNC)

HARPchennai, tamil nadu, in

1 day ago

Job description

Job Description

Profile Summary

Data Engineer with 5 years of experience in Big Data technologies.
Proven expertise in designing and developing scalable data pipelines using Apache Spark and PySpark.
Proficient in Python programming.
Hands-on experience with Databricks, MongoDB, Docker, and Kubernetes.
Solid understanding of DevOps practices and tools.

Primary Skills

Design, develop, and maintain scalable and reliable data pipelines.

Translate business requirements and data models into efficient ETL code.

Work independently on Spark-based data processing workflows.

Skilled in writing complex business logic using PySpark and Spark SQL.

Strong understanding of Spark clusters, distributed computing, and parallel processing.

Capable of writing unit test cases to validate ETL logic.

Experience in building reusable functions and applying modular programming approaches.

Worked with AWS Athena for table creation, indexing, and writing complex SQL queries.

Experience working with both relational databases (e.g., Oracle, SQL Server) and NoSQL databases (e.g., MongoDB) for data extraction and loading.

Secondary Skills

Experience in creating AWS IAM roles and defining access policies.

Familiar with Docker image creation and customization.

Experience with Camunda for workflow orchestration and automation.

Additional Expectations

Strong communication skills.

Proficient in troubleshooting and problem-solving.

Demonstrates a continuous learning mindset.

Focused on automating manual tasks through coding wherever feasible.

Technical Skills

Mandatory Skills :

Python for Data, Apache Spark, Java, Python, Scala, Spark SQL, Databricks

Create a job alert for this search

Software • chennai, tamil nadu, in

Related jobs

Promoted

Cloud Engineer

DBiz.aiChennai, IN

We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services.The ideal candidate wil...Show moreLast updated: 15 days ago

Promoted

L1 Cloud Engineer - Azure / AWS

Cynosure Corporate SolutionsChennai

About the Role : We are seeking an experienced Cloud Engineer to manage, monitor, and optimize AWS and Azure environments, ensuring high availability, scalability, a...Show moreLast updated: 30+ days ago

Promoted

Cloud Engineer Lead (AWS)

Datapel SystemsChennai, IN

The Senior Cloud Engineer (AWS) will be responsible for developing, maintaining, optimising and supporting the cloud infrastructure that supports Datapel’s Warehouse Management System (WMS) and rel...Show moreLast updated: 26 days ago

Promoted

Data Engineer

LTIMindtreeChennai, Tamil Nadu, India

We are hiring for AWS Data Engineer.Notice period - immediate to 30 days.Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and impl...Show moreLast updated: 24 days ago

Promoted

Full Stack Engineer

HyqooChennai, IN

Design, develop, and maintain responsive, high-quality frontend applications using.Collaborate with backend teams to integrate APIs and ensure smooth data flow. Build reusable, testable, and efficie...Show moreLast updated: 1 day ago

Promoted

Software Engineer-(AWS Databricks +Mongo DB) (Full-time at a Fortune 500 tech MNC)

HARPChennai, IN

Data Engineer with 5 years of experience in Big Data technologies.Proven expertise in designing and developing scalable data pipelines using Apache Spark and PySpark. Proficient in Python programmin...Show moreLast updated: 1 day ago

Promoted

AWS DevOps Engineer

TRDFIN Support Services Pvt LtdChennai, Tamil Nadu, India

We are looking for a highly skilled AWS DevOps Engineer with strong expertise in building, automating, and managing cloud-native applications and infrastructure. The ideal candidate should have prov...Show moreLast updated: 6 days ago

Promoted

Cloud Engineer

CBTSChennai, Tamil Nadu, India

Cloud Application Development : Develop, deploy, and manage cloud applications with a focus on scalability, performance, and security in AWS environments. Technical Leadership : Provide technical dire...Show moreLast updated: 30+ days ago

Promoted

Sr. Software Engineer

IntraEdgechennai, tamil nadu, in

Senior Data Engineer – Pyspark | AWS Lambda | AWS Glue | Snowflake.The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring seamless data integration a...Show moreLast updated: 1 day ago

Promoted

Senior Software Engineer

AtomicAdschennai, tamil nadu, in

We are seeking a highly skilled Software Development Engineer (SDE) to join our dynamic engineering team.In this role, you will contribute to building and maintaining scalable, high-performance app...Show moreLast updated: 1 day ago

Promoted

AWS Open Search development Engineer

AXISCADESChennai, Tamil Nadu, India

Company Profile : AXISCADES is a leading, end to end engineering solutions and product company.We bring expertise that caters to the digital, engineering, and smart manufacturing needs of large en...Show moreLast updated: 15 days ago

Promoted

AmpsTek - AWS Data Engineer

AmpstekChennai

Job Role : AWS Data Location : Chennai / Bangalore / Hyderabad / Pune (Hybrid) Key Skills : A...Show moreLast updated: 30+ days ago

Promoted

AWS Cloud Engineer

ProgliteChennai, IN

Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 15 days ago

Promoted

Cloud Engineer

RAVSoft Solutions Inc.Chennai, Tamil Nadu, India

Job Title : Mid-Level AWS Cloud Engineer (AWS Lambda + TypeScript).You will be responsible for building scalable, secure, and high-performance backend systems and infrastructure that power our core ...Show moreLast updated: 15 days ago

Promoted

Senior Cloud Engineer AWS

Matrix USAChennai, IN

We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 12 days ago

Promoted

AWS Engineer III - Cloud Apps

Sampoorna Consultants Pvt. LtdChennai

Job Description : - Cloud Application Development : Develop, deploy, and manage cloud applications with a focus on scalability, performance, and security in AWS envir...Show moreLast updated: 13 days ago

Promoted

AWS Engineer

The AES GroupChennai, Tamil Nadu, India

PM – IST – UK based Shift timings.Hybrid (2 days WFO at DLF, Rama Puram).We are seeking a highly skilled.This role involves designing and deploying Azure environments, collaborating across teams, a...Show moreLast updated: 12 days ago

Promoted

Senior Java Software Engineer plus AWS

Automotive Robotics Ind Private LimitedChennai, Tamil Nadu, India

Please Share updates CV to dpeddolla@arigs.Experience in designing and consuming.Show moreLast updated: 30+ days ago

Promoted

Cloud Engineer

ValueMomentumchennai, tamil nadu, in

We are seeking a highly skilled.You will work closely with development, operations, and security teams to ensure continuous delivery, high availability, and optimal performance of our applications....Show moreLast updated: 14 days ago

Promoted

AWS Cloud Engineer - Terraform

People Prime World WideChennai

Key Responsibilities : - Design, implement, and manage cloud infrastructure using AWS and Terraform.Develop and maintain configuration ma...Show moreLast updated: 30+ days ago