This job offer is not available in your country.

Software Engineer-(AWS Databricks +Mongo DB) (Full-time at a Fortune 500 tech MNC)

HARPindore, madhya pradesh, in

1 day ago

Job description

Job Description

Profile Summary

Data Engineer with 5 years of experience in Big Data technologies.
Proven expertise in designing and developing scalable data pipelines using Apache Spark and PySpark.
Proficient in Python programming.
Hands-on experience with Databricks, MongoDB, Docker, and Kubernetes.
Solid understanding of DevOps practices and tools.

Primary Skills

Design, develop, and maintain scalable and reliable data pipelines.

Translate business requirements and data models into efficient ETL code.

Work independently on Spark-based data processing workflows.

Skilled in writing complex business logic using PySpark and Spark SQL.

Strong understanding of Spark clusters, distributed computing, and parallel processing.

Capable of writing unit test cases to validate ETL logic.

Experience in building reusable functions and applying modular programming approaches.

Worked with AWS Athena for table creation, indexing, and writing complex SQL queries.

Experience working with both relational databases (e.g., Oracle, SQL Server) and NoSQL databases (e.g., MongoDB) for data extraction and loading.

Secondary Skills

Experience in creating AWS IAM roles and defining access policies.

Familiar with Docker image creation and customization.

Experience with Camunda for workflow orchestration and automation.

Additional Expectations

Strong communication skills.

Proficient in troubleshooting and problem-solving.

Demonstrates a continuous learning mindset.

Focused on automating manual tasks through coding wherever feasible.

Technical Skills

Mandatory Skills :

Python for Data, Apache Spark, Java, Python, Scala, Spark SQL, Databricks

Create a job alert for this search

Software • indore, madhya pradesh, in

Related jobs

Promoted

Senior Software Engineer

WiseEngage Private Limitedindore, madhya pradesh, in

We are seeking a highly skilled Senior Software Engineer to execute our strategy preferably experienced in.Financial Services / Procurement domain. SaaS platform using latest technologies like.ReactJS...Show moreLast updated: 1 day ago

Promoted

Cloud Engineer Lead (AWS)

Datapel Systemsindore, madhya pradesh, in

The Senior Cloud Engineer (AWS) will be responsible for developing, maintaining, optimising and supporting the cloud infrastructure that supports Datapel’s Warehouse Management System (WMS) and rel...Show moreLast updated: 26 days ago

Promoted

Cloud Engineer

DBiz.aiindore, madhya pradesh, in

We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services.The ideal candidate wil...Show moreLast updated: 16 days ago

Promoted

Infrastructure Engineer (AWS & Typescript)

Crossing Hurdlesindore, madhya pradesh, in

AWS CDK + TypeScript - Infrastructure Engineer.We are seeking an experienced Infrastructure Engineer specializing in AWS CDK and TypeScript to design, develop, and maintain scalable cloud infrastru...Show moreLast updated: 3 days ago

Promoted

Sr. Software Engineer

IntraEdgeindore, madhya pradesh, in

Senior Data Engineer – Pyspark | AWS Lambda | AWS Glue | Snowflake.The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring seamless data integration a...Show moreLast updated: 1 day ago

Promoted

Full Stack Engineer

Somnetics (Som Imaging Informatics Pvt. Ltd.)indore, madhya pradesh, in

Remote | 🕒 Full-time | 💼 3–7 Years.Docker, CI / CD pipelines, Git workflows.Bonus : AI / ML integration (OpenAI, Google Gemini), Shopify / HubSpot APIs, monitoring (Prometheus / Grafana).OpenAI, Google Ge...Show moreLast updated: 1 day ago

Promoted

Data Engineer(Azure / AWS, Python / Pyspark, SQL)

Sail Analyticsindore, madhya pradesh, in

Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 1 day ago

Promoted

Senior Software Engineer

Integrated Wireless Solutionsindore, madhya pradesh, in

Skills - Java + React + Docker + Kubernetes + RDBMS + NOSQL + Cloud (Azure / AWS).We are seeking a highly skilled and experienced Tech Lead (Full-Stack) to join our dynamic and innovative team.As a T...Show moreLast updated: 1 day ago

Promoted

Senior Cloud Engineer AWS

Matrix USAindore, madhya pradesh, in

We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 12 days ago

Promoted

Senior Software Engineer

Tech Mahindraindore, madhya pradesh, in

Key Skillsets : NET Core with C#, Data Access with Entity Framework, LINQ, T-SQL and Asynchronous programming skills with multithreading and optimization. Experience in programming in handling high-v...Show moreLast updated: 1 day ago

Promoted

AWS Full Stack Lead Developer

ThoughtStormindore, madhya pradesh, in

Senior AWS Full Stack Developer.The role involves designing and developing scalable cloud-native applications, automating deployments, and enabling seamless integrations across enterprise systems.L...Show moreLast updated: 1 day ago

Promoted

AWS Cloud Engineer

Progliteindore, madhya pradesh, in

Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 15 days ago

Promoted

Senior Software Engineer

AtomicAdsindore, madhya pradesh, in

We are seeking a highly skilled Software Development Engineer (SDE) to join our dynamic engineering team.In this role, you will contribute to building and maintaining scalable, high-performance app...Show moreLast updated: 1 day ago

Promoted

Cloud Engineer

Strobes Security, Inc.indore, madhya pradesh, in

We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure. This role requires a strong background in AWS ser...Show moreLast updated: 30+ days ago

Promoted

Cloud Engineer

RAVSoft Solutions Inc.indore, madhya pradesh, in

Job Title : Mid-Level AWS Cloud Engineer (AWS Lambda + TypeScript).You will be responsible for building scalable, secure, and high-performance backend systems and infrastructure that power our core ...Show moreLast updated: 16 days ago

Promoted

Data Engineer

Bahwan CyberTekindore, madhya pradesh, in

We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 25 days ago

Promoted

Cloud Engineer

ValueMomentumindore, madhya pradesh, in

We are seeking a highly skilled.You will work closely with development, operations, and security teams to ensure continuous delivery, high availability, and optimal performance of our applications....Show moreLast updated: 15 days ago

Promoted

Senior Full-Stack Java Engineer - AWS Lambda / AngularJS - Full Remote - Contractor in USD

All European Careersindore, madhya pradesh, in

Remote

For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Full-Stack Java Developer with AWS Lambda and AngularJS experience.You will modernize and ...Show moreLast updated: 1 day ago