This job offer is not available in your country.

Software Engineer-(AWS Databricks +Mongo DB) (Full-time at a Fortune 500 tech MNC)

HARPThiruvananthapuram, IN

7 days ago

Job description

Job Description

Profile Summary

Data Engineer with 5 years of experience in Big Data technologies.
Proven expertise in designing and developing scalable data pipelines using Apache Spark and PySpark.
Proficient in Python programming.
Hands-on experience with Databricks, MongoDB, Docker, and Kubernetes.
Solid understanding of DevOps practices and tools.

Primary Skills

Design, develop, and maintain scalable and reliable data pipelines.

Translate business requirements and data models into efficient ETL code.

Work independently on Spark-based data processing workflows.

Skilled in writing complex business logic using PySpark and Spark SQL.

Strong understanding of Spark clusters, distributed computing, and parallel processing.

Capable of writing unit test cases to validate ETL logic.

Experience in building reusable functions and applying modular programming approaches.

Worked with AWS Athena for table creation, indexing, and writing complex SQL queries.

Experience working with both relational databases (e.g., Oracle, SQL Server) and NoSQL databases (e.g., MongoDB) for data extraction and loading.

Secondary Skills

Experience in creating AWS IAM roles and defining access policies.

Familiar with Docker image creation and customization.

Experience with Camunda for workflow orchestration and automation.

Additional Expectations

Strong communication skills.

Proficient in troubleshooting and problem-solving.

Demonstrates a continuous learning mindset.

Focused on automating manual tasks through coding wherever feasible.

Technical Skills

Mandatory Skills :

Python for Data, Apache Spark, Java, Python, Scala, Spark SQL, Databricks

Create a job alert for this search

Software • Thiruvananthapuram, IN

Related jobs

Promoted

Full Stack Engineer

Somnetics (Som Imaging Informatics Pvt. Ltd.)kollam, kerala, in

Remote | 🕒 Full-time | 💼 3–7 Years.Docker, CI / CD pipelines, Git workflows.Bonus : AI / ML integration (OpenAI, Google Gemini), Shopify / HubSpot APIs, monitoring (Prometheus / Grafana).OpenAI, Google Ge...Show moreLast updated: 6 days ago

Promoted

Senior Software Engineer

BrightEdgeThiruvananthapuram, IN

Senior Software Engineer, Remote.The Software Engineer, Data Ingestion will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust ...Show moreLast updated: 12 days ago

Promoted

Infrastructure Engineer (AWS & Typescript)

Crossing HurdlesKollam, IN

AWS CDK + TypeScript - Infrastructure Engineer.We are seeking an experienced Infrastructure Engineer specializing in AWS CDK and TypeScript to design, develop, and maintain scalable cloud infrastru...Show moreLast updated: 9 days ago

Promoted

Full Stack Engineer

AideWiser SolTekThiruvananthapuram, IN

AWS (EC2, Lambda, S3, RDS, DynamoDB, etc.Design, develop, and maintain backend services using.Net Core / MVC and frontend components using React. Build and scale backend systems on AWS cloud infrastru...Show moreLast updated: 30+ days ago

Promoted

Principal Software Engineer

CoinbaseThiruvananthapuram, IN

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 30+ days ago

Promoted

Senior Java Software Engineer

ACL DigitalThiruvananthapuram, IN

We are looking Remotly for Senior Java Developer for our offiice.Designation : Senior Java Developer.Experience : 5 Years to 8 Years. Notice Period : Immediate(Next Day joiner only).Design, implement, ...Show moreLast updated: 6 days ago

Promoted

Cloud Engineer

RAVSoft Solutions Inc.kollam, kerala, in

Job Title : Mid-Level AWS Cloud Engineer (AWS Lambda + TypeScript).You will be responsible for building scalable, secure, and high-performance backend systems and infrastructure that power our core ...Show moreLast updated: 21 days ago

Promoted

Cloud Engineer

DBiz.aiKollam, IN

We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services.The ideal candidate wil...Show moreLast updated: 21 days ago

Promoted

Cloud Engineer

Strobes Security, Inc.Thiruvananthapuram, IN

We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure. This role requires a strong background in AWS ser...Show moreLast updated: 30+ days ago

Promoted

Senior Full Stack SDE with Data Engineering for Analytics

TruckmentumThiruvananthapuram, IN

Truckmentum is seeking a Senior Full Stack Software Development Engineer (SDE) with deep data engineering experience to help us build cutting-edge software and data infrastructure for our AI-driven...Show moreLast updated: 30+ days ago

Promoted

AWS Cloud Engineer

ProgliteKollam, IN

Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 21 days ago

Promoted

Cloud Engineer

EXLThiruvananthapuram, IN

We're looking for a highly skilled and experienced Cloud AI Engineer to join our dynamic team.In this role, you'll be instrumental in designing, developing, and deploying cutting-edge artificial in...Show moreLast updated: 13 days ago

Promoted

Senior Data Engineer

The Mastermind GroupThiruvananthapuram, IN

Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG). Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago

Promoted

Senior Software Engineer

EvlvThiruvananthapuram, IN

Sector : IT & Services Consulting.Location : Permanent Work From Home (Anywhere in India).Duration : 1-Year - Renewable Contract. Working Hours : Monday to Friday, Eastern Standard Time Zone.Our client ...Show moreLast updated: 7 days ago

Promoted

Sr. Software Engineer

IntraEdgethiruvananthapuram, kerala, in

Senior Data Engineer – Pyspark | AWS Lambda | AWS Glue | Snowflake.The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring seamless data integration a...Show moreLast updated: 6 days ago

Promoted

Cloud Engineer Lead (AWS)

Datapel SystemsKollam, IN

The Senior Cloud Engineer (AWS) will be responsible for developing, maintaining, optimising and supporting the cloud infrastructure that supports Datapel’s Warehouse Management System (WMS) and rel...Show moreLast updated: 30+ days ago

Promoted

Senior Cloud Engineer AWS

Matrix USAThiruvananthapuram, IN

We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 18 days ago

Promoted

Sr. Fullstack engineer

Relevance LabKollam, IN

Design, develop, and maintain our AI Agents platform using Python, FastAPI, React, and TypeScript.Collaborate with cross-functional teams, including product managers, designers, and backend enginee...Show moreLast updated: 30+ days ago

Promoted

Full Stack Engineer

Vista Applied Solutions Group IncKollam, IN

Please find the below Job Description.Senior Full-Stack Python Engineer (Snowflake Cortex : AI / Analyst / Search)0.Strong Python (FastAPI / Django), building REST / GraphQL APIs. Front-end with React; UI in...Show moreLast updated: 7 days ago

Promoted

Senior Software Engineer

Ubique SystemsThiruvananthapuram, IN

Strong expertise in React & Golang development.Hands-on experience with Stripe, PayPal, Braintree, or similar payment processing tools. Proven ability to design & scale secure payment systems (PCI-D...Show moreLast updated: 7 days ago