AWS Databricks + Mongo DB ( Full-time at a Fortune 500 tech MNC )
HARPthane, India1 day ago
Job descriptionApache Spark , PySpark , Spark SQL Databricks Python (for Data Engineering use cases) Relational Databases : Oracle, SQL Server NoSQL : MongoDB Big Data Architecture and scalable pipeline design Java or Scala (good to have) AWS IAM : Role and policy creation Docker : Image creation and container management Camunda : Workflow orchestration and process management Kubernetes : Container orchestration (good to have)
JOB DESCRIPTION / REQUIREMENT
Role Overview :
We are looking for a Senior Data Engineer with 5+ years of experience in Big Data technologies . The ideal candidate will have strong hands-on experience in Spark , PySpark , and Databricks , and be capable of building scalable and reliable data pipelines. Knowledge of DevOps practices and containerization tools is a plus.
Primary Responsibilities :
- Develop and maintain scalable data pipelines for large-scale data processing.
- Translate business requirements into technical specifications and efficient ETL code.
- Work independently to develop and optimize Spark / PySpark pipelines.
- Write complex business logic using PySpark and Spark SQL.
- Understand and manage Spark clusters and parallel data processing.
- Develop unit tests for ETL components to ensure data integrity and quality.
- Build modular, reusable code functions to streamline development.
- Work with Athena : create tables, indexes, and write complex SQL queries.
- Integrate data from relational databases (Oracle, SQL Server) and NoSQL databases (e.g., MongoDB).
Technical Skills Required (Primary) :
Secondary / Desirable Skills :
Create a job alert for this search
Db • thane, India
Related jobs
- Promoted
AWS Cloud Engineer (Terraform Experts)
Saradysol Tech Ventures Private LimitedKalyan-Dombivli, IN AWS Cloud Engineer (Terraform Experts).Saradysol Tech Ventures Private Limited.Saradysol Tech Ventures Private Limited is a leading technology solutions provider, dedicated to delivering exceptiona...Show moreLast updated: 1 day ago
- Promoted
Data Engineer – Azure & AWS
Yoda Techthane, maharashtra, in We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms.
The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 4 days ago
- Promoted
Collinson Group - Lead Data Engineer - AWS Platform
Collinson Loyalty & Benefits Private Limited”Mumbai Description : - Design, develop and maintain data pipelines for collecting, transforming and loading data into various data stores.
Build and maintain data warehousing...Show moreLast updated: 26 days ago
- Promoted
AIOps Engineer - AWS / Azure Platfrom
NovoTree MindsMumbai Job Description : - Implement and manage AIOps platforms for intelligent monitoring, alerting, anomaly detection, and root cause analysis (RCA).Pos...Show moreLast updated: 30+ days ago
- Promoted
AWS Technical Manager
CBTSnavi mumbai, maharashtra, in CBTS’ Enterprise Service Delivery Center is expanding our Cloud Services Operation and looking to add a Senior AWS Cloud Architect.
This role can be performed remotely from inside the Continental US...Show moreLast updated: 4 days ago
- Promoted
PibyThree - AWS Cloud Engineer
PibyThreeNavi Mumbai Job Responsibilities : - Reviewing infra-architecture of application against well architected framework.Design and execute the overall strategic roadmap for the cloud...Show moreLast updated: 30+ days ago
- Promoted
Senior AWS Cloud Developer - DevOps
Nvent.comMumbai About the job : Were looking for people who put their innovation to work to advance our success and their own.Join an organization that en...Show moreLast updated: 30+ days ago
- Promoted
AWS Database Eng
Tata Consultancy Servicesthane, maharashtra, in Desired Competencies (Technical / Behavioral Competency).Should have expertise in creating data warehouses in AWS utilizing the following tools : EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake....Show moreLast updated: 4 days ago
- Promoted
Cloud Consultant
Mastekthane, maharashtra, in We need an experienced AWS Data Engineer / Performance Optimization Consultant to help us analyze, tune, and optimize our existing AWS Glue ETL, Step Functions workflows and Amazon Redshift data wa...Show moreLast updated: 3 days ago
- Promoted
AWS Engineer
Spryc SystemsKalyan-Dombivli, IN We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment.
The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 4 days ago
- Promoted
Senior Data Engineer with AWS_ Exp : 6+ Years
Atyeti IncThane, IN Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 3 days ago
- Promoted
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Incthane, maharashtra, in Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 3 days ago
- Promoted
AWS Cloud Engineer
ProgliteThane, IN Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments.
Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago
- Promoted
Senior Cloud IAM Engineer (AWS / Okta)
Vertex AgilityMumbai, IN Senior Cloud IAM Engineer (AWS / Okta) – Remote.Vertex Agility | Agile On-Demand Solutions.Are you passionate about identity management and cloud security? Vertex Agility is looking for a Senior Cl...Show moreLast updated: 4 days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicesmumbai city, maharashtra, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 12 days ago
- Promoted
Cloud Engineer - AWS
Hrizen techno servicesMumbai Description : Responsibilities : - Design and implement secure, scalable, and highly available infrastructure ...Show moreLast updated: 30+ days ago
- Promoted
AWS Databricks + Mongo DB ( Full-time at a Fortune 500 tech MNC )
HARPThane, IN The ideal candidate will have strong hands-on experience in.Knowledge of DevOps practices and containerization tools is a plus.
Develop and maintain scalable data pipelines for large-scale data proc...Show moreLast updated: 1 day ago
- Promoted
Cloud Engineer (AWS, Azure)
BPMLinksdombivli, maharashtra, in Job Description – Cloud Engineer (AWS, Azure, Snowflake) : .We are looking for a skilled Cloud Engineer to take ownership of the existing multi-cloud infrastructure and data integration setup.Manage ...Show moreLast updated: 2 days ago