AWS Databricks Engineer

ConfidentialMumbai

4 days ago

Job description

Software Development :

Design, develop, test, and deploy high-performance and scalable data solutions using Python, PySpark, SQL
Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
Implement efficient and maintainable code using best practices and coding standards.

AWS & Databricks Implementation :

Work with Databricks platform for big data processing and analytics.

Develop and maintain ETL processes using Databricks notebooks.

Implement and optimize data pipelines for data transformation and integration.

Utilize AWS services (e.g., S3, Glue, Redshift, Lambda) and Databricks to build and optimize data migration pipelines.

Leverage PySpark for large-scale data processing and transformation tasks.

Continuous Learning :

Stay updated on the latest industry trends, tools, and technologies related to Python, SQL, and Databricks.

Share knowledge with the team and contribute to a culture of continuous improvement.

SQL Database Management :

Utilize expertise in SQL to design, optimize, and maintain relational databases.

Write complex SQL queries for data retrieval, manipulation, and analysis.

Qualifications & Skills :

Education : Bachelors degree in Computer Science, Engineering, Data Science, or a related field. Advanced degrees are a plus.

4 to 8 Years of experience in Databricks and big data frameworks

Proficient in AWS services and data migration

Experience in Unity Catalogue

Familiarity with Batch and real time processing

Data engineering with strong skills in Python, PySpark, SQL

Certifications : AWS Certified Solutions Architect, Databricks Certified Professional, or similar are a plus.

Soft Skills :

Strong problem-solving and analytical skills.

Excellent communication and collaboration abilities.

Ability to work in a fast-paced, agile environment.

Skills Required

Aws, Databricks, Spark, Python, Sql, Etl

Create a job alert for this search

Aws Engineer • Mumbai

Related jobs

Promoted

Collinson Group - Lead Data Engineer - AWS Platform

Collinson Loyalty & Benefits Private Limited”Mumbai

Description : - Design, develop and maintain data pipelines for collecting, transforming and loading data into various data stores. Build and maintain data warehousing...Show moreLast updated: 23 days ago

Promoted

Senior Data Engineer - Snowflake / AWS

ResourcetreeMumbai

About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 28 days ago

Promoted

AWS Cloud Engineer

ProgliteMumbai, IN

Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago

Senior AWS Data Engineer

Epergne SolutionsMumbai, Maharashtra, India

Quick Apply

Immediate / 10 Days To 15 days NP.The ideal candidate should have a solid background in data engineering, strong programming skills, and deep experience working with AWS cloud services.Optimize and...Show moreLast updated: 22 days ago

Promoted

LafargeHolcim - AWS Data Engineer

LafargeHolcimNavi Mumbai

Position : AWS Data Engineer Experience : 4 - 8 Years Education : B.Tech from IIT or Tier I / II college...Show moreLast updated: 30+ days ago

Promoted

AWS Data Engineer

Tata Consultancy Servicesdombivli, maharashtra, in

TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 9 days ago

Promoted

AWS Engineer

Spryc SystemsMumbai, IN

We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show moreLast updated: 1 day ago

Promoted
New!

Senior Data Engineer with AWS_ Exp : 6+ Years

Atyeti IncThane, IN

Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 21 hours ago

Promoted

Aws Data Engineer

Tata Consultancy ServicesDombivli, Republic Of India, IN

Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 9 days ago

Promoted

AWS-DATA Engineer

BDO Indiamumbai, maharashtra, in

BDO India Services Private Limited is the India member firm of BDO International.BDO India offers strategic, operational, accounting, tax & regulatory advisory and assistance for both domestic and ...Show moreLast updated: 1 day ago

Promoted

Cloud Engineer - AWS

Hrizen techno servicesMumbai

Description : Responsibilities : - Design and implement secure, scalable, and highly available infrastructure ...Show moreLast updated: 30+ days ago

Promoted

AWS Data Engineer

TerraGiGKalyan-Dombivli, IN

Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 12 days ago

Promoted
New!

Senior AWS Data Engineer_Exp : 5+ Years

Atyeti Incmumbai city, maharashtra, in

Promoted

AWS Data Engineer

ConfidentialMumbai City, Pune

Data Engineer with strong ETL experience and hands-on expertise in AWS Glue, Airflow, Python, and SQL-based systems.Design, develop, and maintain robust ETL workflows using AWS Glue and Airflow.Wri...Show moreLast updated: 4 days ago

Promoted

AWS Data Engineer - Contractual Position

ConfidentialMumbai

Work extensively with AWS services including S3, Lambda, Glue, API Gateway, and SQS.Design and implement data engineering solutions on AWS, utilizing Python, PySpark, and SQL for processing and tra...Show moreLast updated: 4 days ago

Promoted

Volody - AWS / DevOps Engineer - CI / CD Pipeline

VolodyMumbai

Volody is enterprise software company looking out for AWS / Development Operations engineer with prior experience of AWS / Azure & cloud installations for large corporate houses.Candidate shoul...Show moreLast updated: 30+ days ago

Promoted

Data Engineer – Azure & AWS

Yoda TechMumbai, IN

We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 10 days ago

Promoted

AWS Database Eng

Tata Consultancy Servicesmumbai city, maharashtra, in

Desired Competencies (Technical / Behavioral Competency).Should have expertise in creating data warehouses in AWS utilizing the following tools : EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake....Show moreLast updated: 1 day ago