AWS Databricks Engineer
CoforgeBengaluru, Republic Of India, IN16 days ago
Job descriptionDatabricks : Expertise in design jobs and workloads. Proficiency in pyspark / scala for data manipulation, transformation and analysis Optimization of Databricks clusters and notebooks. Python : Hands-on experience in automation and scripting. Cloudera : Strong knowledge of Spark, Hive, Impala, HDFS, Kafa, HBase and Cluster management . Palantir : Hands on experience with analytics, data fusion and developing analytical workflows DevOps Basics : Familiarity with Jenkins CI / CD pipelines . Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda Communication : Excellent verbal and written communication skills. Fast Learner : Ability to quickly grasp new technologies and adapt to changing requirements. Familiarity with containerization technologies (Docker, Kubernetes). Experience with real-time streaming technologies (e.G., Kafka Streams, Spark Streaming). Exposure to machine learning operationalization (MLOps) workflows. Background in regulated industries with strict data compliance requirements. Provide solutioning for web applications and data pipelines. Solutioning data analytics requirements with Palantir. Stay updated with emerging technologies and quickly adapt to new tools and frameworks. Work with CI / CD pipelines.
We are seeking an experienced AWS Databricks Developer to design, develop, and maintain scalable data processing and analytics solutions on the AWS and Databricks platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.
Key Responsibilities :
- Overall, 5 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering.
- Design and develop solution in combination of Cloudera, Palantir and Databricks.
- Develop Python-based automation scripts to optimize workflows and processes.
- Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
- Define architecture for data-driven solutions.
- Ensure scalability, security, and performance of deployed solutions.
- Collaborate with business teams, data engineers, and developers to align solutions with business goals.
Mandatory Skills :
Good to have skills :
Additional Information :
Certifications : Databricks Certified Associate
Create a job alert for this search
Aws Engineer • Bengaluru, Republic Of India, IN
Related jobs
- Promoted
AWS Data Engineer
TerraGiGBengaluru, IN Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 6 days ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticshosur, tamil nadu, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 24 days ago
- Promoted
Snowflake Data Engineer (Snowflake+DBT+SQL+Python) Only Immediate Joiners- PAN India
Mount Talent Consulting Pvt Ltd.hosur, tamil nadu, in As a Snowflake Lead with experience, and additional expertise in ETL tools and DBT, youwill be entrusted with a pivotal role in designing, implementing, and managing Snowflake solutions to driveeff...Show moreLast updated: 24 days ago
- Promoted
SENIOR AWS CLOUD ENGINEER
CloudZeniaBengaluru, Karnataka, India Please fill the below Google Form to get the interview process started : .FAIpQLScx23dmwM6VcPlLTbO0UiVaRWMgK_H0vgluUSYtRaIk0herxA / viewform.
We’re hiring a Cloud Engineer (AWS) to design, build, and ma...Show moreLast updated: 23 days ago
- Promoted
AWS Data Engineer (Pyspark)
Tata Consultancy ServicesBengaluru, Karnataka, India Bangalore,Chennai,Hyderabad,Pune,Kochi,Bhubaneshawar,Kolkata.AWS Lambda, Python, Boto3 ,Pyspark, Glue.Strong experience in Python to package, deploy and monitor data science apps.Knowledge in Pytho...Show moreLast updated: 26 days ago
- Promoted
Databricks Engineer
Tata Consultancy Serviceshosur, tamil nadu, in Skills : Azure Databricks, Pyspark, ADLS, ADF.Responsibility of / Expectations from the Role : .Designing and building Databricks data pipelines is required.
Experience in transforming the data using A...Show moreLast updated: 24 days ago
- Promoted
AWS Data Engineer
Tata Consultancy ServicesBengaluru, Karnataka, India Bangalore or Bhubaneswar or Hyderabad.Bachelor's degree in Engineering , Technology computer science, statistics, biostatistics, mathematics, biology or other health related field or equivalent exp...Show moreLast updated: 30+ days ago
- Promoted
Python AWS Data Engineer
Digitrix Software LLPBangalore, IN Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
- Promoted
2921 - AWS Data Engineer
EXLBangalore Urban, Karnataka, India Job Title – Data Warehouse Developer.We are looking for a Data Warehouse Developer with strong expertise in SQL and a deep understanding of Data Warehouse (DWH) concepts.
The role involves designing...Show moreLast updated: 16 days ago
- Promoted
DevOps Engineer
IntraEdgehosur, tamil nadu, in Seeking a skilled DevOps Engineer with strong expertise in Amazon Web Services (AWS) to join the engineering team.In this role, you will design, implement, and maintain infrastructure that enables ...Show moreLast updated: 24 days ago
- Promoted
Data Engineer
Trantorhosur, tamil nadu, in We are seeking a data engineer to design, implement, and optimize cloud-based data pipelines using Microsoft Azure services, including ADF, Synapse, and ADLS.
Develop and maintain ETL / ELT pipelines ...Show moreLast updated: 16 days ago
- Promoted
Data Engineer
thinkbridgehosur, tamil nadu, in We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show moreLast updated: 30+ days ago
- Promoted
Senior AWS Data Engineer
CYAN360Bengaluru, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
DevOps Engineer
Alp Consulting Ltd.Greater Bengaluru Area, India Good knowledge of AWS technologies including EC2, ECS / EKS (Docker containers), RDS, S3, Lambda, CloudHSM.Cloud stack deployment & upgrade using CloudFormation / Terraform.REST end point development...Show moreLast updated: 13 days ago
- Promoted
Data Engineer
AAA Globalhosur, tamil nadu, in Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 16 days ago
- Promoted
AWS Data Engineer
CoforgeBengaluru, Karnataka, India AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShell.
We are looking for an experienced A...Show moreLast updated: 16 days ago
- Promoted
Full Stack Engineer
Dover IndiaGreater Bengaluru Area, India Roles & Responsibilities : SSE / TL Fullstack.Location : Bagmane Techpark CV Raman Nagar-Bangalore.Net Core with Angular,WEB API, SQL Database.
Develop and debug source code which includes : 1) Developin...Show moreLast updated: 29 days ago
- Promoted
AWS Databricks Developer
CoforgeBengaluru, Karnataka, India The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Overall, 5 to 8 years...Show moreLast updated: 16 days ago