AWS Databricks Developer
CoforgeBengaluru, Karnataka, India15 days ago
Job descriptionDatabricks : Expertise in design jobs and workloads. Proficiency in pyspark / scala for data manipulation, transformation and analysis Optimization of Databricks clusters and notebooks. Python : Hands-on experience in automation and scripting. Cloudera : Strong knowledge of Spark, Hive, Impala, HDFS, Kafa, HBase and Cluster management . Palantir : Hands on experience with analytics, data fusion and developing analytical workflows DevOps Basics : Familiarity with Jenkins CI / CD pipelines . Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda Communication : Excellent verbal and written communication skills. Fast Learner : Ability to quickly grasp new technologies and adapt to changing requirements. Familiarity with containerization technologies (Docker, Kubernetes). Experience with real-time streaming technologies (e.g., Kafka Streams, Spark Streaming). Exposure to machine learning operationalization (MLOps) workflows. Background in regulated industries with strict data compliance requirements. Provide solutioning for web applications and data pipelines. Solutioning data analytics requirements with Palantir. Stay updated with emerging technologies and quickly adapt to new tools and frameworks. Work with CI / CD pipelines.
We are seeking an experienced AWS Databricks Developer to design, develop, and maintain scalable data processing and analytics solutions on the AWS and Databricks platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.
Key Responsibilities :
- Overall, 5 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering.
- Design and develop solution in combination of Cloudera, Palantir and Databricks.
- Develop Python-based automation scripts to optimize workflows and processes.
- Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
- Define architecture for data-driven solutions.
- Ensure scalability, security, and performance of deployed solutions.
- Collaborate with business teams, data engineers, and developers to align solutions with business goals.
Mandatory Skills :
Good to have skills :
Additional Information :
Certifications : Databricks Certified Associate
Create a job alert for this search
Aws Developer • Bengaluru, Karnataka, India
Related jobs
- Promoted
AWS CDK
ACubetech Solutions Private limitedBengaluru, Karnataka, India We are seeking a highly skilled DevOps Engineer with 7+ years hands-on expertise in AWS CDK using TypeScript to help modernize infrastructure, ensure performance, and maintain security for cloud-ho...Show moreLast updated: 8 days ago
- Promoted
- New!
AWS Data Solutions Engineer
Nityo InfotechBengaluru, Republic Of India, IN We are looking for an experienced Senior Data Engineer with strong expertise in AWS Glue, PySpark, and cloud-based data engineering.
The ideal candidate will design, develop, and optimize scalable d...Show moreLast updated: 18 hours ago
- Promoted
AWS Data Architect- Leadership
QuantiphiBengaluru, Karnataka, India AWS Data Architect- Leadership.We are seeking a highly skilled and experienced Technical Leader for our AWS Data Engineering practice.
The ideal candidate will be responsible for driving Data Engine...Show moreLast updated: 30+ days ago
- Promoted
EKS & Datadog Engineer
RED GlobalBangalore, Bangalore (district) EKS & Datadog Engineer – Bangalore or Gurugram (Hybrid).Kubernetes, AWS, and Observability.You will take ownership of end-to-end observability setup, monitoring architecture, and infrastructure-as-...Show moreLast updated: 1 day ago
- Promoted
Snowflake Cortex Developer
Tata Consultancy ServicesGreater Bengaluru Area, India Job Title : Snowflake Cortex Developer.Required Skillset : Snowflake Cortex, SQL, Snowflake.Location : Delhi / Bangalore / Hyderabad / Pune / Mumbai.
Strong data engineer ( snowflake + SQL) with good under...Show moreLast updated: 8 days ago
- Promoted
Senior Snowflake Developer
Tata Consultancy ServicesGreater Bengaluru Area, India Role : Senior Snowflake Developer.Required Technical Skill Set • •.Strong proficiency in SQL for Snowflake.Hands-on experience with Excel data handling (e.
VBA, macros, or scripting to clean and transf...Show moreLast updated: 12 days ago
- Promoted
Aws Data Engineer
CoforgeBengaluru, Republic Of India, IN AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShell.
We are looking for an experienced A...Show moreLast updated: 15 days ago
- Promoted
Python AWS Data Engineer
Digitrix Software LLPBengaluru, IN Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
- Promoted
AWS Databricks Engineer
CoforgeBengaluru, Republic Of India, IN The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Overall, 5 to 8 years...Show moreLast updated: 15 days ago
- Promoted
AWS Data Solutions Engineer
CoforgeBengaluru, Republic Of India, IN AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShell.
We are looking for an experienced A...Show moreLast updated: 15 days ago
- Promoted
AWS Solutions Engineer
MastekBengaluru, Republic Of India, IN Please be informed that the business is decided to hire 10+ years’ experience candidate for the cited position.Kindly help us with a few quality profiles to fulfil the position at the earliest.Prof...Show moreLast updated: 15 days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicesbangalore, India Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 30+ days ago
- Promoted
Senior AWS Data Engineer
CYAN360Bengaluru, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
Snowflake Developer
Tata Consultancy ServicesGreater Bengaluru Area, India Job Title : Snowflake Developer.Required Skillset : Snowflake architecture, Snowpipe, data cloning, and time travel, SQL, Data Modeling.
Deep understanding of cloud data warehousing and expertise in d...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
TerraGiGbangalore district, India Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 5 days ago
- Promoted
AWS Data Engineer
CoforgeBengaluru, Karnataka, India AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShell.
We are looking for an experienced A...Show moreLast updated: 16 days ago
- Promoted
2921 - AWS Data Engineer
EXLBangalore Urban, Karnataka, India Job Title – Data Warehouse Developer.We are looking for a Data Warehouse Developer with strong expertise in SQL and a deep understanding of Data Warehouse (DWH) concepts.
The role involves designing...Show moreLast updated: 15 days ago
- Promoted
Aws Databricks Developer
CoforgeBengaluru, Republic Of India, IN The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Overall, 5 to 8 years...Show moreLast updated: 15 days ago