Talent.com
No longer accepting applications
3 Days Left : AWS Databricks Developer

3 Days Left : AWS Databricks Developer

CoforgeBengaluru, Karnataka, India
4 hours ago
Job description

We are seeking an experienced AWS Databricks Developer to design, develop, and maintain scalable data processing and analytics solutions on the AWS and Databricks platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.

Key Responsibilities :

  • Overall, 5 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering.
  • Design and develop solution in combination of Cloudera, Palantir and Databricks.
  • Develop Python-based automation scripts to optimize workflows and processes.
  • Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
  • Define architecture for data-driven solutions.
  • Ensure scalability, security, and performance of deployed solutions.
  • Collaborate with business teams, data engineers, and developers to align solutions with business goals.

Mandatory Skills :

  • Databricks :
  • Expertise in design jobs and workloads.
  • Proficiency in pyspark / scala for data manipulation, transformation and analysis
  • Optimization of Databricks clusters and notebooks.
  • Python : Hands-on experience in automation and scripting.
  • Cloudera : Strong knowledge of Spark, Hive, Impala, HDFS, Kafa, HBase and Cluster management.
  • Palantir : Hands on experience with analytics, data fusion and developing analytical workflows
  • DevOps Basics : Familiarity with Jenkins CI / CD pipelines.
  • Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
  • Communication : Excellent verbal and written communication skills.
  • Fast Learner : Ability to quickly grasp new technologies and adapt to changing requirements.
  • Good to have skills :

  • Familiarity with containerization technologies (Docker, Kubernetes).
  • Experience with real-time streaming technologies (e.g., Kafka Streams, Spark Streaming).
  • Exposure to machine learning operationalization (MLOps) workflows.
  • Background in regulated industries with strict data compliance requirements.
  • Additional Information :

    Certifications : Databricks Certified Associate

  • Provide solutioning for web applications and data pipelines.
  • Solutioning data analytics requirements with Palantir.
  • Stay updated with emerging technologies and quickly adapt to new tools and frameworks.
  • Work with CI / CD pipelines.
  • Create a job alert for this search

    Developer Aws • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    AWS CDK

    AWS CDK

    ACubetech Solutions Private limitedBengaluru, Karnataka, India
    We are seeking a highly skilled DevOps Engineer with 7+ years hands-on expertise in AWS CDK using TypeScript to help modernize infrastructure, ensure performance, and maintain security for cloud-ho...Show moreLast updated: 4 days ago
    • Promoted
    Senior Analytics Support Engineer (GA4 | GTM | Looker | Tableau | SQL | AWS)

    Senior Analytics Support Engineer (GA4 | GTM | Looker | Tableau | SQL | AWS)

    Sky Systems, Inc. (SkySys)hosur, tamil nadu, in
    Senior Analytics Support Engineer.Full-Time Contract (40hrs / week).Hybrid (2x days onsite) in Bangalore, India.We’re looking for a skilled Analytics Support Engineer experienced in.GA4, GTM, Looker,...Show moreLast updated: 1 day ago
    • Promoted
    Python Developer

    Python Developer

    Infogainhosur, tamil nadu, in
    Python Developer with 3–5 years of experience, specializing in AWS Lambda and API development.Design, develop, and deploy serverless applications using AWS Lambda. Build and maintain RESTful APIs.Wr...Show moreLast updated: 12 days ago
    • Promoted
    AWS Data Architect- Leadership

    AWS Data Architect- Leadership

    QuantiphiBengaluru, Karnataka, India
    AWS Data Architect- Leadership.We are seeking a highly skilled and experienced Technical Leader for our AWS Data Engineering practice. The ideal candidate will be responsible for driving Data Engine...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Bangalore, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Greetings from TATA Consultancy Services.Pls find the Job Description below.Hands-on experience in Pyspark, Glue.Experience on EMR, S3, IAM, Lambda, Cloud formation, Python.AMI Rehydration, Python,...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Tech Lead

    AWS Tech Lead

    PROADSW3 Relations pvt. ltd.Bengaluru, Karnataka, India
    Job Title : AWS Tech Lead (Migration Lead Engineer).Pune | Chennai | Hyderabad | Gurgaon | Bhopal | Bangalore | Jaipur.AWS Tech Lead (Migration Lead Engineer). Infrastructure & Platform Engineering.A...Show moreLast updated: 12 days ago
    • Promoted
    Snowflake Cortex Developer

    Snowflake Cortex Developer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    Job Title : Snowflake Cortex Developer.Required Skillset : Snowflake Cortex, SQL, Snowflake.Location : Delhi / Bangalore / Hyderabad / Pune / Mumbai. Strong data engineer ( snowflake + SQL) with good under...Show moreLast updated: 4 days ago
    • Promoted
    Senior Snowflake Developer

    Senior Snowflake Developer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    Role : Senior Snowflake Developer.Required Technical Skill Set • •.Strong proficiency in SQL for Snowflake.Hands-on experience with Excel data handling (e. VBA, macros, or scripting to clean and transf...Show moreLast updated: 8 days ago
    • Promoted
    EKS & Datadog Engineer

    EKS & Datadog Engineer

    RED Globalbangalore, karnataka, in
    EKS & Datadog Engineer – Bangalore or Gurugram (Hybrid).Kubernetes, AWS, and Observability.You will take ownership of end-to-end observability setup, monitoring architecture, and infrastructure-as-...Show moreLast updated: 10 days ago
    • Promoted
    Senior AWS Administrator

    Senior AWS Administrator

    CYAN360hosur, tamil nadu, in
    Job title : AWS Infrastructure Engineer.ETL / ELT processes using AWS services such as AWS Glue, AWS Lambda and AWS Step Functions. Ensure data quality, security, and compliance with industry best prac...Show moreLast updated: 3 days ago
    • Promoted
    AWS Tech Lead

    AWS Tech Lead

    Digitrix Software LLPBengaluru, Karnataka, India
    MUST Technical requirements in detail : (.Datadog and Sail point – Good to know.Container Runtime – Container D.Working with Docker containers, Docker registry (Docker hub), Docker volume.RBAC (Role...Show moreLast updated: 8 days ago
    • Promoted
    Opening for AWS Lead

    Opening for AWS Lead

    ITC Infotechhosur, tamil nadu, in
    You will participate in the design, development, and deployment of scalable and robust applications using AWS CloudFront, S3 buckets, Node. Implement microservices that integrate with Databricks as ...Show moreLast updated: 20 days ago
    • Promoted
    AWS DevOps

    AWS DevOps

    DeloitteBengaluru, Karnataka, India
    Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services,.Del...Show moreLast updated: 22 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    CoforgeBengaluru, Karnataka, India
    AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShell. We are looking for an experienced A...Show moreLast updated: 12 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPhosur, tamil nadu, in
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
    • Promoted
    Snowflake Developer

    Snowflake Developer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    Greetings from TATA Consultancy Services!!.Must have at least 4- 8 years experience in implementing Data warehousing solutions with at least 2 year in Snowflake. Hands-on experience with building pr...Show moreLast updated: 26 days ago
    • Promoted
    AWS Databricks Developer

    AWS Databricks Developer

    CoforgeBengaluru, Karnataka, India
    The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Overall, 5 to 8 years...Show moreLast updated: 12 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGBangalore, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 1 day ago
    • Promoted
    AWS Devops

    AWS Devops

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Role : Azure, AWS DevOps,SRE, Kubernetes, Ansible, Terraform Exp : 6-12.Show moreLast updated: 11 days ago