Talent.com
Magna - Senior Databricks Engineer

Magna - Senior Databricks Engineer

Magna InternationalBangalore
30+ days ago
Job description

What We Offer :

At Magna, you can expect an engaging and dynamic environment where you can help to develop industry-leading automotive technologies.

We invest in our employees, providing them with the support and resources they need to succeed.

As a member of our global team, you can expect exciting, varied responsibilities as well as a wide range of development prospects.

Because we believe that your career path should be as unique as you are.

Group Summary :

Magna is more than one of the worlds largest suppliers in the automotive space.

We are a mobility technology company built to innovate, with a global, entrepreneurial-minded team.

With 65+ years of expertise, our ecosystem of interconnected products combined with our complete vehicle expertise uniquely positions us to advance mobility in an expanded transportation landscape.

Job Responsibilities :

We are looking for a highly experienced and motivated Senior Engineer to join our Enterprise Data Platform team.

This role is pivotal in designing, building, and maintaining scalable, secure, and high-performance data infrastructure across Azure, AWS, and Databricks.

The ideal candidate will have strong hands-on experience in cloud administration, CI / CD automation, and should be innovative in building ingestion patterns, re-usable components, reference architecture and hyper-automation for platform.

Key Responsibilities Engineering & Administration - Must Have :

  • Administer and optimize Azure and AWS cloud environments, including resource provisioning, access control, monitoring, and cost management.
  • Manage and maintain Databricks workspaces, clusters, jobs, notebooks, and user roles.
  • Ensure platform security, compliance, and performance through proactive monitoring and automation.

Data Engineering & Development Must Have :

  • Design and develop modular, reusable Python-based batch jobs and data pipelines using frameworks like PySpark, pandas, and Delta Lake.
  • Build scalable ETL / ELT processes to ingest, transform, and load data from diverse sources into cloud data lakes and warehouses.
  • Optimize data workflows for performance, reliability, and maintainability.
  • DevOps & CI / CD Automation :

  • Implement and manage CI / CD pipelines using GitHub Actions, Azure DevOps, or similar tools to automate deployment and testing of data solutions.
  • Must Have :

  • Integrate infrastructure-as-code (IaC) practices using tools like Terraform or ARM templates.
  • Good to have :

  • Collaborate with DevOps and platform teams to streamline release cycles and ensure consistent environments.
  • Collaboration & Governance :

  • Work closely with data architects, analysts, and business stakeholders to understand requirements and deliver robust data solutions.
  • Promote best practices in data governance, metadata management, and data quality.
  • Document technical designs, operational procedures, and troubleshooting guides.
  • Required Qualifications :

  • Bachelors or Masters degree in Computer Science, Engineering, or related field.
  • 8 -10 years of experience in data engineering or platform engineering roles.
  • Proven hands-on expertise in Azure, AWS, and Databricks administration.
  • Strong programming skills in Python, with experience in building production-grade data pipelines.
  • Deep understanding of CI / CD principles, Git workflows, and automation tools.
  • Experience with monitoring, logging, and alerting tools (e., Azure Monitor, CloudWatch, Datadog).
  • Preferred Skills :

  • Experience with Terraform, Docker, or Kubernetes.
  • Familiarity with data lakehouse architectures, Delta Lake, and Apache Spark.
  • Knowledge of data security, compliance frameworks, role-based & attribute based access control.
  • Exposure to Agile / Scrum methodologies and tools like JIRA or We Offer :
  • Opportunity to work on cutting-edge cloud-native data platforms.
  • Collaborative and inclusive work culture.
  • Competitive compensation and benefits.
  • Continuous learning and career development support.
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Engineer • Bangalore

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Nityo InfotechBengaluru, Karnataka, India
    We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site.This role requires a self-starter who can architect and implement robust data foun...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Senior Data Engineer AWS + GCP

    Senior Data Engineer AWS + GCP

    People Prime Worldwidebangalore, karnataka, in
    Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for...Show moreLast updated: 13 hours ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Bangalore, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VeraxionBengaluru, Karnataka, India
    We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inchosur, tamil nadu, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyatihosur, tamil nadu, in
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ZetaBengaluru, India
    Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future.It was founded by Bhavin Turakhia and Ramki Gaddipati in 2015.Our flagship p...Show moreLast updated: 28 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    SystemBenderhosur, tamil nadu, in
    Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer -Azure Databricks

    Senior Data Engineer -Azure Databricks

    Tredence Inc.Bengaluru, Karnataka, India
    Loc : Bangalore / Chennai / Pune / Kolkata / Gurugram.Azure Databricks, Pyspark, SQL.Bachelor's and / or masters degree in computer science or equivalent experience. IT experience and experience in Data wareho...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Acuity Knowledge PartnersBengaluru, Karnataka, India
    Acuity Knowledge Partners is hiring multiple ' Senior Data Engineers ' for its Data and Technology Services Team at Bengaluru (hybrid). The position requires advanced profic...Show moreLast updated: 9 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show moreLast updated: 24 days ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limitedhosur, tamil nadu, in
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer - Databricks

    Senior Data Engineer - Databricks

    Tredence Inc.Bengaluru, Karnataka, India
    Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, Cali...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Sonata SoftwareBengaluru, Karnataka, India
    Experience building data pipelines.Highly proficient in python, Data frames.Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB. Highly proficient in SQL Query.Snowflake or experi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL DigitalBengaluru, Karnataka, India
    We are looking for professionals with expertise in Data Engineering.Data Engineer (We are looking for 7 to 10years of experience) and Tech Lead – Data Engineer -( looking for 10+ years of experienc...Show moreLast updated: 14 days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careershosur, tamil nadu, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Pretium Enterprise Services, IndiaBengaluru, Karnataka, India
    Would be a lead responsible for developing data products & solutions for the organization.IT with experience in Data warehouse, ETL, BI projects is required. Would collaborate within Agile teams to ...Show moreLast updated: 12 days ago