This job offer is not available in your country.

Azure Databricks Engineer / Technical Lead - Apache Spark / Informatica

Infinity HR SolutionsBangalore

30+ days ago

Job description

Job Role : Senior Data Bricks Engineer

Type : Contract to hire (6 : Work from Office : Total 8+ Years (6+ years (Databricks, AWS) 4+ years (Apache spark, Title : Senior Databricks Engineer / Technical Lead

Job Overview :

We are looking for a Senior Databricks Engineer or Technical Lead with strong experience in cloud data platforms, particularly with Databricks and AWS. The ideal candidate will lead the design, implementation, and optimization of robust data solutions in a collaborative Responsibilities :

Technical Leadership : Guide and mentor teams in the design and implementation of Databricks solutions.
Architecture & Design : Develop scalable data pipelines and Lakehouse architectures.
Data Engineering : Lead ingestion and transformation processes for both batch and streaming data.
Performance Optimization : Troubleshoot and optimize resource usage for high-performance

workloads.

Security & Compliance : Apply best practices for access control, data governance, and regulatory compliance.

Collaboration : Work with cross-functional teams, including data engineers, analysts, and business stakeholders.

Cloud Integration : Manage and operate Databricks environments on AWS (preferred), Azure, or GCP.

Monitoring & Automation : Set up automated workflows and monitoring tools to enhance operational :

6+ years of experience in Databricks and AWS.

4+ years of hands-on experience with Apache Spark and Informatica.

Strong understanding of distributed systems, data warehousing, and data lake architecture.

Proficiency in SQL, Python, and Spark-based data processing.

Experience with job orchestration tools like Airflow or similar is a plus.

Excellent problem-solving and leadership skills.

Strong verbal and written communication abilities.

(ref : hirist.tech)

Create a job alert for this search

Azure • Bangalore

Related jobs

Promoted

Senior Azure Data Engineer - Full remote - contractor in USD

All European Careershosur, tamil nadu, in

Remote

For an international project in Chennai, we are urgently looking for a Full Remote SeniorAzure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databrick...Show moreLast updated: 8 days ago

Promoted

Azure databricks, PySpark

Tata Consultancy ServicesBengaluru, Karnataka, India

Role : Azure Data Engineer(ADF, ADB).Required Technical Skill Set : Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL / SQL. Location : Kolkata, Pune, Mumbai, Bangalore, Bh...Show moreLast updated: 8 days ago

Promoted
New!

Azure Data Engineer Lead

Creative Synergies GroupBengaluru, Karnataka, India

Creative Synergies Group Overview.Creative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and D...Show moreLast updated: 18 hours ago

Promoted

Lead Azure Data Engineer

RandomTreesBengaluru, IN

We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 26 days ago

Promoted

Azure Data Engineer

Tata Consultancy Servicesbangalore, karnataka, in

Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago

Promoted

Senior Manager - Data Engineering Lead

DIAGEO Indiahosur, tamil nadu, in

Senior Manager - Data Engineering Lead.Bachelor’s or master’s degree in computer science, Data Engineering, or related field. Experience in data engineering.Proven experience in cloud platforms (AWS...Show moreLast updated: 26 days ago

Promoted

Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

USThosur, tamil nadu, in

CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with. Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Otomeyt AIhosur, tamil nadu, in

We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago

Promoted

Data Engineer

Bahwan CyberTekhosur, tamil nadu, in

Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 17 days ago

Promoted

Senior Azure Data Engineer

Wissen InfotechBengaluru, Karnataka, India

Azure Data Engineer Know anyone who is interested!! Share your resumes to adilakshmi.Wissen Infotech is hiring for Bangalore. Job Title : Azure Data Engineer.Years of Experience : 8 plus years.Locatio...Show moreLast updated: 30+ days ago

Promoted
New!

Data Engineer

TechVeritohosur, tamil nadu, in

You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 15 hours ago

Promoted

Data Engineer | Azure + Databricks

XebiaBengaluru, Karnataka, India

Job Opportunity – Data Engineer | Azure + Databricks 🔹.Bangalore (Whitefield) | Hybrid (3 days office / week).Immediate to 2 weeks – only apply if you can join early. The ideal candidate will have st...Show moreLast updated: 8 days ago

Promoted

Technical Lead - Data Engineer

Visara PartnersBengaluru, Karnataka, India

Location : Bengaluru / Hyderabad.Databricks workflow & Unity catalog.Python programming & package builds.Hands-on experience in designing and building scalable data pipelines using Databricks with ...Show moreLast updated: 5 days ago

Promoted
New!

Data Engineering Azure databricks

EXLhosur, tamil nadu, in

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 15 hours ago

Promoted

Data Engineer

Kanerika Inchosur, tamil nadu, in

Following are high level responsibilities that you will play but not limited to : .Analyze the Data Model and do GAP analysis with Business Requirements and Power BI. Design and Model Power BI schema....Show moreLast updated: 19 days ago

Promoted

Data Engineer

ACL Digitalhosur, tamil nadu, in

Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago

Promoted

Senior Azure Data Engineer

Programmers.iohosur, tamil nadu, in

Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

Eucloid Data Solutionshosur, tamil nadu, in

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago

Promoted

Data Engineer Team Lead

SGIhosur, tamil nadu, in

To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 6 days ago

Promoted

Data Engineer

Innodata Inc.hosur, tamil nadu, in

CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago