Talent.com
This job offer is not available in your country.
Azure Databricks Engineer / Technical Lead - Apache Spark / Informatica

Azure Databricks Engineer / Technical Lead - Apache Spark / Informatica

Infinity HR SolutionsHyderabad
30+ days ago
Job description

Job Role : Senior Data Bricks Engineer

Type : Contract to hire (6 : Work from Office : Total 8+ Years (6+ years (Databricks, AWS) 4+ years (Apache spark, Title : Senior Databricks Engineer / Technical Lead

Job Overview :

We are looking for a Senior Databricks Engineer or Technical Lead with strong experience in cloud data platforms, particularly with Databricks and AWS. The ideal candidate will lead the design, implementation, and optimization of robust data solutions in a collaborative Responsibilities :

  • Technical Leadership : Guide and mentor teams in the design and implementation of Databricks solutions.
  • Architecture & Design : Develop scalable data pipelines and Lakehouse architectures.
  • Data Engineering : Lead ingestion and transformation processes for both batch and streaming data.
  • Performance Optimization : Troubleshoot and optimize resource usage for high-performance

workloads.

  • Security & Compliance : Apply best practices for access control, data governance, and regulatory compliance.
  • Collaboration : Work with cross-functional teams, including data engineers, analysts, and business stakeholders.
  • Cloud Integration : Manage and operate Databricks environments on AWS (preferred), Azure, or GCP.
  • Monitoring & Automation : Set up automated workflows and monitoring tools to enhance operational :
  • 6+ years of experience in Databricks and AWS.
  • 4+ years of hands-on experience with Apache Spark and Informatica.
  • Strong understanding of distributed systems, data warehousing, and data lake architecture.
  • Proficiency in SQL, Python, and Spark-based data processing.
  • Experience with job orchestration tools like Airflow or similar is a plus.
  • Excellent problem-solving and leadership skills.
  • Strong verbal and written communication abilities.
  • (ref : hirist.tech)

    Create a job alert for this search

    Azure • Hyderabad

    Related jobs
    • Promoted
    • New!
    Senior Azure Data Engineer- ADB, ADF, Python, Snowflake / SQL

    Senior Azure Data Engineer- ADB, ADF, Python, Snowflake / SQL

    UnitedHealth Grouphyderabad, India
    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...Show moreLast updated: 1 hour ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicessecunderabad, telangana, in
    Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead Consultant-Data Engineer, AWS+SQL

    Lead Consultant-Data Engineer, AWS+SQL

    Genpacthyderabad, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 1 hour ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalsecunderabad, telangana, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure Databricks Architect

    Azure Databricks Architect

    ValueMomentumhyderabad, India
    Are you someone who has a strong data engineering background who is passionate about tackling complex enterprise business challenges by designing data driven solutions? Then read on!.ValueMomentum ...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Senior Data Engineer (Azure Databricks)

    Senior Data Engineer (Azure Databricks)

    Procter & Gamblehyderabad, India
    Are you looking to take your career to the next level?.We’re looking for a Data Engineer to join our Data & Analytics Core Data Lake Platform engineering team. We are searching for self-motivated ca...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Tech Lead - Databricks Job

    Tech Lead - Databricks Job

    YASH Technologieshyderabad, India
    Platform Design & Architecture.Lead the design and deployment of large-scale data solutions on Databricks.Establish best practices for notebook development, job orchestration, and cluster managemen...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Azure Data Spark

    Azure Data Spark

    Anicalls (Pty) Ltdhyderabad, India
    Technical, organizational, and cultural leadership for the team.Build the team by hiring individual contributors, ensuring a healthy mix of talent across seniority, styles, and backgrounds.As a mem...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Tech Lead - AWS Data Engineer Job

    Tech Lead - AWS Data Engineer Job

    YASH Technologieshyderabad, India
    Understanding the current business functionalities of the ETL processes and identifying areas for improvement.Designing and building AWS Glue workflows to replace existing ETL processes.Standardizi...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Module Lead - Azure Databricks Job

    Module Lead - Azure Databricks Job

    YASH Technologieshyderabad, India
    Should have good hands-on azure services and data bricks and should have strong knowledge in medallion architecture.At YASH, you are empowered to create a career that will take you to where you wan...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Principal Consultant, Azure Data Engineer

    Principal Consultant, Azure Data Engineer

    Genpacthyderabad, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Azure Data Technical Delivery Lead...

    Azure Data Technical Delivery Lead...

    Anicalls (Pty) Ltdhyderabad, India
    Azure DataFactory (ADF) • In - depth SQL.PowerBI • Ability to handle his pressure environments.Show moreLast updated: 1 hour ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesHyderabad, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 27 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsHyderabad, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Azure Data Engineering Lead

    Azure Data Engineering Lead

    Trigent Software Private Limitedhyderabad, India
    We are looking for a highly skilled Azure Data Engineering Lead to design, develop, and optimize scalable data solutions using Azure Databricks and Azure Data Factory (ADF).This role involves colla...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Hadoop Development Lead

    Hadoop Development Lead

    ValueMomentumhyderabad, India
    Hadoop, Hive, SQL, must have worked as team lead for minimum 2-3 years.We are seeking an experienced Hadoop Data Engineer to join our team- a team of high-energy individuals who thrive in a rapid-p...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Big Data Engineer (Spark, SparkSQL)

    Big Data Engineer (Spark, SparkSQL)

    Anicalls (Pty) Ltdhyderabad, India
    Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform.Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HB...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Lead Consultant- Databricks Developer!

    Lead Consultant- Databricks Developer!

    Genpacthyderabad, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Technology Lead

    Technology Lead

    Infosyshyderabad, India
    PROGRESS DB, Appserver, Roundtable, XML • Strong analytical and problem-solving skills • Excellent written and verbal communication skills • Willing to learn new tools and technologies.SQL, PL / SQL • Da...Show moreLast updated: 1 hour ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iosecunderabad, telangana, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago