Talent.com
This job offer is not available in your country.
Lead Consultant- Databricks Developer!

Lead Consultant- Databricks Developer!

Genpacthyderabad, India
6 hours ago
Job description

Ready to shape the future of work?

At Genpact, we don’t just adapt to change—we drive it. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges.

If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that’s shaping the future, this is your moment.

Genpact (NYSE : G) is anadvanced technology services and solutions company that deliverslastingvalue for leading enterprisesglobally.Through ourdeep business knowledge, operational excellence, and cutting-edge solutions – we help companies across industries get ahead and stay ahead.Powered by curiosity, courage, and innovation , our teamsimplementdata, technology, and AItocreate tomorrow, today.Get to know us atgenpact.comand onLinkedIn,X,YouTube, andFacebook.

Inviting applications for the role of Lead Consultant- Databricks Developer with experience in Unity Catalog + Python , Spark , Kafka for ETL !

In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements.

  • Responsibilities
  • Develop and maintain scalable ETL pipelines using Databricks with a focus on Unity Catalog for data asset management.
  • Implement data processing frameworks using Apache Spark for large-scale data transformation and aggregation.
  • Integrate real-time data streams using Apache Kafka and Databricks to enable near real-time data processing.
  • Develop data workflows and orchestrate data pipelines using Databricks Workflows or other orchestration tools.
  • Design and enforce data governance policies, access controls, and security protocols within Unity Catalog.
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations for scalability and efficiency.
  • Write efficient Python scripts for data extraction, transformation, and loading.
  • Collaborate with data scientists and analysts to deliver data solutions that meet business requirements.
  • Maintain data documentation, including data dictionaries, data lineage, and data governance frameworks.

Qualifications we seek in you!

Minimum qualifications

Bachelor’s degree in Computer Science, Data Engineering, or a related field.

experience in data engineering with a focus on Databricks development.

Proven expertise in Databricks, Unity Catalog, and data lake management.

Strong programming skills in Python for data processing and automation.

Experience with Apache Spark for distributed data processing and optimization.

Hands-on experience with Apache Kafka for data streaming and event processing.

Proficiency in SQL for data querying and transformation.

Strong understanding of data governance, data security, and data quality frameworks.

Excellent communication skills and the ability to work in a cross-functional environ

  • Must have experience in Data Engineering domain .
  • Must have implemented at least 2 project end-to-end in Databricks.
  • Must have at least experience on databricks which consists of various components as below
  • o Delta lake

    o dbConnect

    o db API 2.0

    o Databricks workflows orchestration

  • Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
  • Must have good understanding to create complex data pipeline
  • Must have good knowledge of Data structure & algorithms.
  • Must be strong in SQL and sprak-sql.
  • Must have strong performance optimization skills to improve efficiency and reduce cost.
  • Must have worked on both Batch and streaming data pipeline.
  • Must have extensive knowledge of Spark and Hive data processing framework.
  • Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS / S3, ADF / Lambda, CosmosDB / DynamoDB, ASB / SQS, Cloud databases.
  • Must be strong in writing unit test case and integration test
  • Must have strong communication skills and have worked on the team of size 5 plus
  • Must have great attitude towards learning new skills and upskilling the existing skills.
  • Preferred Qualifications

  • Good to have Unity catalog and basic governance knowledge.
  • Good to have Databricks SQL Endpoint understanding.
  • Good To have CI / CD experience to build the pipeline for Databricks jobs.
  • Good to have if worked on migration project to build Unified data platform.
  • Good to have knowledge of DBT.
  • Good to have knowledge of docker and Kubernetes.
  • Why join Genpact?

  • Be a transformation leader – Work at the cutting edge of AI, automation, and digital innovation
  • Make an impact – Drive change for global enterprises and solve business challenges that matter
  • Accelerate your career – Get hands-on experience, mentorship, and continuous learning opportunities
  • Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day
  • Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
  • Come join the tech shapers and growth makers at Genpact and take your career in the only direction that matters : Up.

    Let’s build tomorrow together.

    Create a job alert for this search

    Lead Consultant • hyderabad, India

    Related jobs
    • Promoted
    • New!
    Senior Principal Consultant - Databricks Architect!

    Senior Principal Consultant - Databricks Architect!

    Genpacthyderabad, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead Consultant - ETL Datastage

    Lead Consultant - ETL Datastage

    Genpacthyderabad, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 6 hours ago
    • Promoted
    Data Architect

    Data Architect

    InfoBeansHyderabad, IN
    Data Architect – Snowflake & Matillion.Snowflake, Matillion, Data Modeling, SQL, Python / Bash, Cloud Platforms (AWS / Azure). Immediate to 15 days preferred.The ideal candidate is proactive, self-direc...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Principal Consultant- Databricks Lead Developer!

    Principal Consultant- Databricks Lead Developer!

    Genpacthyderabad, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Consultant Data Development

    Consultant Data Development

    TransUnionhyderabad, India
    We are seeking a highly motivated and experienced Senior Developer to join our dynamic team.In this role, you will be responsible for designing, developing, and implementing cutting-edge solutions ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead consultant-Data Engineer

    Lead consultant-Data Engineer

    Genpacthyderabad, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead Consultant-Data Engineer, AWS+SQL

    Lead Consultant-Data Engineer, AWS+SQL

    Genpacthyderabad, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead Consultant-Sr.Data Engineer (DBT+Snowflake)

    Lead Consultant-Sr.Data Engineer (DBT+Snowflake)

    Genpacthyderabad, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Talend Big Data Consultant

    Talend Big Data Consultant

    Anicalls (Pty) Ltdhyderabad, India
    This solution enables our Data Scientists and Data Analysts to actively detect trends, patterns, and relationships in data sets. Contribute to the data movement project enhancement and bug fixes for...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead Consultant - Snowflake Data Engineer

    Lead Consultant - Snowflake Data Engineer

    Genpacthyderabad, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 6 hours ago
    • Promoted
    Lead / Architect Data and AI Platform

    Lead / Architect Data and AI Platform

    AkkodisHyderabad, IN
    Deep experience building on-premises or hybrid data systems (e.Spark, Kafka, Trino, Iceberg, Airflow).Strong understanding of LLM architecture, embeddings, vector search, and agentic workflows.Prov...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    Lead Consultant, Data Engineer ETL!

    Lead Consultant, Data Engineer ETL!

    Genpacthyderabad, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead Consultant-Data Engineer, Azure+Python

    Lead Consultant-Data Engineer, Azure+Python

    Genpacthyderabad, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Tech Lead - Databricks Job

    Tech Lead - Databricks Job

    YASH Technologieshyderabad, India
    Platform Design & Architecture.Lead the design and deployment of large-scale data solutions on Databricks.Establish best practices for notebook development, job orchestration, and cluster managemen...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Principal Consultant, Azure Data Engineer

    Principal Consultant, Azure Data Engineer

    Genpacthyderabad, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Consultant- Data Engineer- Databricks!

    Consultant- Data Engineer- Databricks!

    Genpacthyderabad, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes thatshape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity,entrepren...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead Consultant- Snowflake Data Engineer( Python+Cloud)!

    Lead Consultant- Snowflake Data Engineer( Python+Cloud)!

    Genpacthyderabad, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead Consultant, SQL Developer

    Lead Consultant, SQL Developer

    Genpacthyderabad, India
    Genpact (NYSE : G) is a global professional services and solutions firm delivering outcomes that shape the future.Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepr...Show moreLast updated: 6 hours ago