Talent.com
Principal Consultant, Sr. Databricks Developer!

Principal Consultant, Sr. Databricks Developer!

ConfidentialChennai
6 days ago
Job description

Ready to shape the future of work

At Genpact, we don't just adapt to change-we drive it. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies' most complex challenges.

If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that's shaping the future, this is your moment.

Genpact (NYSE : G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions - we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook.Inviting applications for the role of Principal Consultant, Sr. Databricks Developer!

In this role, the Sr. Databricks developer is responsible for solving real world cutting edge problem and mentor a team of one or more junior developer to address the goal.Responsibilities

  • .Design and develop end-to-end data pipelines using PySpark, SQL / Spark-SQL,

and Delta Lake.

  • .Translate requirements into scalable, high-performance data solutions.
  • .Participate in architecture discussions and provide technical inputs.
  • .Implement ETL / ELT workflows in Lakehouse (Bronze, Silver, Gold layers).
  • .Optimize pipelines, clusters, and queries for performance and cost.
  • .Integrate Databricks with cloud services, APIs, and messaging systems.
  • .Implement data quality checks, unit tests, and integration tests.
  • .Develop both batch and streaming pipelines for real-time use cases.
  • .Contribute to shared assets, frameworks, and accelerators.
  • .Collaborate with leads, architects, and analysts during delivery.
  • .Support data migration projects to Databricks Lakehouse.
  • .Document technical solutions, coding standards, and best practices.
  • .Act as a strategic advisor on Databricks adoption, modernization, and data strategy.
  • .Define enterprise-scale architectures leveraging the Databricks Lakehouse platform.
  • .Establish data governance frameworks with Unity Catalog (lineage, auditing, security, compliance).
  • .Oversee multiple delivery streams, ensuring alignment with standards and best practices.
  • .Drive reusable accelerators, frameworks, and reference architectures.
  • .Engage with stakeholders on cost optimization, innovation, and roadmap planning.
  • .Lead thought leadership initiatives (whitepapers, blogs, conferences).
  • .Mentor and coach developers, senior developers, and leads.
  • .Support Centers of Excellence (CoE) and competency frameworks.
  • .Stay ahead of emerging technologies, trends, and Databricks innovations.
  • Qualifications we seek in you!

    Minimum qualifications

  • .Bachelor's Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
  • .Relevant years in data engineering with hands-on Databricks experience..End-to-end implementation of at least 2 Databricks projects(migration / integration).
  • .Strong background in batch and streaming data pipelines.
  • .Proficiency in Python (preferred) or Scala for Spark-based development.
  • .Expertise in SQL & Spark-SQL, data structures, and algorithms.
  • .Deep knowledge of Databricks components : Delta Lake, DLT, dbConnect, REST API 2.0, Workflows orchestration.
  • .Design, develop, and optimize large-scale batch pipelines for ingestion, transformation, and analytics using Databricks.
  • .Build and manage low-latency streaming pipelines using Spark Structured Streaming, Delta Live Tables, or other Databricks-native frameworks to enable real-time insights and decision-making.
  • .Strong in performance optimization for pipelines (efficiency, scalability, cost reduction).
  • .Hands-on experience with Apache Spark, Hive, and Lakehouse architecture.
  • .Cloud expertise (Azure / AWS) includes storage (ADLS / S3), messaging (ASB / SQS), compute (ADF / Lambda), and databases (CosmosDB / DynamoDB / Cloud SQL).
  • .Experience writing unit tests and integration tests for data pipelines.
  • .Ability to work with architects and lead engineers to design solutions meeting functional & non-functional requirements.
  • .Excellent technical skills to enabling the creation of future-proof, complex global solutions
  • .Team player with experience leading teams of 5+ engineers.
  • .Strong communication and client-facing skills.
  • .Keeps updated with emerging technologies and industry trends.
  • .Strong analytical and problem-solving abilities.
  • .Positive attitude towards continuous learning and upskilling
  • .Good to have Databricks SQL Endpoint understanding.
  • .Good to have understanding on LakeflowConnect, Lakeflow Declarative Pipelines
  • .Good To have CI / CD experience to build the pipeline for Databricks jobs.
  • .Good to have if worked on migration project to build Unified data platform.
  • .Good to have knowledge of DBT.
  • .Good to have knowledge of docker and Kubernetes.
  • .Certification on Databricks Associate or Professional level.
  • .Any one Cloud Certification (AWS / Azure) Associate / Professional level -Data Engineer or Architect level is an added advantageWhy join Genpact
  • .Be a transformation leader - Work at the cutting edge of AI, automation, and digital innovation
  • .Make an impact - Drive change for global enterprises and solve business challenges that matter
  • .Accelerate your career - Get hands-on experience, mentorship, and continuous learning opportunities
  • .Work with the best - Join 140,000+ bold thinkers and problem-solvers who push boundaries every day
  • .Thrive in a values-driven culture - Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
  • Come join the tech shapers and growth makers at Genpact and take your career in the only direction that matters : Up.

    Let's build tomorrow together.Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military / veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.

    Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a %27starter kit,%27 paying to apply, or purchasing equipment or training.

    Create a job alert for this search

    Principal Consultant • Chennai

    Related jobs
    • Promoted
    Principal Data Architect - Data Modelling

    Principal Data Architect - Data Modelling

    ConfidentialChennai
    Minimum 15 years of experience.Deep understanding of data architecture principles, data modelling, data integration, data governance, and data management technologies. Experience in Data strategies ...Show moreLast updated: 30+ days ago
    • Promoted
    Cognos Developer - Databricks & Big Data

    Cognos Developer - Databricks & Big Data

    Lancesoft India Pvt LtdChennai
    About the Role : LanceSoft is seeking an experienced COGNOS Developer to design, develop, and optimize business intelligence solutions using IBM Cognos Analytics.The ...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Consultant

    Principal Consultant

    ConfidentialChennai
    This role would require designing, configuring, and developing new business processes, enhancing existing solution in SAP Finance & Controlling within the purview of global template, and supporting...Show moreLast updated: 30+ days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    AaysChennai, IN
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 30+ days ago
    • Promoted
    Kissflow - Principal Solution Consultant

    Kissflow - Principal Solution Consultant

    KissflowChennai
    Have you dreamt of working in a Product based company? Heres an opportunity for you! Kissflow is the leader in no-code citizen development and a strong player in low-code appl...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Analytics Consultant

    Principal Analytics Consultant

    ProspectionChennai, IN
    Are you passionate about turning real-world healthcare data into actionable insights that improve patient outcomes? At.RWD) to deliver high-impact outcomes for pharmaceutical companies, healthcare ...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Architect - Databricks

    Principal Architect - Databricks

    Tiger AnalyticsChennai, Tamil Nadu, India
    Title : Principal Architect – Databricks.Location : Chennai, Bengaluru, Hyderabad.Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challen...Show moreLast updated: 20 days ago
    • Promoted
    Databricks Architect

    Databricks Architect

    ConfidentialChennai, India
    We are seeking an experienced .The ideal candidate will have deep expertise in big data technologies, cloud platforms, and analytics architectures, with strong communication skills to interact with...Show moreLast updated: 6 days ago
    • Promoted
    Capgemini - SAP MDG Consultant - E2E Implementation

    Capgemini - SAP MDG Consultant - E2E Implementation

    Capgemini Technology Services India LimitedChennai
    Your Role : - Review technical design and development of master data related interfaces, enhancement, load program, report and workflow in ...Show moreLast updated: 30+ days ago
    • Promoted
    Kissflow - Principal Solution Consultant

    Kissflow - Principal Solution Consultant

    ConfidentialChennai, India
    Have you dreamt of working in a Product based company Heres an opportunity for you!.Kissflow is the leader in no-code citizen development and a strong player in low-code application development emp...Show moreLast updated: 6 days ago
    • Promoted
    MicroStrategyE3

    MicroStrategyE3

    ConfidentialChennai
    Design schema objects (attributes, facts, metrics) and application objects (grids, filters, prompts).Optimize and tune MicroStrategy performance for large datasets and complex reports.Integrate Mic...Show moreLast updated: 30+ days ago
    • Promoted
    Solution Architect - Big Data Platform

    Solution Architect - Big Data Platform

    ConfidentialChennai, India
    Seeking an accomplished End-to-End (E2E) Data Architect to lead the design and implementation of large-scale Big Data solutions. The ideal candidate will combine deep expertise in modern data platfo...Show moreLast updated: 6 days ago
    • Promoted
    Sr. ODI Consultant

    Sr. ODI Consultant

    KPI Partnerschennai, tamil nadu, in
    KPI Partners is seeking a highly skilled and experienced 'Sr ODI Consultant' to join our dynamic team.Location : Bengaluru, Hyderabad, Pune or Remote. Hands-on experience in API source handling.Oracl...Show moreLast updated: 1 day ago
    • Promoted
    Consultant-Databricks

    Consultant-Databricks

    ConfidentialChennai, Kolkata, Pune
    Primary Roles and Responsibilities : Developing Modern Data Warehouse solutions using Databricks and AWS / Azure Stack Ability to provide solutions that are forward-thinking in data engineering and a...Show moreLast updated: 30+ days ago
    • Promoted
    SAP Signavio Consultant

    SAP Signavio Consultant

    DATAQUAD IT SOLUTIONS PRIVATE LIMITEDChennai
    Job Description : - For a Celonis to SAP Signavio migration project, looking for Primary skills and project experience in Data Modelling with Signavi...Show moreLast updated: 29 days ago
    • Promoted
    Lead Consultant - Technical Platform Owner - Data

    Lead Consultant - Technical Platform Owner - Data

    ConfidentialChennai, India
    Job Title : Lead Consultant - Technical Platform Owner.Are you ready to redefine an industry and change lives Join our global Operations IT team, where we combine innovative science with leading dig...Show moreLast updated: 1 day ago
    • Promoted
    Solution Architect - Big Data Platform

    Solution Architect - Big Data Platform

    MOURITechChennai
    Role Overview : Seeking an accomplished End-to-End (E2E) Data Architect to lead the design and implementation of large-scale Big Data solutions.The ideal candidate wi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    DataBrick

    DataBrick

    ConfidentialChennai, India
    We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Datab...Show moreLast updated: 21 hours ago