Talent.com
Principal Consultant, Sr. Databricks Developer!

Principal Consultant, Sr. Databricks Developer!

GenpactChennai, Tamil Nadu, India
30+ days ago
Job description

Ready to shape the future of work

At Genpact we dont just adapt to changewe drive it. AI and digital innovation are redefining industries and were leading the charge. Genpacts AI Gigafactory our industry-first accelerator is an example of how were scaling advanced technology solutions to help global enterprises work smarter grow faster and transform at scale. From large-scale models to agentic AI our breakthrough solutions tackle companies most complex challenges.

If you thrive in a fast-moving tech-driven environment love solving real-world problems and want to be part of a team thats shaping the future this is your moment.

Genpact (NYSE : G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge operational excellence and cutting-edge solutions we help companies across industries get ahead and stay ahead. Powered by curiosity courage and innovation our teams implement data technology and AI to create tomorrow today. Get to know us at and on LinkedIn X YouTube and Facebook.

Inviting applications for the role of Principal Consultant Sr. Databricks Developer!

In this role the Sr. Databricks developer is responsible for solving real world cutting edge problem and mentor a team of one or more junior developer to address the goal.

Responsibilities

Design and develop end-to-end data pipelines using PySpark SQL / Spark-SQL

and Delta Lake.

Translate requirements into scalable high-performance data solutions.

Participate in architecture discussions and provide technical inputs.

Implement ETL / ELT workflows in Lakehouse (Bronze Silver Gold layers).

Optimize pipelines clusters and queries for performance and cost.

Integrate Databricks with cloud services APIs and messaging systems.

Implement data quality checks unit tests and integration tests.

Develop both batch and streaming pipelines for real-time use cases.

Contribute to shared assets frameworks and accelerators.

Collaborate with leads architects and analysts during delivery.

Support data migration projects to Databricks Lakehouse.

Document technical solutions coding standards and best practices.

Act as a strategic advisor on Databricks adoption modernization and data strategy.

Define enterprise-scale architectures leveraging the Databricks Lakehouse platform.

Establish data governance frameworks with Unity Catalog (lineage auditing security compliance).

Oversee multiple delivery streams ensuring alignment with standards and best practices.

Drive reusable accelerators frameworks and reference architectures.

Engage with stakeholders on cost optimization innovation and roadmap planning.

Lead thought leadership initiatives (whitepapers blogs conferences).

Mentor and coach developers senior developers and leads.

Support Centers of Excellence (CoE) and competency frameworks.

Stay ahead of emerging technologies trends and Databricks innovations.

Qualifications we seek in you!

Minimum qualifications

Bachelors Degree or equivalency (CS CE CIS IS MIS or engineering discipline) or equivalent work experience.

Relevant years in data engineering with hands-on Databricks experience.

End-to-end implementation of at least 2 Databricks projects(migration / integration).

Strong background in batch and streaming data pipelines.

Proficiency in Python (preferred) or Scala for Spark-based development.

Expertise in SQL & Spark-SQL data structures and algorithms.

Deep knowledge of Databricks components : Delta Lake DLT dbConnect REST API 2.0 Workflows orchestration.

Design develop and optimize large-scale batch pipelines for ingestion transformation and analytics using Databricks.

Build and manage low-latency streaming pipelines using Spark Structured Streaming Delta Live Tables or other Databricks-native frameworks to enable real-time insights and decision-making.

Strong in performance optimization for pipelines (efficiency scalability cost reduction).

Hands-on experience with Apache Spark Hive and Lakehouse architecture.

Cloud expertise (Azure / AWS) includes storage (ADLS / S3) messaging (ASB / SQS) compute (ADF / Lambda) and databases (CosmosDB / DynamoDB / Cloud SQL).

Experience writing unit tests and integration tests for data pipelines.

Ability to work with architects and lead engineers to design solutions meeting functional & non-functional requirements.

Excellent technical skills to enabling the creation of future-proof complex global solutions

Team player with experience leading teams of 5 engineers.

Strong communication and client-facing skills.

Keeps updated with emerging technologies and industry trends.

Strong analytical and problem-solving abilities.

Positive attitude towards continuous learning and upskilling

Good to have Databricks SQL Endpoint understanding.

Good to have understanding on LakeflowConnect Lakeflow Declarative Pipelines

Good To have CI / CD experience to build the pipeline for Databricks jobs.

Good to have if worked on migration project to build Unified data platform.

Good to have knowledge of DBT.

Good to have knowledge of docker and Kubernetes.

Certification on Databricks Associate or Professional level.

Any one Cloud Certification (AWS / Azure) Associate / Professional level Data Engineer or Architect level is an added advantage

Why join Genpact

Be a transformation leader Work at the cutting edge of AI automation and digital innovation

Make an impact Drive change for global enterprises and solve business challenges that matter

Accelerate your career Get hands-on experience mentorship and continuous learning opportunities

Work with the best Join 140000 bold thinkers and problem-solvers who push boundaries every day

Thrive in a values-driven culture Our courage curiosity and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress

Come join the tech shapers and growth makers at Genpact and take your career in the only direction that matters : Up.

Lets build tomorrow together.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race color religion or belief sex age national origin citizenship status marital status military / veteran status genetic information sexual orientation gender identity physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity customer focus and innovation.

Furthermore please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a starter kit paying to apply or purchasing equipment or training.

Required Experience :

Staff IC

Key Skills

Enterprise Software,SAP Warehouse Management,AWS,Solution Architecture,SAP EWM,SAP Finance & Controlling,SAP Supply Chain Management,SAP S / 4HANA,Enterprise Sales,Pre-sales,Management Consulting,Oracle

Employment Type : Full-Time

Experience : years

Vacancy : 1

Create a job alert for this search

Principal Consultant • Chennai, Tamil Nadu, India

Related jobs
  • Promoted
Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

Sky Systems, Inc. (SkySys)Chennai, IN
Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire). Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show moreLast updated: 3 days ago
  • Promoted
Sr. Azure Data Architect & Presales Solution

Sr. Azure Data Architect & Presales Solution

Programmers.ioChennai, IN
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show moreLast updated: 4 days ago
  • Promoted
AWS Data Architect

AWS Data Architect

ACL DigitalChennai, IN
AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show moreLast updated: 9 days ago
  • Promoted
Cognos Developer - Databricks & Big Data

Cognos Developer - Databricks & Big Data

Lancesoft India Pvt LtdChennai
About the Role : LanceSoft is seeking an experienced COGNOS Developer to design, develop, and optimize business intelligence solutions using IBM Cognos Analytics.The ...Show moreLast updated: 30+ days ago
  • Promoted
Principal Consultant

Principal Consultant

ConfidentialChennai
This role would require designing, configuring, and developing new business processes, enhancing existing solution in SAP Finance & Controlling within the purview of global template, and supporting...Show moreLast updated: 30+ days ago
  • Promoted
Principal Analytics Consultant

Principal Analytics Consultant

ProspectionChennai, IN
Are you passionate about turning real-world healthcare data into actionable insights that improve patient outcomes? At.RWD) to deliver high-impact outcomes for pharmaceutical companies, healthcare ...Show moreLast updated: 30+ days ago
  • Promoted
Principal Consultant- Databricks Lead Developer!

Principal Consultant- Databricks Lead Developer!

ConfidentialChennai
Ready to shape the future of work.AI and digital innovation are redefining industries, and.If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be ...Show moreLast updated: 10 days ago
  • Promoted
Principal Data Engineer IRC276334

Principal Data Engineer IRC276334

ConfidentialChennai, India
Data platform that bridges marketing strategy to scaled activation.Must have 10+ years of experience.Experience architecting ML-based solutions in conjunction with DS teams, software engineering te...Show moreLast updated: 11 days ago
  • Promoted
Databricks Architect

Databricks Architect

ConfidentialChennai, India
We are seeking an experienced .The ideal candidate will have deep expertise in big data technologies, cloud platforms, and analytics architectures, with strong communication skills to interact with...Show moreLast updated: 22 days ago
  • Promoted
Kissflow - Principal Solution Consultant

Kissflow - Principal Solution Consultant

ConfidentialChennai, India
Have you dreamt of working in a Product based company Heres an opportunity for you!.Kissflow is the leader in no-code citizen development and a strong player in low-code application development emp...Show moreLast updated: 22 days ago
  • Promoted
MicroStrategyE3

MicroStrategyE3

ConfidentialChennai
Design schema objects (attributes, facts, metrics) and application objects (grids, filters, prompts).Optimize and tune MicroStrategy performance for large datasets and complex reports.Integrate Mic...Show moreLast updated: 30+ days ago
Senior Consultant

Senior Consultant

Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India
Quick Apply
Client : Leading Analytics, Data Engineering, AI and ML Company HQ in the US, with offices in India.Looking for a candidate who can join immediately or can join in 10-15 days.Collaborate with the da...Show moreLast updated: 30+ days ago
  • Promoted
Principal Data Engineer

Principal Data Engineer

CodeMyMobileChennai, IN
Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show moreLast updated: 18 days ago
  • Promoted
SAP Signavio Consultant

SAP Signavio Consultant

DATAQUAD IT SOLUTIONS PRIVATE LIMITEDChennai
Job Description : - For a Celonis to SAP Signavio migration project, looking for Primary skills and project experience in Data Modelling with Signavi...Show moreLast updated: 30+ days ago
  • Promoted
Lead Consultant - Technical Platform Owner - Data

Lead Consultant - Technical Platform Owner - Data

ConfidentialChennai, India
Job Title : Lead Consultant - Technical Platform Owner.Are you ready to redefine an industry and change lives Join our global Operations IT team, where we combine innovative science with leading dig...Show moreLast updated: 17 days ago
  • Promoted
Principal Solutions Consultant

Principal Solutions Consultant

KissflowChennai, Tamil Nadu, India
This role demands a hands-on professional with a strong grasp of business requirements and expertise in low-code / no-code platforms is preferred. In addition to closely engaging with customers, you w...Show moreLast updated: 30+ days ago
  • Promoted
Infocepts - Microstrategy Developer - SQL / ETL

Infocepts - Microstrategy Developer - SQL / ETL

InfoCepts Technologies Pvt. Ltd.Chennai
Job Summary : We are looking for a skilled MicroStrategy Developer with strong expertise in SQL and hands-on experience in designing, developing, ...Show moreLast updated: 30+ days ago
  • Promoted
Solution Architect - Big Data Platform

Solution Architect - Big Data Platform

MOURITechChennai
Role Overview : Seeking an accomplished End-to-End (E2E) Data Architect to lead the design and implementation of large-scale Big Data solutions.The ideal candidate wi...Show moreLast updated: 30+ days ago