Talent.com
No longer accepting applications
Senior Principal consultant-Databricks Architect

Senior Principal consultant-Databricks Architect

GenpactKolkata, West Bengal, India
21 days ago
Job description

Ready to shape the future of work?

At Genpact, we don’t just adapt to change—we drive it. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges.

If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that’s shaping the future, this is your moment.

Genpact (NYSE : G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook.

Inviting applications for the role of Senior Principal Consultant - Databricks Architect!

In this role, the Databricks Architect is responsible for providing technical direction and lead a group of one or more developer to address a goal.

Responsibilities

  • Architect and design solutions to meet functional and non-functional requirements.
  • Create and review architecture and solution design artifacts.
  • Evangelize re-use through the implementation of shared assets.
  • Enforce adherence to architectural standards / principles, global product-specific guidelines, usability design standards, etc.
  • Proactively guide engineering methodologies, standards, and leading practices.
  • Guidance of engineering staff and reviews of as-built configurations during the construction phase.
  • Provide insight and direction on roles and responsibilities required for solution operations.
  • Identify, communicate and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.
  • Considers the art of the possible, compares various architectural options based on feasibility and impact, and proposes actionable plans.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Ability to analyze and operate at various levels of abstraction.
  • Ability to balance what is strategically right with what is practically realistic.
  • Growing the Data Engineering business by helping customers identify opportunities to deliver improved business outcomes, designing and driving the implementation of those solutions.
  • Growing & retaining the Data Engineering team with appropriate skills and experience to deliver high quality services to our customers.
  • Supporting and developing our people, including learning & development, certification & career development plans
  • Providing technical governance and oversight for solution design and implementation
  • Should have technical foresight to understand new technology and advancement.
  • Leading team in the definition of best practices & repeatable methodologies in Cloud Data Engineering, including Data Storage, ETL, Data Integration & Migration, Data Warehousing and Data Governance
  • Should have Technical Experience in Azure, AWS & GCP Cloud Data Engineering services and solutions.
  • Contributing to Sales & Pre-sales activities including proposals, pursuits, demonstrations, and proof of concept initiatives
  • Evangelizing the Data Engineering service offerings to both internal and external stakeholders
  • Development of Whitepapers, blogs, webinars and other though leadership material
  • Development of Go-to-Market and Service Offering definitions for Data Engineering
  • Working with Learning & Development teams to establish appropriate learning & certification paths for their domain.
  • Expand the business within existing accounts and help clients, by building and sustaining strategic executive relationships, doubling up as their trusted business technology advisor.
  • Position differentiated and custom solutions to clients, based on the market trends, specific needs of the clients and the supporting business cases.
  • Build new Data capabilities, solutions, assets, accelerators, and team competencies.
  • Manage multiple opportunities through the entire business cycle simultaneously, working with cross-functional teams as necessary.

Qualifications we seek in you!

Minimum qualifications

  • Excellent technical architecture skills, enabling the creation of future-proof, complex global solutions.
  • Excellent interpersonal communication and organizational skills are required to operate as a leading member of global, distributed teams that deliver quality services and solutions.
  • Ability to rapidly gain knowledge of the organizational structure of the firm to facilitate work with groups outside of the immediate technical team.
  • Knowledge and experience in IT methodologies and life cycles that will be used.
  • Familiar with solution implementation / management, service / operations management, etc.
  • Leadership skills can inspire others and persuade.
  • Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
  • Bachelor’s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience
  • Experience in a solution architecture role using service and hosting solutions such as private / public cloud IaaS, PaaS, and SaaS platforms.
  • Experience in architecting and designing technical solutions for cloud-centric solutions based on industry standards using IaaS, PaaS, and SaaS capabilities.
  • Must have strong hands-on experience on various cloud services like ADF / Lambda, ADLS / S3, Security, Monitoring, Governance
  • Must have experience to design platform on Databricks.
  • Hands-on Experience to design and build Databricks based solution on any cloud platform.
  • Hands-on experience to design and build solution powered by DBT models and integrate with databricks.
  • Must be very good designing End-to-End solution on cloud platform.
  • Must have good knowledge of Data Engineering concept and related services of cloud.
  • Must have good experience in Python and Spark.
  • Must have good experience in setting up development best practices.
  • Intermediate level knowledge is required for Data Modelling.
  • Good to have knowledge of docker and Kubernetes.
  • Experience with claims-based authentication (SAML / OAuth / OIDC), MFA, RBAC, SSO etc.
  • Knowledge of cloud security controls including tenant isolation, encryption at rest, encryption in transit, key management, vulnerability assessments, application firewalls, SIEM, etc.
  • Experience building and supporting mission-critical technology components with DR capabilities.
  • Experience with multi-tier system and service design and development for large enterprises
  • Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technologies.
  • Exposure to infrastructure and application security technologies and approaches
  • Familiarity with requirements gathering techniques.
  • Preferred qualifications

  • Must have designed the E2E architecture of unified data platform covering all the aspect of data lifecycle starting from Data Ingestion, Transformation, Serve and consumption.
  • Must have excellent coding skills either Python or Scala, preferably Python.
  • Must have experience in Data Engineering domain with total
  • Must have designed and implemented at least 2-3 project end-to-end in Databricks.
  • Must have experience on databricks which consists of various components as below
  • o Delta lake

    o dbConnect

    o db API 2.0

    o SQL Endpoint – Photon engine

    o Unity Catalog

    o Databricks workflows orchestration

    o Security management

    o Platform governance

    o Data Security

  • Must have knowledge of new features available in Databricks and its implications along with various possible use-case.
  • Must have followed various architectural principles to design best suited per problem.
  • Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
  • Must have strong understanding of Data warehousing and various governance and security standards around Databricks.
  • Must have knowledge of cluster optimization and its integration with various cloud services.
  • Must have good understanding to create complex data pipeline.
  • Must be strong in SQL and sprak-sql.
  • Must have strong performance optimization skills to improve efficiency and reduce cost.
  • Must have worked on designing both Batch and streaming data pipeline.
  • Must have extensive knowledge of Spark and Hive data processing framework.
  • Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS / S3, ADF / Lambda, CosmosDB / DynamoDB, ASB / SQS, Cloud databases.
  • Must be strong in writing unit test case and integration test.
  • Must have strong communication skills and have worked with cross platform team.
  • Must have great attitude towards learning new skills and upskilling the existing skills.
  • Responsible to set best practices around Databricks CI / CD.
  • Must understand composable architecture to take fullest advantage of Databricks capabilities.
  • Good to have Rest API knowledge.
  • Good to have understanding around cost distribution.
  • Good to have if worked on migration project to build Unified data platform.
  • Good to have knowledge of DBT.
  • Experience around DevSecOps including docker and Kubernetes.
  • Software development full lifecycle methodologies, patterns, frameworks, libraries, and tools
  • Knowledge of programming and scripting languages such as JavaScript, PowerShell, Bash, SQL, Java, Python, etc.
  • Experience with data ingestion technologies such as Azure Data Factory, SSIS, Pentaho, Alteryx
  • Experience with visualization tools such as Tableau, Power BI
  • Experience with machine learning tools such as mlFlow, Databricks AI / ML, Azure ML, AWS sagemaker, etc.
  • Experience in distilling complex technical challenges to actionable decisions for stakeholders and guiding project teams by building consensus and mediating compromises when necessary.
  • Experience coordinating the intersection of complex system dependencies and interactions
  • Experience in solution delivery using common methodologies especially SAFe Agile but also Waterfall, Iterative, etc.
  • Demonstrated knowledge of relevant industry trends and standards

    Why join Genpact?

  • Be a transformation leader – Work at the cutting edge of AI, automation, and digital innovation
  • Make an impact – Drive change for global enterprises and solve business challenges that matter
  • Accelerate your career – Get hands-on experience, mentorship, and continuous learning opportunities
  • Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day
  • Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
  • Come join the tech shapers and growth makers at Genpact and take your career in the only direction that matters : Up.

    Let’s build tomorrow together.

    Create a job alert for this search

    Principal Architect • Kolkata, West Bengal, India

    Related jobs
    • Promoted
    Oracle Consultant

    Oracle Consultant

    DigileKolkata, IN
    ODI and OIC in enterprise Oracle ERP integration and migration projects.Proven experience leading integrations from source systems to Oracle ERP Cloud, including master and transactional data flows...Show moreLast updated: 9 days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    AaysKolkata, IN
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 30+ days ago
    • Promoted
    Data & AI Architect

    Data & AI Architect

    Delphi Consulting Middle EastKolkata, IN
    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. Interviews and onboarding are condu...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Azure Cloud Architect / Principal Engineer

    Principal Azure Cloud Architect / Principal Engineer

    First American (India)Kolkata, IN
    Job Title : Principal Azure Cloud Architect / Principal Engineer (20+ Years Experience).We are seeking a technical visionary Principal Azure Cloud Architect with 20+ years of experience to lead the tr...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Architect

    Principal Architect

    AltudoKolkata, IN
    Altudo is seeking a Principal Architect to act as the India-based lead within the Chief Architect’s Office (CAO).This role is critical in extending architectural leadership, supporting incident res...Show moreLast updated: 18 days ago
    • Promoted
    AI Data Architect

    AI Data Architect

    Tata Consultancy Serviceskolkata, west bengal, in
    We are seeking an inventive Data Architect for AI with 8–15 years of experience to lead the strategic design and implementation of enterprise-scale AI solutions. ETL / ELT, Big Data cloud data solutio...Show moreLast updated: 4 days ago
    • Promoted
    Data Solutions Architect

    Data Solutions Architect

    BristleconeKolkata, IN
    We are seeking an accomplished Data Solutions Architect with deep experience in designing, implementing, and optimizing modern cloud data platforms. The ideal candidate will expertly leverage Snowfl...Show moreLast updated: 24 days ago
    • Promoted
    Fabric Platform Data Architect (Remote)

    Fabric Platform Data Architect (Remote)

    Thinkgrid LabsKolkata, IN
    Remote
    Thinkgrid Labs is at the forefront of innovation and technology.Our expert team of software engineers, architects, and UI / UX designers specialises in crafting bespoke web, mobile, cloud application...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Analytics Consultant

    Principal Analytics Consultant

    ProspectionKolkata, IN
    Are you passionate about turning real-world healthcare data into actionable insights that improve patient outcomes? At.Principal Analytics Consultant. RWD) to deliver high-impact outcomes for pharma...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Principal Architect

    AWS Principal Architect

    AdastraKolkata, IN
    We’re Hiring : AWS Principal Architect.Are you passionate about designing and managing complex cloud infrastructures? We are looking for a. AWS to join our team and lead cloud transformation initiati...Show moreLast updated: 8 days ago
    • Promoted
    Data Architect - Snowflake (Job Location : Kerala)

    Data Architect - Snowflake (Job Location : Kerala)

    Reflections Info Systemskolkata, west bengal, in
    We are looking for 10 + year experienced Data Architect with strong background in Snowflake, demonstrating leadership in technical design, architecture, and implementation of complex data solutions...Show moreLast updated: 1 day ago
    • Promoted
    Cloud Architect

    Cloud Architect

    IntraEdgekolkata, west bengal, in
    Senior Cloud Architecture Engineer.The Senior Cloud Architecture Engineer is responsible for designing, building and maintaining the underlying PaaS systems that products and services run on, with ...Show moreLast updated: 24 days ago
    • Promoted
    Data Architect

    Data Architect

    G10XKolkata, IN
    Senior Data Architect (15+ Years Experience).We are looking for a seasoned Data Architect to lead and shape enterprise-wide data initiatives. This role requires a strategic leader with deep technica...Show moreLast updated: 24 days ago
    • Promoted
    Data Architect

    Data Architect

    Tata Consultancy ServicesKolkata, West Bengal, India
    Required Technical Skill Set • •Databricks, AWS ,RedshiftEDW DB to Databricks Lakehouse Platform on AWS.Desired Experience Range • •12+ years with 4-5+ years in Cloud Data Architecture, Databricks and ...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Serviceskolkata, west bengal, in
    Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 9 days ago
    • Promoted
    Data Architect

    Data Architect

    Greymatter InnovationzKolkata, IN
    Greymatter Innovationz helps you stay digitally relevant across domains, technologies, and skillsets, every day.Design and maintain enterprise-wide unified data platform, primarily through establis...Show moreLast updated: 2 days ago
    • Promoted
    Cloud Architect-AI

    Cloud Architect-AI

    HCLTechkolkata, west bengal, in
    AI Cloud Architect + developer.You will be responsible for creating scalable, secure, and cost-effective cloud architectures that meet the business and technical requirements of the projects.You wi...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Cloud Architect

    Azure Cloud Architect

    Persistent Systemskolkata, west bengal, in
    We are seeking an experienced Azure Data Cloud Architect to design, implement, and optimize cutting-edge data solutions on Microsoft Azure. You will collaborate with cross-functional teams to transl...Show moreLast updated: 9 days ago
    • Promoted
    Enterprise Architect

    Enterprise Architect

    Paritas RecruitmentKolkata, IN
    Enterprise Architect (Data Leader) - Long term Contract.Location : Kolkata, Pune or Bengaluru.Competitive Market Daily Rate on offer (USD). Paritas is currently seeking an experienced Data Architect ...Show moreLast updated: 9 days ago
    • Promoted
    Senior Consultant / Architect – CyberArk (PAM)

    Senior Consultant / Architect – CyberArk (PAM)

    CyberSolveKolkata, IN
    CyberSolve is a fastest growing IAM Specialist firm in the US with aspirations of becoming the world's largest company in the IAM space. CyberSolve’s 350+ specialists solve interesting puzzles in IG...Show moreLast updated: 9 days ago