Talent.com
This job offer is not available in your country.
Principal Engineer - Databricks

Principal Engineer - Databricks

FlexeraBengaluru, Karnataka, India
11 hours ago
Job description

Flexera saves customers billions of dollars in wasted technology spend. A pioneer in Hybrid ITAM and FinOps, Flexera provides award-winning, data-oriented SaaS solutions for technology value optimization (TVO), enabling IT, finance, procurement and cloud teams to gain deep insights into cost optimization, compliance and risks for each business service. Flexera One solutions are built on a set of definitive customer, supplier and industry data, powered by our Technology Intelligence Platform, that enables organizations to visualize their Enterprise Technology Blueprint™ in hybrid environments—from on-premises to SaaS to containers to cloud.

We’re transforming the software industry. We’re Flexera. With more than 50,000 customers across the world, we’re achievingthat goal.Butwe knowwe can’t do any of that without our team. Ready to help us re-imagine the industry during a time of substantial growth and ambitious plans? Come and see why we’re consistently recognized by Gartner, Forrester and IDC as a category leader in the marketplace. Learn more at flexera.com

At Flexera, we empower global enterprises by turning IT insights into action. We’re seeking a Principal Engineer with deep expertise in architecting and optimizing big data platforms, with a strong focus on Databricks. You’ll drive the core design and performance of our lakehouse, enabling analytics, AI / ML, and product innovation at scale.

As a senior technical leader, you’ll own key components of our data platform — collaborating with architects, data scientists, and engineers to deliver high-performance, scalable solutions. The ideal candidate is a Databricks expert, fluent in modern data engineering, distributed systems, and cloud-native architectures.

What you'll do :

  • Architect, design, and implement scalable and performant Databricks-based data pipelines, including batch and streaming workloads.
  • Optimize Databricks Lakehouse architecture — including Delta Lake, Unity Catalog, and Photon — for cost efficiency, data reliability, and query performance at scale.
  • Define and implement advanced data models and ontologies to support complex analytics and AI / ML workflows.
  • Design and tune complex Spark applications (PySpark and / or Scala) for high-volume data processing, including structured streaming and incremental processing.
  • Implement orchestration workflows (e.g., Databricks Workflows, Azure Data Factory, or similar) to automate data pipelines with robust monitoring and alerting.
  • Drive best practices for data governance, security, and lineage, leveraging Unity Catalog, table ACLs, and audit capabilities.
  • Optimize cluster configurations, autoscaling strategies, and cost management within Databricks environments.
  • Collaborate with data scientists and analytics engineers to enable self-service access to high-quality, well-documented datasets and features.
  • Lead complex troubleshooting efforts, deep performance tuning, and root-cause analysis across distributed systems.
  • Author and maintain technical artifacts, including architecture diagrams, design docs, reference implementations, and best practice guides.
  • Mentor and coach engineers across teams on Databricks internals, Spark performance tuning, and modern data engineering architectures.
  • Stay on top of emerging Databricks features (e.g., Mosaic AI, serverless compute, Delta Live Tables), advocating for their adoption when they bring tangible value.

You'll be expected to have :

  • Bachelor’s or higher degree in Computer Science, Software Engineering, or a related field.
  • 12+ years of software engineering experience, with 6+ years specifically in building large-scale data platforms.
  • Expert-level proficiency in Databricks, including :
  • Delta Lake internals (ACID transactions, time travel, Z-ordering, data compaction strategies)
  • Unity Catalog for data governance, security, and lineage
  • Advanced Spark tuning (shuffle management, partitioning strategies, caching, cluster configuration)
  • Databricks SQL Warehousing, Workflows, and MLflow integration
  • Strong expertise with cloud-native data engineering in Azure or AWS, including storage (ADLS / S3), networking, and IAM integration.
  • Knowledge of streaming architectures (Apache Kafka, structured streaming), schema evolution, and event-driven data modeling.
  • Hands-on experience with metadata catalogs, orchestration frameworks, and observability tooling (e.g., Datadog, Grafana).
  • Strong understanding of distributed systems, fault tolerance, and large-scale performance engineering.
  • Proven ability to solve complex, ambiguous problems and make architectural trade-offs in real-world production systems.
  • Excellent technical communication skills — ability to document, present, and explain technical concepts clearly to varied audiences.
  • Prior experience mentoring engineers, conducting design reviews, and setting technical direction across teams.
  • A continuous learner mindset — actively keeping pace with evolving Databricks platform capabilities and broader data engineering trends.
  • Preferred but not required :

  • Experience with Power BI Direct Lake mode and semantic modeling for lakehouse-based analytics.
  • Familiarity with Mosaic AI, Databricks GenAI capabilities, or Feature Store implementations.
  • Contributions to open-source Spark, Databricks community content, or certifications (e.g., Databricks Certified Data Engineer Professional).
  • At Flexera, we foster a fun and engaged hybrid working environment where collaboration and innovation thrive. We value diversity and encourage applicants from underrepresented groups in technology to apply.

    Join our team to not only contribute to a world-class global product but also to grow in your career. At Flexera, we encourage continuous learning and provide opportunities for professional development.

    Flexera is proud to be an equal opportunity employer. Qualified applicants will be considered for open roles regardless of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by local / national laws, policies and / or regulations.

    Flexera understands the value that results from employing a diverse, equitable, and inclusive workforce. We recognize that equity necessitates acknowledging past exclusion and that inclusion requires intentional effort. Our DEI(Diversity, Equity, and Inclusion)council is the driving force behind our commitment to championing policies and practices that foster a welcoming environment for all.

    We encourage candidates requiring accommodations to please let us know by emailing.

    Create a job alert for this search

    Principal Engineer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    • New!
    Principal Consultant- Databricks Developer

    Principal Consultant- Databricks Developer

    GenpactBengaluru, Karnataka, India
    Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Principal Cloud Engineer

    Principal Cloud Engineer

    BayerBengaluru, Karnataka, India
    At Bayer we’re visionaries, driven to solve the world’s toughest challenges and striving for a world where ,Health for all, Hunger for none’ is no longer a dream, but a real possibility.We’re doing...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Volvo CarsNandhagudi, Karnataka, India
    We bring bold digital visions to life.So we’re on the lookout for more curious and creative engineers who want to create change – one line of high-quality code at a time. Our transformation isn't fo...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    ETL Data Engineer – AWS & Python Specialist

    ETL Data Engineer – AWS & Python Specialist

    EastvantageBangalore Rural, Karnataka, India
    We're Hiring : ETL Data Engineer – AWS & Python Specialist!.We are seeking an experienced ETL Data Engineer to design, develop, and maintain robust data pipelines using AWS cloud services and Python...Show moreLast updated: 11 hours ago
    • Promoted
    Principal Engineer

    Principal Engineer

    Recrobangalore district, karnataka, in
    Essential duties / responsibilities : .Investigate, troubleshoot, and resolve software issues to ensure system stability and reliability. Maintain and enhance existing applications by optimizing perform...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Principal Data Engineer

    Principal Data Engineer

    ScaleneWorksBengaluru, Karnataka, India
    Being aware of departmental guidance on best practices, processes, templates, clauses and playbooks.Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Principal Data Engineer

    Principal Data Engineer

    Commonwealth BankBengaluru, Karnataka, India
    At CommBank, we never lose sight of the role we play in other people’s financial wellbeing.Our focus is to help people and businesses move forward to progress. To make the right financial decisions ...Show moreLast updated: 11 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIhosur, tamil nadu, in
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 21 days ago
    • Promoted
    Principal Engineer

    Principal Engineer

    CoffeeBeansBangalore Urban, Karnataka, India
    CoffeeBeans Consulting is a tech consulting firm focused on making organizations.We are looking for a Principal Engineer who can design and implement complex solutions that are scalable, future-pro...Show moreLast updated: 3 days ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticshosur, tamil nadu, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TechVeritohosur, tamil nadu, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Principal Data Engineer

    Principal Data Engineer

    PayPalBengaluru, Karnataka, India
    This position will report to the Head of Credit Internal Data and will require a significant amount of collaboration across all business, technologies, product & platform teams within PayPal and it...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight Globalhosur, tamil nadu, in
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on LinkedIn with resume. Design, develop, and maintai...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Principal Engineer, Enterprise Data Platform

    Principal Engineer, Enterprise Data Platform

    Western DigitalBengaluru, Karnataka, India
    At Western Digital, our vision is to power global innovation and push the boundaries of technology to make what you thought was once impossible, possible. At our core, Western Digital is a company o...Show moreLast updated: 11 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHhosur, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Principal Engineer, Data Platform

    Principal Engineer, Data Platform

    NetskopeBengaluru, Karnataka, India
    Today, there's more data and users outside the enterprise than inside, causing the network perimeter as we know it to dissolve. We realized a new perimeter was needed, one that is built in the cloud...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Principal Engineer (Data Platform)

    Principal Engineer (Data Platform)

    Weekday AIBengaluru, Karnataka, India
    This role is for one of Weekday’s clients.We are looking for a seasoned Principal Engineer to lead the design and development of next-generation data pipelines that enable near real-time ingestion ...Show moreLast updated: 11 hours ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    PriceEasy AIbangalore, karnataka, in
    Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advan...Show moreLast updated: 30+ days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    Aayshosur, tamil nadu, in
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 18 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    XebiaBengaluru, IN
    We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 25 days ago