Talent.com
Lead Data Solutions Architect
Lead Data Solutions ArchitectRainier Softech Solutions Pvt Ltd • Bengaluru, Republic Of India, IN
Lead Data Solutions Architect

Lead Data Solutions Architect

Rainier Softech Solutions Pvt Ltd • Bengaluru, Republic Of India, IN
7 days ago
Job description

Sr. Data Engineer (Databricks)

About the Role

We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks. You’ll turn requirements into production-grade ELT / ETL jobs, Delta Lake tables, and reusable components that speed up our teams. In this role, you’ll implement and improve reference patterns, optimize Spark for performance and cost, apply best practices with Unity Catalog and workflow orchestration, and ship high-quality code others can build on. If you love solving data problems at scale and empowering teammates through clean, well-documented solutions, you’ll thrive here.

Core Qualifications :

  • Bachelor’s degree in computer science, Engineering, or a related field
  • 7+ years of experience in software / data engineering, including at least 2 years working with Databricks and Apache Spark
  • Strong proficiency in Python, SQL, and PySpark
  • Deep understanding of AWS and Azure Cloud service
  • Experience with Databricks Data LakeHouse, Databricks Workflows, and Databricks SQL, dbt
  • Solid grasp of data Lakehouse and warehousing architecture
  • Prior experience supporting AI / ML workflows, including training data pipelines and model deployment support
  • Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
  • Strong analytical and troubleshooting skills in a fast-paced, agile environment
  • Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders
  • Clear communicator with strong documentation habits
  • Comfortable leading discussions, offering strategic input, and mentoring others

Key Responsibilities :

  • The ideal candidate will have a strong background in building scalable data pipelines, optimizing big data workflows, and integrating Databricks with cloud services
  • This role will play a pivotal part in enabling the customer’s data engineering and analytics initiatives—especially those tied to AI-driven solutions and projects—by implementing cloud-native architectures that fuel innovation and sustainability
  • Partner directly with the customer’s data engineering team to design and deliver scalable, cloud-based data solutions
  • Execute complex ad-hoc queries using Databricks SQL to explore large lakehouse datasets and uncover actionable insights
  • Leverage Databricks notebooks to develop robust data transformation workflows using PySpark and SQL
  • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks
  • Build ETL / ELT workflows with AWS and Azure Services
  • Optimize Spark jobs for both performance and cost within the customer’s cloud infrastructure
  • Collaborate with data scientists, ML engineers, and business analysts to support AI and machine learning use cases, including data preparation, feature engineering, and model operationalization
  • Contribute to the development of AI-powered solutions that improve operational efficiency, route optimization, and predictive maintenance in the waste management domain
  • Implement CI / CD pipelines for Databricks jobs using GitHub Actions, Azure DevOps, or Jenkins
  • Ensure data quality, lineage, and compliance through tools like Unity Catalog, Delta Lake, and AWS Lake Formation
  • Troubleshoot and maintain production data pipelines
  • Provide mentorship and share best practices with both internal and customer teams
  • Create a job alert for this search

    Lead Data Architect • Bengaluru, Republic Of India, IN

    Related jobs
    Lead Data Solutions Architect

    Lead Data Solutions Architect

    Quantiphi • Bengaluru, Republic Of India, IN
    Bangalore, Mumbai OR Trivandrum (Hybrid).You will be working as a Data architect designing and delivering big data pipelines for structured and unstructured data that are running across multiple ge...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Solutions Architect

    Senior Data Solutions Architect

    NeerInfo Solutions • Bengaluru, Republic Of India, IN
    Modern Data Architect to lead the design and implementation of next-generation data platforms.Responsible for architecting scalable, cloud-native, and real-time data ecosystems to support advanced ...Show more
    Last updated: 5 days ago • Promoted
    Data Solutions Architect

    Data Solutions Architect

    TP • Bengaluru, Republic Of India, IN
    Design end-to-end data solutions, including data lakes, lakehouses, real-time streaming pipelines, ETL / ELT workflows, and data integration architectures. Ensure modularity, scalability, and interope...Show more
    Last updated: 22 days ago • Promoted
    Lead Data Solutions Architect

    Lead Data Solutions Architect

    PriceEasy AI • Bengaluru, Republic Of India, IN
    Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advan...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Solutions Architect

    Lead Data Solutions Architect

    Tata Consultancy Services • Bengaluru, Republic Of India, IN
    Skill : Principal Data Engineer.Possesses hands-on technical experience working in AWS.The individual should possess a robust set of technical and soft skills and be an excellent AWS Data Engineer ...Show more
    Last updated: 30+ days ago • Promoted
    Data Solutions Architect & Implementation Lead

    Data Solutions Architect & Implementation Lead

    Impelsys • Bengaluru, Republic Of India, IN
    Job Title : Technical Architect / Delivery Lead.Walk-in Drive : 27th November, 2025.IWF Campus, Whitefield Main Road, B Narayanapura, Mahadevapura, Bengaluru, Karnataka 560048.As a Technical Architec...Show more
    Last updated: 3 days ago • Promoted
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting Solutions • Bengaluru, IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
    Last updated: 8 days ago • Promoted
    Lead Azure Data Solutions Architect

    Lead Azure Data Solutions Architect

    Genpact • Bengaluru, Republic Of India, IN
    We are seeking an experienced Azure Data & Analytics Architect with a strong background in delivery and excellent communication skills. The ideal candidate will have experience and a proven track re...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Solutions Architect

    Lead Data Solutions Architect

    Datamatics • Bengaluru, Republic Of India, IN
    Demonstrated domain experience in BFSI and Manufacturing industries.Lead strategic enterprise data transformations with SAS to Databricks migration as a core capability. Architect cloud-native data ...Show more
    Last updated: 13 days ago • Promoted
    Lead Data Solutions Architect

    Lead Data Solutions Architect

    GrayMatter Software Services • Bengaluru, Republic Of India, IN
    We are seeking a highly skilled Technical Architect with 12+ years of experience to oversee and guide the development of advanced data architectures, business intelligence solutions, and ETL workfl...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Solutions Architect

    Lead Data Solutions Architect

    Incept Labs • Bengaluru, Republic Of India, IN
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show more
    Last updated: 30+ days ago • Promoted
    Data Solution Architect

    Data Solution Architect

    Bristlecone • Bengaluru, Karnataka, India
    Bangalore / Flexible / Remote].We are seeking an accomplished.The ideal candidate will expertly leverage.Snowflake, Databricks, DBT, Airflow, Python, PySpark. AI / ML and Generative AI (GenAI).You wil...Show more
    Last updated: 1 day ago • Promoted
    Data Architect

    Data Architect

    Genisys Group • Bengaluru, Karnataka, India
    The Data Lead / Data Architect will own the vision, design, and delivery of cutting-edge enterprise data platforms and modern analytics solutions across public clouds and hybrid infrastructures.This ...Show more
    Last updated: 8 days ago • Promoted
    Lead Data Solutions Architect

    Lead Data Solutions Architect

    LTIMindtree • Bengaluru, Republic Of India, IN
    Senior data architect with experience in Supply Chain domain - JD.Senior data architect with mandatory experience in Supply Chain domain (one or more of logistics, planning, materials management, e...Show more
    Last updated: 7 days ago • Promoted
    Lead Data & AI Solutions Architect

    Lead Data & AI Solutions Architect

    SCIENTE • Bengaluru, Republic Of India, IN
    Sciente Group is a multi-award winning, ISO9001 / Great Place to Work certified, Singapore headquartered technology focused organisation with business interest in Singapore (HQ), USA, Malaysia, Phili...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Solutions Architect

    Lead Data Solutions Architect

    FM • Bengaluru, Republic Of India, IN
    We are a highly successful 190-year-old, Fortune 500 commercial property insurance company of 6,000+ employees with a unique focus on science and risk engineering. Businesses worldwide trust our exp...Show more
    Last updated: 19 days ago • Promoted
    Enterprise Data Solutions Architect

    Enterprise Data Solutions Architect

    Genisys Group • Bengaluru, Republic Of India, IN
    The Data Lead / Data Architect will own the vision, design, and delivery of cutting-edge enterprise data platforms and modern analytics solutions across public clouds and hybrid infrastructures.This ...Show more
    Last updated: 9 days ago • Promoted
    Lead Data Architect

    Lead Data Architect

    Sigmoid • Bengaluru, Republic Of India, IN
    Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations ...Show more
    Last updated: 30+ days ago • Promoted