Talent.com
Databricks Architect

Databricks Architect

ConfidentialDelhi, Pune, Bengaluru / Bangalore
30+ days ago
Job description
  • Overall 10-18 yrs. of Data Engineering experience with Minimum 4+ years of hands on experience in Databricks. Ready to travel Onsite and work at client location.
  • Proven hands-on experience as a Databricks Architect or similar role with a deep understanding of the Databricks platform and its capabilities.
  • Analyze business requirements and translate them into technical specifications for data pipelines, data lakes, and analytical processes on the Databricks platform.
  • Design and architect end-to-end data solutions, including data ingestion, storage, transformation, and presentation layers, to meet business needs and performance requirements.
  • Lead the setup, configuration, and optimization of Databricks clusters, workspaces, and jobs to ensure the platform operates efficiently and meets performance benchmarks.
  • Manage access controls and security configurations to ensure data privacy and compliance.
  • Design and implement data integration processes, ETL workflows, and data pipelines to extract, transform, and load data from various sources into the Databricks platform.
  • Optimize ETL processes to achieve high data quality and reduce latency.
  • Monitor and optimize query performance and overall platform performance to ensure efficient execution of analytical queries and data processing jobs.
  • Identify and resolve performance bottlenecks in the Databricks environment.
  • Establish and enforce best practices, standards, and guidelines for Databricks development, ensuring data quality, consistency, and maintainability.
  • Implement data governance and data lineage processes to ensure data accuracy and traceability.
  • Mentor and train team members on Databricks best practices, features, and capabilities.
  • Conduct knowledge-sharing sessions and workshops to foster a data-driven culture within the organization.
  • Will be responsible for Databricks Practice Technical / Partnership initiatives.
  • Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects.
  • Roles & Responsibilities

    • Bachelor's or Masters degree in Computer Science, Information Technology, or related field.
    • In depth hands-on implementation knowledge on Databricks. Delta Lake, Delta table - Managing Delta Tables, Databricks Cluster Configuration, Cluster policies.
    • Experience handling structured and unstructured datasets
    • Strong proficiency in programming languages like Python, Scala, or SQL.
    • Experience with Cloud platforms like AWS, Azure, or Google Cloud, and understanding of cloud-based data storage and computing services.
    • Familiarity with big data technologies like Apache Spark, Hadoop, and data lake architectures.
    • Develop and maintain data pipelines, ETL workflows, and analytical processes on the Databricks platform.
    • Should have good experience in Data Engineering in Databricks Batch process and Streaming
    • Should have good experience in creating Workflows & Scheduling the pipelines.
    • Should have good exposure on how to make packages or libraries available in DB.
    • Familiarity in Databricks default runtimes
    • Databricks Certified Data Engineer Associate / Professional Certification (Desirable).
    • Should have experience working in Agile methodology
    • Strong verbal and written communication skills.
    • Strong analytical and problem-solving skills with a high attention to detail.
    • Role :   Solution Architect

      Industry Type :   IT Services & Consulting

      Department :   Engineering - Software & QA

      Employment Type :   Full Time, Permanent

      Role Category :   Software Development

      Education

      UG :   BCA in Any Specialization, B.Tech / B.E. in Any Specialization

      PG :   MCA in Any Specialization, M.Tech in Any Specialization

      Skills Required

      Azure Synapse, Azure Data Factory, Architecture, Pyspark, Azure Databricks, Sql

    Create a job alert for this search

    Architect • Delhi, Pune, Bengaluru / Bangalore

    Related jobs
    • Promoted
    Data Architect

    Data Architect

    RecroPune, IN
    Central Data Office – Data Architect.SMEs, engineers, and developers to design and govern enterprise-level data architectures, ensuring alignment with corporate data principles and standards.This p...Show moreLast updated: 4 days ago
    • Promoted
    Data Architect

    Data Architect

    CareerUS SolutionsPune, IN
    The Data Architect is responsible for.This includes ensuring that data is.The role focuses on developing.Collaborate with software engineers, analysts, and stakeholders to understand data needs and...Show moreLast updated: 2 days ago
    • Promoted
    Databricks Solution Architect

    Databricks Solution Architect

    InspireXTPune
    Description : About InspireXT : InspireXT is on a mission to build the most trusted supply chains in the world.Our Connected I...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Architect

    Azure Data Architect

    Programmers.iopune, maharashtra, in
    Job Title : Azure Data Architect.Location : Hyderabad, pune (hybrid).Experience required : 12+ years.We are seeking a highly experienced S. The ideal candidate should bring strong expertise in SQL, ETL...Show moreLast updated: 30+ days ago
    • Promoted
    Data Solution Architect

    Data Solution Architect

    Persistent Systemspune, maharashtra, in
    The Architect will lead the design and implementation of scalable data solutions.This includes architecting cloud-native data pipelines, integrating tagging logic, and ensuring high-performance dat...Show moreLast updated: 21 days ago
    • Promoted
    Data Architect

    Data Architect

    Recruise India Consulting Pvt Ltdpune, maharashtra, in
    Architect platform, desginate integration points.Solution desgin based on incoming requests.Participate in architecture review boards. North star for technical and solution implementations of NexusO...Show moreLast updated: 1 day ago
    • Promoted
    Cloud Data Architect

    Cloud Data Architect

    PeoplefyPune, Maharashtra, India
    We are hiring for One of our MNC Client for.We are looking for Immediate Joiners / 30 days / 60 days or serving NP.Strong knowledge of SQL Server 2019 (T-SQL), and NoSQL databases.Experience with E...Show moreLast updated: 1 day ago
    • Promoted
    2914 | Solution Architect

    2914 | Solution Architect

    EXLPune, Maharashtra, India
    Azure Solution Architect and team lead.All EXL location - Hybrid (Pune, Gurgaon, Hyderabad, Bangalore).Must be an Azure Solution architect and Data Architect with experience in.Should have lead Dat...Show moreLast updated: 24 days ago
    • Promoted
    Enterprise Data Architect

    Enterprise Data Architect

    DBiz.aiPune, IN
    You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI / ML initiatives at scale. You will work closely with business stakeholders and tech...Show moreLast updated: 14 days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    AaysPune, IN
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 30+ days ago
    • Promoted
    Solution & Data Architect - Azure Applications

    Solution & Data Architect - Azure Applications

    InfotechtionPune, IN
    Solution & Data Architect - Azure Applications .Location : India (Remote) | Employment Type : Full-time .Senior - 8-11+ Years of experience. We are seeking an accomplished Solution and Data Architect ...Show moreLast updated: 3 days ago
    • Promoted
    Data Architect

    Data Architect

    Tata Consultancy Servicespune, maharashtra, in
    Role- Snowflake Data Architect.Cloud data warehouse technologies on Snowflake and AWS, Azure or GCP.At least one End-to-end Snowflake implementation is a must covering all aspects including archite...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure Databricks Architect (Immediate Joiner) - Bengaluru / Pune / Chennai

    Azure Databricks Architect (Immediate Joiner) - Bengaluru / Pune / Chennai

    A Mid-size IT Co - Client of Axim Digitechpune, maharashtra, in
    Role : Azure Databricks Architect : .Relevant exp- 5 yrs as Architect experience.Work Location- Bangalore , Pune, Chennai , Hyderabad. Lead architecture, design, and implementation of data lakehouse so...Show moreLast updated: 10 hours ago
    • Promoted
    Data Architect

    Data Architect

    ACL DigitalPune, Maharashtra, India
    Technical skills and core competencies.Strong understanding of Data Architecture and models and leading data driven projects. Solid expertise and strong opinions on Data Modelling paradigms such as ...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Servicespune, maharashtra, in
    Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and consumption.Develop Data Pipelines...Show moreLast updated: 25 days ago
    • Promoted
    Data Architect

    Data Architect

    Persistent Systemspune, maharashtra, in
    We are seeking a highly skilled and experienced Azure Databricks Architect to lead the design, development, and implementation of scalable data solutions using Azure Databricks.This role involves w...Show moreLast updated: 22 days ago
    • Promoted
    Data Architect - Snowflake (Job Location : Kerala)

    Data Architect - Snowflake (Job Location : Kerala)

    Reflections Info Systemspune, maharashtra, in
    We are looking for 10 + year experienced Data Architect with strong background in Snowflake, demonstrating leadership in technical design, architecture, and implementation of complex data solutions...Show moreLast updated: 16 days ago
    • Promoted
    Data Architect- Databricks

    Data Architect- Databricks

    ConfidentialPune, India
    Data Architect (Databricks, Snowflake).Nagpur, Pune, Chennai, Bangalore.Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engine...Show moreLast updated: 7 days ago