Talent.com
Data Bricks Developer

Data Bricks Developer

Tata TechnologiesMumbai, Maharashtra, India
16 days ago
Job description

Purpose of the Role :

We are seeking a skilled Databricks with 4 to 6 years of experience in data engineering and cloud platforms. Designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modelling, and cloud integration, ensuring high performance, security, and reliability.

Job Responsibilities :

  • Design and implement Databricks-based data architectures to meet business requirements.
  • Develop and optimize data pipelines using PySpark, Scala, or SQL.
  • Establish the Databricks Lakehouse architecture for batch and streaming data.
  • Collaborate with cross-functional teams to integrate Databricks with cloud platforms (e.g., AWS, Azure, GCP).
  • Ensure data security and compliance with best practices.
  • Monitor and troubleshoot Databricks environments for performance and reliability.
  • Stay updated on Databricks advancements and industry trends.

Desired Candidate Profile :

  • 4 to 6 years of experience in data engineering using Databricks or Apache Spark-based platforms.
  • Proven track record of building and optimizing ETL / ELT pipelines for batch and streaming data ingestion.
  • Good understanding of AWS cloud services
  • Proficiency in programming languages such as Python, Scala, or SQL for data processing and transformation.
  • Expertise in Spark (PySpark, Spark SQL, or Scala) and Databricks notebooks for large-scale data processing.
  • Familiarity with Delta Lake, Delta Live Tables, and medallion architecture for data lake house implementations.
  • Build and query delta lake storage solutions
  • Process streaming data with Azure Databricks structured streaming
  • Design Azure Databricks security and data protection solutions
  • Flatten nested structures and explode arrays with spark
  • Experience with orchestration tools like Databricks Jobs for scheduling and automation.
  • Knowledge of Git for source control and CI / CD integration for Databricks workflows, cost optimization, performance tuning.
  • Familiarity with Unity Catalog, RBAC, or enterprise-level Databricks setups.
  • Ability to create reusable components, templates, and documentation to standardize data engineering workflows.
  • Solutioning and presales - Architecting frameworks, defining roadmaps, and engaging with stakeholders.
  • Experience in defining data strategy, evaluating new tools / technologies, and driving adoption across the organization.
  • Must have experience of working with streaming data sources and Kafka.
  • Preferred Experience :

  • Bachelor’s degree in computer science, Information Technology, or related field
  • Proven experience as a Databricks Architect or similar role
  • Complete knowledge in Azure Databricks platform architecture
  • Databricks certification (e.g., Certified Data Engineer, Associate Developer)
  • Expertise in Python / Scala / SQL / R
  • Experience with cloud platforms like AWS, Azure, or GCP
  • Strong understanding of data modelling and cloud integration
  • Create a job alert for this search

    Developer • Mumbai, Maharashtra, India

    Related jobs
    • Promoted
    Electronic Data Interchange Developer

    Electronic Data Interchange Developer

    BGSFMumbai, IN
    Years Experience in EDI / Seeburger technology ( Minimum 2-4 years specifically in SEE burger must).Knowledge of EDI X12 , mapping, and working experience preferred. Experience in Mapping, Cloud, et...Show moreLast updated: 13 days ago
    • Promoted
    ETL Developer

    ETL Developer

    SynechronMumbai, Maharashtra, India
    We have immediate opportunity for DataStage Developer– 5 to 10 years.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines crea...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Teradata Developer

    Teradata Developer

    HCLTechthane, maharashtra, in
    We are seeking for skilled and experienced.You will be responsible for playing a strategic role in designing, implementing and maintaining scalable, high-performance data solutions using Teradata t...Show moreLast updated: 13 hours ago
    • Promoted
    Alteryx Data Engineer

    Alteryx Data Engineer

    CollinsonMumbai, Maharashtra, India
    Location - Mumbai Purpose of the job.Collinson, Working within the Transformation Team, you will be responsible for delivering key elements of our transformation programme.You will create new, and ...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Architect

    GCP Data Architect

    HCLTechKalyan-Dombivli, IN
    Job Title - GCP Data Architect.Location - Bangalore / Chennai / Hyderabad / Noida.Contribute to architectural decisions and support the Architecture Lead in defining and delivering technology strategy.He...Show moreLast updated: 30+ days ago
    • Promoted
    Looker Developer

    Looker Developer

    RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS)mumbai city, maharashtra, in
    We are looking for a skilled BI Developer to support a large client in the Healthcare domain.The role will involve enhancing and maintaining reports using Looker / LookML, developing dimensional data...Show moreLast updated: 16 days ago
    • Promoted
    Data Integration Developer (Level 2)

    Data Integration Developer (Level 2)

    BluticMumbai, IN
    Data Integration Developer (Level 2).ETL processes, reports, and database solutions using.This role requires solid technical skills to implement solutions, optimize code, and collaborate effectivel...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Database Developer

    Database Developer

    USTThane, IN
    Role : Database Developer (Preferred Domain : Healthcare).Location : Chennai, Trivandrum, Kochi.SQL, data integration, and cloud technologies to design, develop, and optimize enterprise-level data sol...Show moreLast updated: 19 hours ago
    • Promoted
    Senior Azure / Biztalk Developer

    Senior Azure / Biztalk Developer

    Orion Innovationnavi mumbai, maharashtra, in
    Job Title : Senior Azure Biztalk Developer.Senior Azure Developer with Biztalk.Design, develop, and support enterprise-level integration solutions. Create technical designs and architectures for comp...Show moreLast updated: 2 days ago
    • Promoted
    Data Integration Developer (Level 1)

    Data Integration Developer (Level 1)

    BluticKalyan-Dombivli, IN
    Data Integration Developer (Level 1).ETL processes and reports using.This entry-level role is ideal for developers looking to grow their skills in enterprise data solutions while contributing to cr...Show moreLast updated: 7 days ago
    • Promoted
    Databricks Administrator

    Databricks Administrator

    Quess IT StaffingThane, IN
    Hiring : Databricks Administrator | C2H | Pune (Night Shift).Location : Pune (3 days WFO — may change as per business needs). Shift : Night Shift (6 : 30 PM IST to 2 : 30 AM IST, shifts by 1 hour during DS...Show moreLast updated: 2 days ago
    • Promoted
    Data Architect

    Data Architect

    AndelaKalyan-Dombivli, IN
    Andela exists to connect brilliance and opportunity.Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations ...Show moreLast updated: 2 days ago
    • Promoted
    ETL Developer

    ETL Developer

    Programmers.iomumbai city, maharashtra, in
    Shift Timings : General Shift (12 : 00 PM IST till 9 : 00 PM or 9 : 30 PM IST).Location : PAN India-Remote Until Office Resume, Work from Home. Experience required : 5 to 8 years.Design, develop, and maintai...Show moreLast updated: 14 days ago
    • Promoted
    Azure Databricks Admin

    Azure Databricks Admin

    Greymatter InnovationzMumbai, IN
    Greymatter Innovationz helps you stay digitally relevant across domains, technologies, and skillsets, every day.Location : Anywhere in India / Bangalore preferred. Databricks Platform Support and capa...Show moreLast updated: 30+ days ago
    • Promoted
    Azure + Databricks

    Azure + Databricks

    PwC Indiamumbai, maharashtra, in
    As a Senior Associate, you will take ownership of designing and delivering complex data engineering solutions across cloud and on-premise environments. You’ll lead the technical delivery of ETL / ELT ...Show moreLast updated: 2 days ago
    • Promoted
    Developer

    Developer

    ConfidentialKalyan-Dombivli, IN
    We are looking for a highly skilled SnapLogic Developer with over 5 years of experience in designing, developing, and maintaining integration solutions. The ideal candidate should have hands-on expe...Show moreLast updated: 16 days ago
    • Promoted
    Azure Databricks+Pyspark

    Azure Databricks+Pyspark

    Tata Consultancy ServicesMumbai, IN
    TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad. Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Tata Consultancy ServicesMumbai, IN
    Job Title : Senior Azure Data Engineer.Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL. Good Knowledge of Data Brick lakehouse and Azure ...Show moreLast updated: 19 hours ago