Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

USEReadykolkata, west bengal, in
12 days ago
Job description

Job Title : Senior Databricks Engineer

Experience Level : 5-8 Years

Job Summary

As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable solutions that process large-scale data efficiently. The ideal candidate is a proactive problem-solver with a strong background in data engineering and a passion for mentoring and driving technical excellence.

Key Responsibilities

  • Architect and Develop : Design, build, and maintain robust and scalable data pipelines and ETL / ELT processes using Databricks, Apache Spark, and Python / Scala.
  • Lakehouse Implementation : Architect and implement solutions on the Databricks Lakehouse Platform, including data modeling, ingestion, storage, and processing using Delta Lake.
  • Performance Optimization : Analyze and tune the performance of Spark jobs and Databricks clusters to ensure high efficiency, reliability, and cost-effectiveness.
  • Data Governance : Implement and manage data governance, data quality, and security best practices within Databricks, utilizing features like Unity Catalog.
  • Collaboration : Work closely with data scientists, analysts, and business stakeholders to understand their data requirements and deliver high-quality, end-to-end data solutions.
  • Automation & CI / CD : Develop and maintain CI / CD pipelines for automated testing and deployment of data workflows (e.g., using Azure DevOps, Jenkins, GitHub Actions).
  • Mentorship : Mentor junior engineers, conduct code reviews, and champion best practices in data engineering and software development.
  • Innovation : Stay current with the latest advancements in the Databricks platform and the broader big data ecosystem, and drive the adoption of new tools and technologies.

Required Qualifications and Skills

  • Experience : 5-8 years of professional experience in a data engineering role.
  • Databricks Expertise : Proven hands-on experience architecting and building solutions on the Databricks platform.
  • Core Technical Skills :
  • Strong proficiency in Python or Scala .
  • Expert-level knowledge of Apache Spark , including Spark SQL and DataFrame APIs.
  • In-depth understanding and practical experience with Delta Lake .
  • Advanced SQL skills and experience with data warehousing concepts.
  • Cloud Proficiency : Solid experience with at least one major cloud platform ( Azure , AWS , or GCP ), including their data storage and processing services (e.g., Azure Data Lake Storage, AWS S3, Google Cloud Storage).
  • ETL / ELT : Demonstrable experience in designing and implementing complex ETL / ELT pipelines.
  • Problem-Solving : Excellent analytical and problem-solving abilities with a keen attention to detail.
  • Communication : Strong verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.
  • Data Visualization : Experience supporting data visualization tools like Power BI or Tableau
  • Create a job alert for this search

    Senior Data Engineer • kolkata, west bengal, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyKolkata, IN
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    SapaadKolkata, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    NOQKolkata, IN
    Senior Data & Reporting Developer (Remote | India | Contract Role).NOQ Group is a technology-driven organization dedicated to delivering innovative data solutions for businesses in the food and bev...Show moreLast updated: 2 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ATOM Systems Private LimitedKolkata, IN
    We are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team.The ideal candidate combines strong leadership and technical expertise with the ability to deliver...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsKolkata, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIKolkata, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 10 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKolkata, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsKolkata, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncKolkata, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 12 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainKolkata, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKolkata, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    PASO CoKolkata, IN
    We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKolkata, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyKolkata, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Magma ConsultancyKolkata, IN
    Part-time (20–25 hours per week).The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers,...Show moreLast updated: 21 hours ago
    • Promoted
    Data Engineer_Immediate Joiners

    Data Engineer_Immediate Joiners

    VXI Global SolutionsKolkata, IN
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 2 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Kolkata, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Integration Engineer

    Senior Data Integration Engineer

    IndsafriKolkata, IN
    Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseKolkata, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeKolkata, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago