Talent.com
No longer accepting applications
Data Engineer

Data Engineer

Koantekthane, maharashtra, in
8 days ago
Job description

We are seeking an experienced Databricks Full Stack Data Engineer with 3-6 years of industry

experience. The ideal candidate will have a proven track record of working on live projects.

He / she will play a key role in developing and maintaining scalable data solutions using

Databricks and related technologies.

Key Responsibilities :

  • Develop, and deploy end-to-end data pipelines and solutions on Databricks,

integrating with various data sources and systems.

  • Collaborate with cross-functional teams to understand data, and deliver effective BI
  • solutions.

  • Implement data ingestion, transformation, and processing workflows using Spark
  • (PySpark / Scala), SQL, and Databricks notebooks.

  • Develop and maintain data models, ETL / ELT processes ensuring high performance,
  • reliability, scalability and data quality.

  • Build and maintain APIs and data services to support analytics, reporting, and
  • application integration.

  • Ensure data quality, integrity, and security across all stages of the data lifecycle.
  • Monitor, troubleshoot, and optimize pipeline performance in a cloud-based environment.
  • Integrate data from various sources, including APIs, relational and non-relational
  • databases, IoT devices, and external data providers.

  • Ensure adherence to data governance, security, and compliance policies.
  • Required Skills and Experience :

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 3-6 years of hands-on experience in data engineering, with a strong focus on
  • Databricks and Apache Spark.

  • Strong programming skills in Python / PySpark and / or Scala, with a deep understanding
  • of Apache Spark.

  • Experience with Azure Databricks.
  • Strong SQL skills for data manipulation, analysis, and performance tuning.
  • Strong understanding of data structures and algorithms, with the ability to apply them to
  • optimize code and implement efficient solutions.

  • Strong understanding of data architecture, data modeling, ETL / ELT processes, and
  • data warehousing concepts.

  • Experience building and maintaining ETL / ELT pipelines in production environments.
  • Familiarity with Delta Lake, Unity Catalog, or similar technologies.
  • Experience working with structured and unstructured data, including JSON, Parquet,
  • Avro, and time-series data.

  • Familiarity with CI / CD pipelines and tools like Azure DevOps, version control (Git), and
  • DevOps practices for data engineering.

  • Excellent problem-solving skills, attention to detail, and ability to work independently or
  • as part of a team.

  • Strong communication skills to interact with technical and non-technical stakeholders.
  • Preferred Qualifications :

  • Experience with Delta Lake and Databricks Workflows.
  • Exposure to real-time data processing and streaming technologies (Kafka, Spark
  • Streaming).

  • Exposure to data visualization tool Databricks Genie for data analysis and reporting.
  • Knowledge of data governance, security, and compliance best practices.
  • Must Have Skills : Spark, Migration Experience, ETL

    Create a job alert for this search

    Data Engineer • thane, maharashtra, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    SynechronMumbai Metropolitan Region, India
    We have immediate opportunity for Data Engineer – 3-7 Years.We began life in 2001 as a small, self-funded team of technology specialists. Since then, we’ve grown our organization to 14,500+ people, ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesThane, IN
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
    • Promoted
    Alteryx Data Engineer

    Alteryx Data Engineer

    CollinsonMumbai, Maharashtra, India
    Location - Mumbai Purpose of the job.Collinson, Working within the Transformation Team, you will be responsible for delivering key elements of our transformation programme.You will create new, and ...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell ResourcesKalyan-Dombivli, IN
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 18 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group IncKalyan-Dombivli, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    KonectaMumbai, IN
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show moreLast updated: less than 1 hour ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdThane, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlanceThane, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AIKalyan-Dombivli, IN
    DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show moreLast updated: less than 1 hour ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeMumbai, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    ACL DigitalMumbai, Maharashtra, India
    Hello connections! We have urgent openings for AWS Data Engineer.Job Description : We are seeking an experienced Data Engineer to join our team and contribute to the building, development, and su...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseThane, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions LimitedThane, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 5 days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC GroupKalyan-Dombivli, IN
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalThane, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroMumbai, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionThane, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneMumbai, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 19 days ago