Talent.com
No longer accepting applications
Quantiphi - Senior Data Engineer - ETL / Azure Databricks

Quantiphi - Senior Data Engineer - ETL / Azure Databricks

Quantiphi AnalyticsMumbai
30+ days ago
Job description

While technology is the heart of our business, a global and diverse culture is the heart of our success.

We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests youyou would enjoy your career with Quantiphi!.

Role : Senior Data Engineer (Databricks).

Experience Level : 3 to 6 Years.

Work location : Mumbai, Bengaluru, Trivandrum.

Role & Responsibilities :

  • Design and implement data solutions (ETL pipelines, Processing and Transformation logic) using Snowflake as a key platform.
  • Design Virtual warehouses which are optimized for performance and cost (auto scaling, idle time etc).
  • Write SQL , stored procedures to implement business logic, other critical requirements like encryption, data masking etc.
  • Implement solutions with features like Snowpipe, tasks, streams,dynamic tables etc.
  • Design the solutions by leveraging key concepts around the architecture of Snowflake, its data distribution and partitioning mechanism, data caching etc.
  • Identify queries which take more time , look at the logs etc and provide solutions to optimize those queries.

Must Have Skills :

  • 3+ years experience of Hands-on in data structures, distributed systems, Spark, SQL, PySpark, NoSQL Databases.
  • Strong software development skills in at least one of : Python, Pyspark or Scala.
  • Develop and maintain scalable & modular data pipelines using databricks & Apache Spark.
  • Experience building and supporting large-scale systems in a production environment.
  • Experience working on either of the cloud storages AWS S3, Azure data lake, GCS buckets.
  • Exposure to the ELT tools offered by the cloud platforms like, ADF, AWS Glue, Google dataflow.
  • Integrate Databricks with other cloud services like AWS, Azure or Google Cloud.
  • Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks.
  • Managing and configuring databricks environments, including clusters and notebooks.
  • Experience working with different file formats parquet, databricks delta lake.
  • Experience working with data governance on databricks, implementing unity catalog, delta share.
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Mumbai

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Codombivli, maharashtra, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 15 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group IncMumbai, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Celebal TechnologiesNavi Mumbai, Maharashtra, India
    We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Archite...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasKalyan-Dombivli, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroThane, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellify SolutionsThane, IN
    Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show moreLast updated: 6 days ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions LimitedKalyan-Dombivli, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 1 day ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersThane, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 1 day ago
    • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek ConsultingKalyan-Dombivli, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionKalyan-Dombivli, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneThane, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeThane, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKalyan-Dombivli, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    StraiveMumbai, Maharashtra, India
    Analyse relevant internally and externally sourced data (raw data) to generate BI and Advanced.Analytics datasets based on your stakeholders’ requirements. Design data pipelines to curate sourced da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalThane, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    QuantiphiMumbai, Maharashtra, India
    Company Profile : Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning techno...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIKalyan-Dombivli, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiMumbai, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago