Talent.com
This job offer is not available in your country.
Quantiphi - Senior Data Engineer - ETL / Azure Databricks

Quantiphi - Senior Data Engineer - ETL / Azure Databricks

Quantiphi AnalyticsTrivandrum
13 days ago
Job description

While technology is the heart of our business, a global and diverse culture is the heart of our success.

We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests youyou would enjoy your career with Quantiphi!.

Role : Senior Data Engineer (Databricks).

Experience Level : 3 to 6 Years.

Work location : Mumbai, Bengaluru, Trivandrum.

Role & Responsibilities :

  • Design and implement data solutions (ETL pipelines, Processing and Transformation logic) using Snowflake as a key platform.
  • Design Virtual warehouses which are optimized for performance and cost (auto scaling, idle time etc).
  • Write SQL , stored procedures to implement business logic, other critical requirements like encryption, data masking etc.
  • Implement solutions with features like Snowpipe, tasks, streams,dynamic tables etc.
  • Design the solutions by leveraging key concepts around the architecture of Snowflake, its data distribution and partitioning mechanism, data caching etc.
  • Identify queries which take more time , look at the logs etc and provide solutions to optimize those queries.

Must Have Skills :

  • 3+ years experience of Hands-on in data structures, distributed systems, Spark, SQL, PySpark, NoSQL Databases.
  • Strong software development skills in at least one of : Python, Pyspark or Scala.
  • Develop and maintain scalable & modular data pipelines using databricks & Apache Spark.
  • Experience building and supporting large-scale systems in a production environment.
  • Experience working on either of the cloud storages AWS S3, Azure data lake, GCS buckets.
  • Exposure to the ELT tools offered by the cloud platforms like, ADF, AWS Glue, Google dataflow.
  • Integrate Databricks with other cloud services like AWS, Azure or Google Cloud.
  • Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks.
  • Managing and configuring databricks environments, including clusters and notebooks.
  • Experience working with different file formats parquet, databricks delta lake.
  • Experience working with data governance on databricks, implementing unity catalog, delta share.
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Trivandrum

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    QuantiphiTrivandrum, Kerala, India
    Review and analyze existing data collection systems, and make recommendations on improvement, maintenance, or other factors to improve the system. Supervising junior data engineering teams to ensure...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Net Zero InsightsThiruvananthapuram, IN
    Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisThiruvananthapuram, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 14 days ago
    • Promoted
    • New!
    Senior Developer – EMDA Analytics (ETL, Biovia Pipeline Pilot)

    Senior Developer – EMDA Analytics (ETL, Biovia Pipeline Pilot)

    Tech One ITKollam, IN
    We are seeking a highly skilled.EMDA (Environmental Monitoring Data Analytics) team.The role focuses on developing, deploying, and maintaining ETL workflows for a. Pfizer’s global manufacturing site...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIThiruvananthapuram, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AiKollam, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesKollam, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIThiruvananthapuram, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainThiruvananthapuram, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalThiruvananthapuram, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeKollam, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLThiruvananthapuram, IN
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Appfabs IncorporationTrivandrum, Kerala, India
    We are engaging with one of customer to build and operationalize their Enterprise Data Platform (EDP).It is a strategic initiative to mature their data and analytics capabilities across the organiz...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Analyst / Engineer

    Senior Data Analyst / Engineer

    Milestone Technologies, Inc.Kollam, IN
    This role will ensure data ingested from manufacturing systems into Client's data lake and downstream applications (e.The successful candidate will work directly with. Identify gaps, missing values,...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CESThiruvananthapuram, IN
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 5 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKollam, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIKollam, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Generative AI Engineer (Databricks Data Lake)

    Senior Generative AI Engineer (Databricks Data Lake)

    AmpstekThiruvananthapuram, IN
    Title : Senior Generative AI Engineer (Databricks Data Lake).We are seeking an experienced Senior Generative AI Engineer with a strong background in Databricks and data lake architectures.This indiv...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EvolentThiruvananthapuram, IN
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 23 days ago
    • Promoted
    • New!
    Senior Generative AI Engineer (Databricks,Data Lake)

    Senior Generative AI Engineer (Databricks,Data Lake)

    AmpstekThiruvananthapuram, IN
    Title : Senior Generative AI Engineer (Databricks,Data Lake).Design and implement GenAI models (LLMs, multimodal, embeddings, and fine-tuning) for enterprise use cases. Architect and optimize data pi...Show moreLast updated: 6 hours ago