This job offer is not available in your country.

Celebal Technologies - Data Engineer - Python / SQL

Celebal TechnologiesPune

5 days ago

Job description

Responsibilities : Platform Expertise :

Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platform to guide NextGen customers (domain teams) on data and analytics implementations
Design and validate well-architected solutions and plans for productiongrade implementations based on NextGen best practices.
Discover new use case patterns that are emerging within various Domains and convert them to technical capability requirements and incorporate it back in the NextGen platform.

Development & Production Deployment :

Implement and operationalize data pipelines using Delta Live Tables (DLT) while ensuring production readiness.

Develop and sustain Continuous Integration / Continuous Deployment (CI / CD) pipelines for effective code promotion and release management.

Ensure alignment of implemented solutions with NextGen best practices.

Workflows & Serverless :

Design and manage data and analytics workflows using Databricks Workflows

Advise on serverless architecture planning and implementation to promote scalability and cost efficiency

Programming and Solution Design :

Develop solutions using Python and SQL, ensuring scalability, reliability, and robustness.

Provide architectural and design oversight for efficient data pipelines, workflows, and data quality practices.

Customer Leadership and Advisory :

Serve as an escalation point for technical challenges while ensuring timely resolution.

Collaborate with cross-functional teams (e.g., Platform Engineering, Domain Teams, Platform Architecture) to define and achieve customer success goals.

Coach and upskill Domain teams on Databricks capabilities and best practices

Documentation and Communication :

Create and present technical stories, architecture designs, and technical documentation

Requirements :

Strong hands-on experience with the Databricks platform.

Strong expertise in using Delta Live Tables (DLT) for building and managing data pipelines.

Proven track record of operationalizing code through CI / CD pipelines in data engineering contexts.

Proficiency in Python and SQL programming

Familiarity with Databricks Workflows and / or serverless implementations

Demonstrated experience in data solution architecture with scalable and maintainable designs.

Additional Qualifications :

Experience working with stakeholders to understand business requirements, deduct business needs from existing technical implementation and deliver solutions tailored to business needs

Excellent problem-solving skills and the ability to adapt to various domain team environments quickly

(ref : hirist.tech)

Create a job alert for this search

Data Engineer • Pune

Related jobs

Promoted

Data Engineer - Python / SQL

Career Hotspot & ServicesPune

Key Responsibilities : Python Proficiency : - Demonstrate strong command of Python, actively contributing to the development and enhancement of d...Show moreLast updated: 30+ days ago

Promoted

Staff Data Platform Engineer

ZendeskSaswad, India

Our Enterprise Data & Analytics (EDA) is looking for an experienced Staff Data Platform Engineer to join our growing Platform engineering team. You’ll work in a collaborative Agile environment...Show moreLast updated: 19 days ago

Promoted

TripleLift - Senior Data Engineer - Python / SQL

TripleLiftPune

About TripleLift : We're TripleLift, an advertising platform on a mission to elevate digital advertising through beautiful creative, quality publishers, actionab...Show moreLast updated: 30+ days ago

Promoted

Evolent Health - Senior Data Engineer - Python / SQL

Evolent HealthPune

Responsibilities : - Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Arch...Show moreLast updated: 22 days ago

Promoted

Zinnia - Data Engineer III - Python / SQL

ZinniaPune

Who You Are : As a seasoned Data Engineer specializing in data engineering, you bring extensive expertise in optimizing data workflows using various database tools l...Show moreLast updated: 14 days ago

Promoted

AWS Data Engineer - Python / SQL / ETL

DeqodePune

Profile : AWS Data Engineer Mandate Skills : AWS + Databricks + Pyspark + SQL role Location : Bangalore ...Show moreLast updated: 6 days ago

Promoted

PySpark Databricks Engineer - SQL / Azure

Confidential CompanyPune

Primary Tech skills : AZURE ,Databricks ,Pyspark, SQL Secondary Tech skills : ADF, Synapse Job Description : Show moreLast updated: 16 days ago

Promoted

Senior Data Engineer

DeltacubesPune, IN

Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago

Promoted

Big Data Engineer - PySpark / SQL

PRONEXUS CONSULTING PRIVATE LIMITEDPune

About the Role : We are seeking a highly skilled Senior Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines and platforms.T...Show moreLast updated: 14 days ago

Promoted

Intellias - Senior Data Engineer - Python Programming

IntelliasPune

Why Work at Intellias ? At Intellias, we are more than just a technology company - we are a trusted partner to some of the worlds most prestigious organizations.With ...Show moreLast updated: 21 days ago

Promoted

Data Engineer

Innodata Inc.Pune, IN

CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago

Promoted

Data Engineer - Python / SQL

VIPANY GLOBAL SOLUTIONS PRIVATE LIMITEDPune

Responsibilities for Data Engineer : - Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet function...Show moreLast updated: 21 days ago

Promoted

Big Data Engineer - SQL / Python

ANB IT Solutions Pvt LtdPune

Job Description : - Minimum of 7+ years of progressive experience in Data Engineering, with a proven track record in pi...Show moreLast updated: 11 days ago

Promoted

Senior Databricks Engineer - Python / SQL / Scala

ConfidentialPune

You will be responsible for architecting scalable data solutions, collaborating with cross-functional teams to migrate existing solutions, and ensuring the reliability and performance of our data i...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer - Python

People Prime World WidePune

About Client : Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France.Founded in 1967, It h...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Manuh TechnologiesPune, IN

Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago

Promoted

Lead Cloud Data Engineer - PySpark / SQL

upGradPune

About the Job : We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark.Work with Databricks platform using Spark for big data processing and an...Show moreLast updated: 30+ days ago

Promoted

AWS Data Engineer - Python / Scala / Java

HyrEzy Talent SolutionsPune

Job Title : AWS Data Engineer Location : Pune , Bangalore, Greater Noida, Trichy Responsibilities : Show moreLast updated: 30+ days ago