This job offer is not available in your country.

Celebal Technologies - Data Engineer - Python / SQL

Celebal TechnologiesHyderabad

6 days ago

Job description

Responsibilities : Platform Expertise :

Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platform to guide NextGen customers (domain teams) on data and analytics implementations
Design and validate well-architected solutions and plans for productiongrade implementations based on NextGen best practices.
Discover new use case patterns that are emerging within various Domains and convert them to technical capability requirements and incorporate it back in the NextGen platform.

Development & Production Deployment :

Implement and operationalize data pipelines using Delta Live Tables (DLT) while ensuring production readiness.

Develop and sustain Continuous Integration / Continuous Deployment (CI / CD) pipelines for effective code promotion and release management.

Ensure alignment of implemented solutions with NextGen best practices.

Workflows & Serverless :

Design and manage data and analytics workflows using Databricks Workflows

Advise on serverless architecture planning and implementation to promote scalability and cost efficiency

Programming and Solution Design :

Develop solutions using Python and SQL, ensuring scalability, reliability, and robustness.

Provide architectural and design oversight for efficient data pipelines, workflows, and data quality practices.

Customer Leadership and Advisory :

Serve as an escalation point for technical challenges while ensuring timely resolution.

Collaborate with cross-functional teams (e.g., Platform Engineering, Domain Teams, Platform Architecture) to define and achieve customer success goals.

Coach and upskill Domain teams on Databricks capabilities and best practices

Documentation and Communication :

Create and present technical stories, architecture designs, and technical documentation

Requirements :

Strong hands-on experience with the Databricks platform.

Strong expertise in using Delta Live Tables (DLT) for building and managing data pipelines.

Proven track record of operationalizing code through CI / CD pipelines in data engineering contexts.

Proficiency in Python and SQL programming

Familiarity with Databricks Workflows and / or serverless implementations

Demonstrated experience in data solution architecture with scalable and maintainable designs.

Additional Qualifications :

Experience working with stakeholders to understand business requirements, deduct business needs from existing technical implementation and deliver solutions tailored to business needs

Excellent problem-solving skills and the ability to adapt to various domain team environments quickly

(ref : hirist.tech)

Create a job alert for this search

Data Engineer • Hyderabad

Related jobs

Promoted

Data Engineer

EgenHyderabad, Telangana, India

Lead Data Engineer – Python & GCP.We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data enginee...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Innodata Inc.Hyderabad, IN

CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 27 days ago

Promoted

Data Engineer - Python / SQL

HyrEzy Talent SolutionsHyderabad

What You'll Do : As a Senior Consultant, you will have the opportunity to gain valuable hands-on experience collaborating with leading professionals while buildi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

DeltacubesHyderabad, IN

Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 17 days ago

Promoted

Data Engineer - Python / SQL

CORTEX ConsultantsHyderabad

Job Title : Data Engineer Experience : 6+ Years Location : Bangalore / Hyderabad / Pune / Noida &...Show moreLast updated: 9 days ago

Promoted

Ingrain Systems Inc - Senior Data Engineer - Python / SQL

Ingrain Systems IncHyderabad

Job Description : - Develop and own efficient SQL and Python code to support data analysis and ELT pipeline development.Build and maintain data transformation models ...Show moreLast updated: 1 day ago

Promoted

Dun & Bradstreet - Senior Data Engineer - Python / SQL

DUN BRADSTREET TECHNOLOGY AND CORPORATE SERVICESHyderabad

Why We Work at Dun & Bradstreet : Dun & Bradstreet unlocks the power of data through analytics, creating a bette...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

ADPhyderabad, telangana, in

Below is the JD followed for Data Engineering.Position : Data Engineer with 4 to Y8ears experience in AWS, PySpark, Python, SQL and Data bricks. In this role candidate will be responsible for unders...Show moreLast updated: 28 days ago

Promoted

Data Engineer

Saras Analyticshyderabad, telangana, in

As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and workflows. You will work closely with data analysts, data scientists, and other stakeho...Show moreLast updated: 9 days ago

Promoted

Data Engineer

Rrootshell Technologiiss Pvt Ltdhyderabad, telangana, in

Hope you are doing well & Safe!.Rrootshell Technologiiss Pvt Ltd.We are HIRING & URGENT Requirement for.This is for FULL -TIME role and Work From Office (WFO) Opportunity. Location : Hyderabad, Work ...Show moreLast updated: 22 days ago

Promoted

Senior Data Engineer - Python / Scala / SQL

InfoslabHyderabad

Job Title : Senior Data Engineer Location : Hyderabad (Onsite / Hybrid) About the Role : We are looking for a highly skilled and experie...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Manuh TechnologiesHyderabad, IN

Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago

Promoted
New!

Data Engineer- Snowflake

Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India

We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show moreLast updated: 1 hour ago

Promoted

Data Engineer

INFEC ServicesHyderabad, Telangana, India

Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 30+ days ago

Promoted

Senior Technical AI Data Engineer - Python / SQL

RazerTech ConsultingHyderabad

RazerTech Consulting is mandated to hire for a Sr.Technical AI Data Engineer for a US-based Strategy Consulting, Investment Banking Advisory firm.Location : Hyderabad |...Show moreLast updated: 7 days ago

Promoted

Data Engineer

AceolutionHyderabad, IN

We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 9 days ago

Promoted

Data Engineer - PySpark / SQL

GALAXY I TECHNOLOGIES INCHyderabad

Key Responsibilities : - Design, build, and optimize data pipelines leveraging Apache Spark, PySpark, and SQL.Develop scalable data integration, tr...Show moreLast updated: 4 days ago

Promoted

Data Engineer - SQL / Python

Orbion InfotechHyderabad

Job Description : Key Responsibilities : - Design, build, and maintain scalable data pipelines and ETL workflows.Devel...Show moreLast updated: 13 days ago