This job offer is not available in your country.

Celebal Technologies - Data Engineer - Python / SQL

Celebal TechnologiesNoida

5 days ago

Job description

Responsibilities : Platform Expertise :

Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platform to guide NextGen customers (domain teams) on data and analytics implementations
Design and validate well-architected solutions and plans for productiongrade implementations based on NextGen best practices.
Discover new use case patterns that are emerging within various Domains and convert them to technical capability requirements and incorporate it back in the NextGen platform.

Development & Production Deployment :

Implement and operationalize data pipelines using Delta Live Tables (DLT) while ensuring production readiness.

Develop and sustain Continuous Integration / Continuous Deployment (CI / CD) pipelines for effective code promotion and release management.

Ensure alignment of implemented solutions with NextGen best practices.

Workflows & Serverless :

Design and manage data and analytics workflows using Databricks Workflows

Advise on serverless architecture planning and implementation to promote scalability and cost efficiency

Programming and Solution Design :

Develop solutions using Python and SQL, ensuring scalability, reliability, and robustness.

Provide architectural and design oversight for efficient data pipelines, workflows, and data quality practices.

Customer Leadership and Advisory :

Serve as an escalation point for technical challenges while ensuring timely resolution.

Collaborate with cross-functional teams (e.g., Platform Engineering, Domain Teams, Platform Architecture) to define and achieve customer success goals.

Coach and upskill Domain teams on Databricks capabilities and best practices

Documentation and Communication :

Create and present technical stories, architecture designs, and technical documentation

Requirements :

Strong hands-on experience with the Databricks platform.

Strong expertise in using Delta Live Tables (DLT) for building and managing data pipelines.

Proven track record of operationalizing code through CI / CD pipelines in data engineering contexts.

Proficiency in Python and SQL programming

Familiarity with Databricks Workflows and / or serverless implementations

Demonstrated experience in data solution architecture with scalable and maintainable designs.

Additional Qualifications :

Experience working with stakeholders to understand business requirements, deduct business needs from existing technical implementation and deliver solutions tailored to business needs

Excellent problem-solving skills and the ability to adapt to various domain team environments quickly

(ref : hirist.tech)

Create a job alert for this search

Data Engineer • Noida