This job offer is not available in your country.

Celebal Technologies - Data Engineer - Python / SQL

Celebal TechnologiesBangalore

5 days ago

Job description

Responsibilities : Platform Expertise :

Act as a trusted advisor by leveraging in-depth knowledge of the Databricks Platform to guide NextGen customers (domain teams) on data and analytics implementations
Design and validate well-architected solutions and plans for productiongrade implementations based on NextGen best practices.
Discover new use case patterns that are emerging within various Domains and convert them to technical capability requirements and incorporate it back in the NextGen platform.

Development & Production Deployment :

Implement and operationalize data pipelines using Delta Live Tables (DLT) while ensuring production readiness.

Develop and sustain Continuous Integration / Continuous Deployment (CI / CD) pipelines for effective code promotion and release management.

Ensure alignment of implemented solutions with NextGen best practices.

Workflows & Serverless :

Design and manage data and analytics workflows using Databricks Workflows

Advise on serverless architecture planning and implementation to promote scalability and cost efficiency

Programming and Solution Design :

Develop solutions using Python and SQL, ensuring scalability, reliability, and robustness.

Provide architectural and design oversight for efficient data pipelines, workflows, and data quality practices.

Customer Leadership and Advisory :

Serve as an escalation point for technical challenges while ensuring timely resolution.

Collaborate with cross-functional teams (e.g., Platform Engineering, Domain Teams, Platform Architecture) to define and achieve customer success goals.

Coach and upskill Domain teams on Databricks capabilities and best practices

Documentation and Communication :

Create and present technical stories, architecture designs, and technical documentation

Requirements :

Strong hands-on experience with the Databricks platform.

Strong expertise in using Delta Live Tables (DLT) for building and managing data pipelines.

Proven track record of operationalizing code through CI / CD pipelines in data engineering contexts.

Proficiency in Python and SQL programming

Familiarity with Databricks Workflows and / or serverless implementations

Demonstrated experience in data solution architecture with scalable and maintainable designs.

Additional Qualifications :

Experience working with stakeholders to understand business requirements, deduct business needs from existing technical implementation and deliver solutions tailored to business needs

Excellent problem-solving skills and the ability to adapt to various domain team environments quickly

(ref : hirist.tech)

Create a job alert for this search

Data Engineer • Bangalore

Related jobs

Promoted

Data Engineer

Aceolutionhosur, tamil nadu, in

We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 8 days ago

Promoted
New!

Databricks SQL Engineer with Commercial Pharma

Keasishosur, tamil nadu, in

Job Title : Databricks SQL Engineer with Commercial Pharma.We are looking for a Databricks SQL Engineer to design, develop, and optimize data solutions using Databricks SQL.The ideal candidate will ...Show moreLast updated: 10 hours ago

Promoted

Senior Data Engineer

IGT Solutionshosur, tamil nadu, in

Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 25 days ago

Promoted

Senior Data Engineer

Tata Consultancy ServicesBengaluru, Karnataka, India

We have an opening for TCS, Bangalore "Data Engineer- Python+Pyspark,GCP Developer".Skill : Data Engineer- Python+Pyspark,GCP Developer. Data Engineer- Python+Pyspark,GCP Developer.Hands-on developm...Show moreLast updated: 30+ days ago

Promoted
New!

Data Engineer

Bahwan CyberTekBengaluru, Karnataka, India

We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 14 hours ago

Promoted

Data Engineer

Manuh Technologieshosur, tamil nadu, in

Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 20 days ago

Promoted

Senior Data Engineer

Deltacubeshosur, tamil nadu, in

Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago

Promoted

Azure Data Engineer

Tata Consultancy Serviceshosur, tamil nadu, in

Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago

Promoted

Engineer

Alp Consulting Ltd.hosur, tamil nadu, in

As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems on. You will collaborate with cross-functional teams to ensure data is acces...Show moreLast updated: 19 days ago

Promoted
New!

Data Engineer

TechVeritohosur, tamil nadu, in

You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 10 hours ago

Promoted

Data Engineer

INFEC Serviceshosur, tamil nadu, in

Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago

Promoted

Data Engineer

Innodata Inc.bangalore, karnataka, in

CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago

Promoted

Data Engineer (Pyspark)

Tata Consultancy Servicesbangalore, karnataka, in

Role : Data Engineer with Mandatory Pyspark Knowledge.Required Technical Skill Set : Python , Pyspark, BigQuery.Desired Experience Range : 7 to 10 yrs. Desired Competencies (Technical / Behavioral Compet...Show moreLast updated: 4 days ago

Promoted

Data Engineer

VAANTECHhosur, tamil nadu, in

Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 29 days ago

Promoted

Senior Data Engineer

SAIVA AIhosur, tamil nadu, in

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago

Promoted

Data Engineer

Canopus Infosystems - A CMMI Level 3 Companyhosur, tamil nadu, in

Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 17 days ago

Promoted

Data Engineer

Kanerika Inchosur, tamil nadu, in

Following are high level responsibilities that you will play but not limited to : .Analyze the Data Model and do GAP analysis with Business Requirements and Power BI. Design and Model Power BI schema....Show moreLast updated: 19 days ago

Promoted

Data Engineer

IntraEdgehosur, tamil nadu, in

Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 26 days ago

Promoted

Lead Data Engineer

Eucloid Data Solutionshosur, tamil nadu, in

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago

Promoted

Data Engineer

ACL Digitalhosur, tamil nadu, in

Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago