Data Engineer with Databricks ExpertiseHello World Tech Consulting • Dindigul, IN
Data Engineer with Databricks Expertise
Hello World Tech Consulting • Dindigul, IN
2 days ago
Job descriptionUtilize Delta Lake for data storage and management, ensuring secure data Implement data governance and access control using Unity Catalog. Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects. Develop and manage ETL pipelines using AWS Glue. Leverage Amazon S3 for data storage and management. Utilize AWS Lambda and Step Functions for serverless computing in data Apply data warehousing solutions and best practices in data transformation. Monitor and implement data quality checks and governance practices. Collaborate with data scientists, analysts, and other stakeholders in an Agile Deliver large-scale data processing and analytics projects within cloud Databricks certifications with practical experience in the Databricks Lakehouse Proficient in AWS services : Glue, S3, Lambda, Step Functions, and data Strong programming skills in Python, Scala, or Java. Proficient in SQL for querying and manipulating data. Experience in data modeling for Lakehouse architecture. Knowledge of ETL best practices and data transformation techniques. Understanding of data governance frameworks and practices. Proven track record of delivering data engineering projects, particularly in cloud Experience with large-scale data processing and analytics projects. Ability to work in Agile teams and collaborate eEectively with various Advanced AWS certifications. Experience with additional cloud platforms (e.g., Azure). Familiarity with other data engineering tools and frameworks.
Job Summary
We are seeking a highly skilled Data Engineer with Databricks certifications and
extensive practical experience working with the Databricks Lakehouse platform and its
supporting capabilities. The ideal candidate will possess a robust understanding of AWS
services relevant to data engineering and demonstrate proficiency in data pipeline
development, programming, data modeling, and governance.
Key Responsibilities
- Design and implement data pipelines using AWS and Databricks.
- Manage and orchestrate data workflows, ensuring eEicient data ingestion
processes.
sharing across platforms with Delta Sharing.
processing.
environment.
environments.
Required Skills and Qualifications
platform.
warehousing solutions.
environments.
stakeholders.
Preferred Qualifications
Create a job alert for this search
Data Engineer • Dindigul, IN
Related jobs
Data Engineer
Dexian India • Dindigul, IN
Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
Constructing infrastructure for efficient ETL processes from vari...Show more
Last updated: 3 days ago • Promoted
Google Looker Data Engineer
Insight Global • Madurai, IN
We’re seeking a skilled Data Engineer to support a major reporting migration from Tableau to Google Looker.This role focuses on designing and building scalable data models, data marts, and ETL / ELT ...Show more
Last updated: 2 days ago • Promoted
Data Engineer
Randstad Enterprise • Madurai, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
Last updated: 30+ days ago • Promoted
Data Engineer - Palantir Foundry
NP Group • madurai, tamil nadu, in
Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Recro • Madurai, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Data Engineer with Databricks Expertise
Hello World Tech Consulting • Madurai, IN
We are seeking a highly skilled Data Engineer with Databricks certifications and.Databricks Lakehouse platform and its.The ideal candidate will possess a robust understanding of AWS.Design and impl...Show more
Last updated: 2 days ago • Promoted
Data Engineer
IntraEdge • Dindigul, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Data Modeler / Data Engineer
HCLTech • Greater Madurai Area, India
Looking for Immediate joiners - From 5+ to 7 yrs : -.Collaborate with DevOps, BI, and application teams to ensure data consistency and availability.
Ensure data quality, integrity, and compliance wit...Show more
Last updated: 21 days ago • Promoted
Data Engineer
thinkbridge • dindigul, tamil nadu, in
We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show more
Last updated: 30+ days ago • Promoted
Data & Analytics Engineer
APPIT Software Inc • Dindigul, IN
Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience.
Data Modelling & Data Warehouse -Mandatory -Hands...Show more
Last updated: 8 days ago • Promoted
Data Engineer
Tata Consultancy Services • Dindigul, IN
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Insight Global • Dindigul, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Aceolution • Madurai, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Veraxion • Dindigul, IN
Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show more
Last updated: 21 days ago • Promoted
Data Engineer (GCP)
HISH IT SERVICES • Madurai, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 2 days ago • Promoted
Data Engineer
Digitalzone • Madurai, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 10 days ago • Promoted
Data Engineer
Sapphire Software Solutions Inc • Madurai, IN
A global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is looking to build out a data lake to encompass both internal and...Show more
Last updated: 1 day ago • Promoted
Data Engineer
Vriba Solutions • Madurai, IN
Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show more
Last updated: 30+ days ago • Promoted