No longer accepting applications
Data Engineer with Databricks Expertise
Hello World Tech ConsultingThoothukudi, IN5 days ago
Job descriptionUtilize Delta Lake for data storage and management, ensuring secure data Implement data governance and access control using Unity Catalog. Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects. Develop and manage ETL pipelines using AWS Glue. Leverage Amazon S3 for data storage and management. Utilize AWS Lambda and Step Functions for serverless computing in data Apply data warehousing solutions and best practices in data transformation. Monitor and implement data quality checks and governance practices. Collaborate with data scientists, analysts, and other stakeholders in an Agile Deliver large-scale data processing and analytics projects within cloud Databricks certifications with practical experience in the Databricks Lakehouse Proficient in AWS services : Glue, S3, Lambda, Step Functions, and data Strong programming skills in Python, Scala, or Java. Proficient in SQL for querying and manipulating data. Experience in data modeling for Lakehouse architecture. Knowledge of ETL best practices and data transformation techniques. Understanding of data governance frameworks and practices. Proven track record of delivering data engineering projects, particularly in cloud Experience with large-scale data processing and analytics projects. Ability to work in Agile teams and collaborate eEectively with various Advanced AWS certifications. Experience with additional cloud platforms (e.g., Azure). Familiarity with other data engineering tools and frameworks.
Job Summary
We are seeking a highly skilled Data Engineer with Databricks certifications and
extensive practical experience working with the Databricks Lakehouse platform and its
supporting capabilities. The ideal candidate will possess a robust understanding of AWS
services relevant to data engineering and demonstrate proficiency in data pipeline
development, programming, data modeling, and governance.
Key Responsibilities
- Design and implement data pipelines using AWS and Databricks.
- Manage and orchestrate data workflows, ensuring eEicient data ingestion
processes.
sharing across platforms with Delta Sharing.
processing.
environment.
environments.
Required Skills and Qualifications
platform.
warehousing solutions.
environments.
stakeholders.
Preferred Qualifications
Create a job alert for this search
Data Engineer • Thoothukudi, IN
Related jobs
- Promoted
Data Engineer
Tata Consultancy ServicesThoothukudi, IN TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
- Promoted
Azure Data Engineer
K&K Talents - IndiaThoothukudi, IN This position is with one of our.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.Employment Type : Full-time Permanent.
We are seeking an experienced Data Engineer with strong...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicesthoothukudi, tamil nadu, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 21 days ago
- Promoted
Data Engineer (GCP)
HISH IT SERVICESThoothukudi, IN We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 5 days ago
- Promoted
Data Engineer
Randstad EnterpriseThoothukudi, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Dexian IndiaThoothukudi, IN Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
High proficiency in Python, ...Show moreLast updated: 5 days ago
- Promoted
GCP Data Engineer
Xsell ResourcesThoothukudi, IN Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days.
GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 11 days ago
- Promoted
Data Engineer
VeraxionThoothukudi, IN Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 24 days ago
- Promoted
Immediate Opening for Data Engineer (Databricks & D365)
GyanSys Inc.Thoothukudi, IN Need to have databricks experience as well as experience with handling D365 data.Need strong SQL skills, strong analytical skills.Show moreLast updated: 3 days ago
- Promoted
Data Engineer
AceolutionThoothukudi, IN Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Insight GlobalThoothukudi, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
RecroThoothukudi, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
IntraEdgeThoothukudi, IN We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
- Promoted
Freelance Data Engineer
Leading MNCThoothukudi, IN Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs.
If you're looking for freelance / part time opportunity (along with your day...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
DigitalzoneThoothukudi, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 13 days ago
- Promoted
Google Looker Data Engineer
Insight GlobalThoothukudi, IN We’re seeking a skilled Data Engineer to support a major reporting migration from Tableau to Google Looker.This role focuses on designing and building scalable data models, data marts, and ETL / ELT ...Show moreLast updated: 5 days ago
- Promoted
Data Engineer - Palantir Foundry
NP GroupThoothukudi, IN Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
TEKsystemsThoothukudi, IN Location - Remote or Delhi or Hyderabad or Bangalore or Pune.Proficiency in Python and experience maintaining data-driven applications.
Hands-on experience with ETL pipeline development, schema desi...Show moreLast updated: 30+ days ago