Databricks SMEDataE2E Technologies • tirunelveli, tamil nadu, in
No longer accepting applications
Databricks SME
DataE2E Technologies • tirunelveli, tamil nadu, in
7 days ago
Job description
Salary - Upto 25 LPA
Key Responsibilities
Design, develop, and maintain data pipelines and ETL processes on Databricks .
Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
Optimize data workflows for performance, cost-efficiency, and reliability .
Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
Implement best practices in data governance, security, and quality management.
Mentor junior engineers and provide technical leadership in data engineering best practices.
Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .
Required Skills & Experience
7+ years of experience in Data Engineering .
Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
Strong experience with PySpark , Spark SQL , and Scala .
Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
Proficiency in data modeling, ETL development , and data warehousing concepts.
Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
Strong SQL development skills with a focus on performance tuning .
Experience in implementing CI / CD pipelines for data solutions.
Create a job alert for this search
Sme • tirunelveli, tamil nadu, in
Related jobs
Data Solutions Director
Amethyst Partners • Thoothukudi, IN
This role carries both strategic and operational leadership responsibilities, managing Principal Analysts across APAC and working closely with data engineering, development, and global teams.You wi...Show more
Last updated: 5 days ago • Promoted
Azure Databricks
Kumaran Systems • Thoothukudi, IN
We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.
The candidate should be proficient in Dat...Show more
Last updated: 6 days ago • Promoted
Senior Oracle Data Engineer
Strattek Consulting • Thoothukudi, IN
This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.
Exposure to Oracle FDI (Fusion Data Intel...Show more
Last updated: 6 days ago • Promoted
Azure Databricks+Pyspark
Tata Consultancy Services • Thoothukudi, IN
TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad.
Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show more
Last updated: 21 days ago • Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careers • Thoothukudi, IN
Remote
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
Last updated: 6 days ago • Promoted
Data Engineer (GCP)
HISH IT SERVICES • Thoothukudi, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 13 days ago • Promoted
AWS Data Architect
ACL Digital • Thoothukudi, IN
AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices.
.AWS Certified Solutions Architect preferred.Show more
Last updated: 11 days ago • Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.io • Thoothukudi, IN
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
Last updated: 6 days ago • Promoted
Azure Databricks Admin
Greymatter Innovationz • Thoothukudi, IN
Greymatter Innovationz helps you stay digitally relevant across domains, technologies, and skillsets, every day.Location : Anywhere in India / Bangalore preferred.
Databricks Platform Support and capa...Show more
Last updated: 30+ days ago • Promoted
Senior Data Architect- Snowflake
USEReady • Thoothukudi, IN
USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage.
USEReady partners with cloud...Show more
Last updated: 5 days ago • Promoted
Databricks Architect ( Full-time at a Fortune 500 tech MNC )
HARP • Thoothukudi, IN
Lead the architecture, design, and implementation of data lakehouse solutions leveraging Databricks, Delta Lake, Unity Catalog, and Apache Spark.
Define and enforce architectural best practices for ...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
Mindlance • Thoothukudi, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 5 days ago • Promoted
Azure Data Engineer – Databricks, DBT
Tata Consultancy Services • Thoothukudi, IN
Role • •Azure Data Engineer – Databricks, DBT.Required Technical Skill Set • •Data Lake architecture, Azure Services – ADLS, ADF, Azure Databricks, Synapse.
Build the solution for optimal extraction, tr...Show more
Last updated: 1 day ago • Promoted
Senior Solutions Architect (Data)
Hillview Consulting Solutions • Thoothukudi, IN
If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on.
You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
Last updated: 6 days ago • Promoted
Databricks Engineer
DataE2E Technologies • Thoothukudi, IN
We are looking for an experienced.The ideal candidate has hands-on experience in Databricks production environments, along with.
You will collaborate with cross-functional teams to create robust dat...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
IntraEdge • Thoothukudi, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire).
Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show more
Last updated: 5 days ago • Promoted
Senior Data Engineer
SAIVA AI • Thoothukudi, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more