Design, develop, and maintain data pipelines and ETL processes on Databricks .
Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
Optimize data workflows for performance, cost-efficiency, and reliability .
Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
Implement best practices in data governance, security, and quality management.
Mentor junior engineers and provide technical leadership in data engineering best practices.
Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .
Required Skills & Experience
7+ years of experience in Data Engineering .
Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
Strong experience with PySpark , Spark SQL , and Scala .
Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
Proficiency in data modeling, ETL development , and data warehousing concepts.
Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
Strong SQL development skills with a focus on performance tuning .
Experience in implementing CI / CD pipelines for data solutions.
Create a job alert for this search
Sme • nellore, andhra pradesh, in
Related jobs
Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions LimitedNellore, IN
BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 1 day ago
Promoted
AWS Data Engineer
Vista Applied Solutions Group IncNellore, IN
Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions).
Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 1 day ago
Promoted
Big Data Developer (Hive, Pyspark)
Tata Consultancy Servicesnellore, andhra pradesh, in
Big Data Developer (Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 5th Nov, 2025.Mode of Interview : Virtual Drive(Cisco or Webex).
Hands-on experience of Hadoop, Python, PySpark,...Show moreLast updated: 15 days ago
Promoted
Senior Oracle Data Engineer
Strattek ConsultingNellore, IN
This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.
Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 1 day ago
Promoted
Azure + Databricks
PwC Indianellore, andhra pradesh, in
Job Title : Azure Data Engineer.As a Manager in the Data Engineering practice, you will lead teams and client engagements to design, architect, and deliver enterprise-grade data platforms.You’ll dri...Show moreLast updated: 1 day ago
Promoted
Senior Data Engineer
SAIVA AINellore, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
Promoted
New!
Data Engineer
One Tapp Consultingnellore, andhra pradesh, in
Design and Development : Design, build, and maintain robust, scalable, and optimized ETL / ELT.Python and standard data warehousing principles.
Data Platform Management : Implement and manage data proce...Show moreLast updated: 21 hours ago
Promoted
Azure Databricks+Pyspark
Tata Consultancy ServicesNellore, IN
TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad.
Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show moreLast updated: 15 days ago
Promoted
Senior Solutions Architect (Data)
Hillview Consulting SolutionsNellore, IN
If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on.
You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show moreLast updated: 1 day ago
Promoted
Senior Data Engineer
DonyatiNellore, IN
We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago
Promoted
Data Engineer
DigitalzoneNellore, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 15 days ago
Promoted
Senior Data Engineer (AWS / GCP)
ArmakuniNellore, IN
We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show moreLast updated: 1 day ago
Promoted
AI and Databricks
Quantum Integratorsnellore, andhra pradesh, in
Role : AI and Databricks Engineer.Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers.
Spark, Delta Lake, MLflow, Databr...Show moreLast updated: 1 day ago
Promoted
Azure Databricks
Kumaran SystemsNellore, IN
We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.
The candidate should be proficient in Dat...Show moreLast updated: 1 day ago
Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.ioNellore, IN
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show moreLast updated: 1 day ago
Promoted
Azure Databricks Admin
Greymatter InnovationzNellore, IN
Greymatter Innovationz helps you stay digitally relevant across domains, technologies, and skillsets, every day.Location : Anywhere in India / Bangalore preferred.
Databricks Platform Support and capa...Show moreLast updated: 29 days ago
Promoted
Data Engineer
IntraEdgeNellore, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
Promoted
Senior AWS Data Engineer
CYAN360Nellore, IN
Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago