Design, develop, and maintain data pipelines and ETL processes on Databricks .
Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
Optimize data workflows for performance, cost-efficiency, and reliability .
Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
Implement best practices in data governance, security, and quality management.
Mentor junior engineers and provide technical leadership in data engineering best practices.
Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity .
Required Skills & Experience
7+ years of experience in Data Engineering .
Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
Strong experience with PySpark , Spark SQL , and Scala .
Hands-on experience with cloud platforms (Azure preferred; AWS / GCP a plus).
Proficiency in data modeling, ETL development , and data warehousing concepts.
Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
Strong SQL development skills with a focus on performance tuning .
Experience in implementing CI / CD pipelines for data solutions.
Create a job alert for this search
Sme • Kolkata, IN
Related jobs
Data Engineer
Vriba Solutions • Kolkata, IN
Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
RapidBrains • Kolkata, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Tata Consultancy Services • Kolkata, West Bengal, India
Walkin Date- 15th Nov,25 (Saturday).Venue- Tata Consultancy Services Limited.DH Block(Newtown), Action Area I, Newtown, Chakpachuria, New Town, West Bengal 700135.
Design and implement scalable, sec...Show more
Last updated: 15 days ago • Promoted
Azure Databricks Engineer
Philodesign Technologies Inc • Kolkata, IN
Job Opening : Azure Databricks Engineer (7+ Years Experience) | Budget : ₹1 LPM | Remote / Hybrid.We are seeking a highly skilled.
This role is ideal for professionals who have deep expertise in buildin...Show more
Last updated: 2 days ago • Promoted
Data Support Engineer ( Azure, Databricks )
Kumaran Systems • Kolkata, IN
We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer
LTIMindtree • Greater Kolkata Area, India
LTIMindtree is hiring for below positions and conducting only F2F-Inperson Drive in Chennai / Kolkata locations on 08th-Nov-2025(Saturday).
Open Positions for Chennai / Kolkata based-(5+ to 12 Years onl...Show more
Last updated: 6 days ago • Promoted
Data Engineer
Tata Consultancy Services • Greater Kolkata Area, India
Role : Databricks Senior Developer.Required Technical Skill Set : Databricks, Spark and Data Migration experience.Desired Competencies (Technical / Behavioral Competency).
Databricks, Spark and Data M...Show more
Last updated: 4 days ago • Promoted
Azure Databricks
Tata Consultancy Services • Kolkata, West Bengal, India
Location : Kolkata- Walk in Drive.Design and implement scalable, secure, and high-performance data pipelines using Azure-native services and Azure Databricks.
Develop and maintain ETL / ELT processes t...Show more
Last updated: 18 days ago • Promoted
Senior Data Engineer
SAIVA AI • Kolkata, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.io • Kolkata, IN
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
Last updated: 10 days ago • Promoted
Data Modeler
Stratus • Kolkata, IN
Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks.
Experience with Agile development methodologies and tools, such as Jira, t...Show more
Last updated: 16 days ago • Promoted
Senior Data Engineer
Mindlance • Kolkata, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 8 days ago • Promoted
Azure Databricks
Kumaran Systems • Kolkata, IN
We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.
The candidate should be proficient in Dat...Show more
Last updated: 10 days ago • Promoted
Senior Solutions Architect (Data)
Hillview Consulting Solutions • Kolkata, IN
If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on.
You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
Last updated: 10 days ago • Promoted
Senior Oracle Data Engineer
Strattek Consulting • Kolkata, IN
This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.
Exposure to Oracle FDI (Fusion Data Intel...Show more
Last updated: 10 days ago • Promoted
AWS Data Engineer
Vista Applied Solutions Group Inc • Kolkata, IN
Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions).
Hands-on with AWS : Glue, Lambda, Redshif...Show more
Last updated: 10 days ago • Promoted
AWS Data Architect
ACL Digital • Kolkata, IN
AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices.
.AWS Certified Solutions Architect preferred.Show more
Last updated: 15 days ago • Promoted
Senior Data Engineer
Tata Consultancy Services • Kolkata, West Bengal, India
Job Title : Senior Data Engineer.Required Skillset : Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda).
Master Databricks tools (job creation, cluster, notebook) and be able to qu...Show more