No longer accepting applications

Lead Data Engineering Efforts

beBeeDataEngineerErode, Tamil Nadu, India

5 days ago

Job description

We are seeking an experienced professional to lead our data engineering efforts. This senior data engineer will be responsible for designing and optimizing data pipelines, ensuring smooth data flow and supporting multiple teams with reliable scalable data solutions.

Key Responsibilities :

Design and develop complex data pipelines using Apache Spark
Automate processes and improve scalability of data infrastructure
Collaborate with product, data and engineering teams to solve data challenges
Support machine learning and analytics projects by ensuring accurate and accessible data

Requirements :

11-15 years of experience as a data engineer

Strong experience with Apache Spark (5+ years)

Expertise in Scala, Python, Java and SQL

Hands-on experience with Databricks and cloud-based data systems

Knowledge of relational databases including Postgres and MySQL

Familiarity with Delta tables, Parquet, CSV and JSON

Comfortable with Linux shell scripting and agile environments

Machine learning knowledge is a plus

Strong communication skills & ability to work independently

Perks & Benefits :

Remote work option

Flexible shift timings

Paid leaves, holidays, incentives and medical policy

Company-paid training programs

Inclusive & diverse workplace

Create a job alert for this search

Data Engineering Lead • Erode, Tamil Nadu, India

Related jobs

Promoted

Engineering Manager - Data Platform

CoinbaseSalem,Tamil Nadu, IN

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 1 day ago

Promoted
New!

Data Engineering Manager – AI & Automation (7 to 12 Years)

AIMLEAPSalem,Tamil Nadu, IN

Data Engineering Manager – AI & Automation.Remote (Work from Home) / Bangalore / India .Tech / MCA / Computer Science / IT . IT / Data / AI / E-commerce / FinTech / Healthcare .Python-based data scr...Show moreLast updated: 5 hours ago

Promoted

Data / ML Engineer

LiloSalem,Tamil Nadu, IN

Lilo is revolutionizing procurement for Commercial Real Estate (CRE) businesses by providing a single platform to automate and optimize procurement processes using AI. From hotels to gyms, schools, ...Show moreLast updated: 1 day ago

Promoted

Cloud Data Delivery & Modernization Lead

Pacific Data IntegratorsSalem,Tamil Nadu, IN

Core Technical & Domain Skills.Extensive hands-on experience with cloud modernization of ETL pipelines.Strong data debugging skills and deep understanding of enterprise analytics stack.Proven track...Show moreLast updated: 18 days ago

Promoted

Senior AWS Data Engineer

CYAN360Salem,Tamil Nadu, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Reltio Lead / Architect

Mastech DigitalErode, IN

Chennai / Bangalore / Hyderabad / Noida / Remote with quarterly visit.LPA (Depending on level of expertise).Immediate joiner / Currently serving notice / Notice is less than 60 days.We are looking for a hands...Show moreLast updated: 7 days ago

Promoted

Data Platform Engineer

Intuitive.CloudTiruppur, IN

With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 28 days ago

Promoted

Data Engineering Azure databricks

EXLSalem,Tamil Nadu, IN

Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 23 days ago

Promoted

Power Apps Lead

Exult GlobalSalem,Tamil Nadu, IN

Bachelor's degree in Computer Science, Information Technology, or a related field.Power Apps development (both canvas and model-driven apps). Proficiency in Power Pages, Power Automate, Copilot Stud...Show moreLast updated: 30+ days ago

Promoted

Senior Data Integration Engineer

IndsafriSalem,Tamil Nadu, IN

Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 7 days ago

Promoted

E-discovery- Data Management

MoraeTiruppur, IN

Morae Global seeks to find the best and the brightest people- those who understand what it takes to deliver top quality solutions for our clients. Working closely with all internal stakeholders on t...Show moreLast updated: 8 days ago

Promoted

Technical Lead - Gen AI

AceolutionErode, IN

Freelance Remote Opportunity : Tech Lead – GenAI Code Initiatives.Tech Lead / Senior Software Engineer.AI-driven code generation systems. Write, evaluate, and refine complex code solutions.This is a ...Show moreLast updated: 4 days ago

Promoted

Lead Data Engineer

Searce IncTiruppur, IN

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 18 days ago

Promoted

Data Architect

G10XErode, IN

Senior Data Architect (15+ Years Experience).We are looking for a seasoned Data Architect to lead and shape enterprise-wide data initiatives. This role requires a strategic leader with deep technica...Show moreLast updated: 23 days ago

Promoted

Databricks Engineer Remote Job Offshore

KPG99 INCTiruppur, IN

Remote

Position : Databricks Engineer.Duration : 12 months with extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development.Proficiency...Show moreLast updated: 5 days ago

Promoted

APM Data Integration Analyst

TribolaTech IncSalem,Tamil Nadu, IN

Title - APM Data Integration Analyst.This role ensures data integrity, integration, and governance across the APM ecosystem. The Data Integration Analyst will manage application metadata completenes...Show moreLast updated: 30+ days ago

Promoted

Lead Engineer – AI-Powered Full Stack Solutions ( 5+ yrs)

AIMLEAPTiruppur, IN

Lead Engineer – AI-Powered Full Stack Solutions (WFH).Work from Home / Bangalore / India.Tech / MCA / Computer Science / IT. Proven expertise in delivering complex, cross-domain projects across AI, ...Show moreLast updated: 8 days ago

Promoted

Lead Sustenance Engineer - Storage

DDNTiruppur, IN

This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a globa...Show moreLast updated: 30+ days ago

Promoted

Data Engineering Role

100x.incSalem,Tamil Nadu, IN

At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 18 days ago

Promoted

Data Engineer

IntraEdgeSalem,Tamil Nadu, IN

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago