Lead Data EngineerConfidential • Mangalore, IN
Lead Data Engineer
Confidential • Mangalore, IN
3 hours ago
Job descriptionDesign, build, deploy, and own complete, scalable, and reliable data platforms and solutions. Lead the technical design of new data pipelines, services, and systems. Build reusable frameworks, libraries, and data management tools to improve productivity. Optimize performance and cost-efficiency of data workflows and compute layers. Collaborate with stakeholders such as data scientists, business analysts, and product managers to understand and translate business requirements into technical solutions. Provide technical leadership and mentorship to junior engineers. Ensure the uptime, reliability, and monitoring of the systems you build and own.
Skillset Required
- 7+ years of experience in software development, with a strong foundation in distributed systems, cloud-native architectures, and data platforms.
- Expertise in big data technologies such as Apache Spark and real-time streaming technologies like Apache Kafka.
- Strong programming skills in Python, Java, C++, SQL etc.
- Advanced knowledge of a major cloud platform (AWS, Azure, GCP) and its ecosystem of data services.
- Proficiency with Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormation.
- Strong understanding of advanced data modeling techniques and modern data warehouses.
- Ability to design scalable, fault-tolerant, and maintainable distributed systems.
- Excellent communication and stakeholder management skills.
What You’ll Do
Create a job alert for this search
Lead Data Engineer • Mangalore, IN
Related jobs
These fully remote, long-term freelance roles are ideal for engineers who can build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initi...Show more
Lead Data Engineer
Guidanz Inc • Mangalore, IN
BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
Last updated: 1 day ago • Promoted
Data Engineer
TerraGiG • Mangalore, IN
Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Vriba Solutions • Mangalore, IN
AWS, Snowflake, Kafka, Airflow, GitHub, PySpark, Python.Design, develop, and maintain scalable ETL / ELT pipelines.Ingest data from various sources (APIs, databases, files, etc.Implement both real-ti...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Tata Consultancy Services • Mangalore, IN
Locations : Hyderabad, Kolkata, Noida, Chennai, Bangalore.Designing and building Databricks data pipelines is required.Experience in transforming the data using Azure Databricks & Delta lake.Hands-o...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
BayOne Solutions • Mangalore, IN
We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Donyati • Mangalore, IN
We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
Last updated: 16 days ago • Promoted
Data Engineer
MyRemoteTeam Inc • Mangalore, IN
MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent.We empower businesses by providing world-class software engineers, operations suppo...Show more
Last updated: 3 hours ago • Promoted • New!
Data Engineer
Staffingine LLC • Mangalore, IN
The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions.
This role requires strong Python programming skills, expertise...Show more
Last updated: 7 days ago • Promoted
Senior Snowflake Data Engineer
Luxoft • Mangalore, IN
We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
Last updated: 10 days ago • Promoted
Data Engineer
Quess IT Staffing • Mangalore, Karnataka, India
Lead the design and implementation of scalable data pipelines for ingesting, transforming, and activating customer data.Develop and orchestrate workflows using Apache Airflow and Spark.S3, Glue, At...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Ironbook AI • Mangalore, IN
The ideal candidate will have strong experience with cloud platforms, modern ETL / ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks.
Design, develop, and maintain s...Show more
Last updated: 3 hours ago • Promoted • New!
Data Engineer
EXL • Mangalore, IN
The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
Last updated: 30+ days ago • Promoted
Lead Data Engineer
Ironbook AI • Mangalore, IN
We are seeking an experienced and driven Lead Data Engineer to spearhead the.AI use cases across the organization.Minimum 7 years of experience in data engineering, with at.Strong hands-on experien...Show more
Last updated: 3 hours ago • Promoted • New!
Data Engineer
IntraEdge • Mangalore, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)
SkillsCapital • Mangalore, IN
Remote
Last updated: 4 days ago • Promoted
Data Engineer
ShimentoX Technologies • Mangalore, IN
Data Engineer (Strong with Building data connectors).Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL.
Must have proven background in building data connectors.Experience s...Show more
Last updated: 1 day ago • Promoted
GCP Data Engineer
Adastra • Mangalore, IN
We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
Last updated: 17 days ago • Promoted
Azure Data Engineer
Paritas Recruitment • Mangalore, IN
Azure Data Engineer - 6 Month+ Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking an experienced and...Show more
Last updated: 1 day ago • Promoted