Senior Data Engineer

SGS & CoMangalore, Republic Of India, IN

2 days ago

Job description

Position Title : Senior Data Engineer

Experience Required : 8 to 12 Years

Location : Remote

Job Summary :

We are looking for a highly skilled and experienced Data Engineer with strong expertise in Databricks , PySpark , and big data technologies . The ideal candidate will play a key role in designing, building, and optimizing scalable data pipelines and analytics solutions to support business decision-making.

Key Responsibilities :

Design, develop, and maintain scalable data pipelines using Databricks and PySpark .
Work with large-scale structured and unstructured data from various sources.
Optimize data workflows for performance and reliability.
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
Implement data quality checks, monitoring, and alerting mechanisms.
Ensure data security and compliance with governance policies.
Participate in code reviews and contribute to best practices in data engineering.

Required Skills & Qualifications :

8 to 12 years of experience in data engineering or related roles.

Strong hands-on experience with Databricks and Apache Spark (PySpark) .

Proficiency in Python and SQL.

Experience with cloud platforms such as Azure , AWS , or GCP (preferably Azure).

Solid understanding of ETL / ELT processes , data warehousing , and data modeling .

Familiarity with Delta Lake and Parquet formats.

Experience with CI / CD pipelines and version control (e.G., Git).

Excellent problem-solving and communication skills.

Preferred Qualifications :

Knowledge of data governance , security , and compliance standards.

Exposure to real-time data processing using tools like Kafka or Spark Streaming.

For More Details

Contact : Magimai

Mobile : 8220698292

Email ID : magimaitamilazhagan.francis@sgsco.com

Create a job alert for this search

Senior Data Engineer • Mangalore, Republic Of India, IN

Related jobs

Promoted

Senior Data Engineer

SAIVA AIMangalore, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Canopus Infosystems - A CMMI Level 3 CompanyMangalore, IN

Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago

Promoted

Data Engineer II

ClearDemandMangalore, IN

Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 2 days ago

Promoted

Data Engineer

DigitalzoneMangalore, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 2 days ago

Promoted

Data Engineer

Insight GlobalMangalore, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accolademangalore, karnataka, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer with AWS_ Exp : 6+ Years

Atyeti IncMangalore, IN

Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

Straivemangalore, karnataka, in

The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Incept Labsmangalore, karnataka, in

Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

ACL Digitalmangalore, karnataka, in

We are looking for professionals with expertise in Data Engineering.Data Engineer (We are looking for 7 to 10years of experience) and Tech Lead – Data Engineer -( looking for 10+ years of experienc...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

Guidanz IncMangalore, IN

BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

IntelliasMangalore, IN

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

Mastekmangalore, karnataka, in

We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago

Promoted

Data Engineer

RecroMangalore, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Platform Engineer

Black Dog LabsMangalore, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

HealthyMe AIMangalore, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago

Promoted

Senior Snowflake Data Engineer

iVoyantMangalore, IN

One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering a...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer-Remote

Cimpress Indiamangalore, karnataka, in

Remote

NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 22 days ago