Senior Data Engineer

Position Title : Senior Data Engineer

Experience Required : 8 to 12 Years

Location : Remote

Job Summary :

We are looking for a highly skilled and experienced Data Engineer with strong expertise in Databricks , PySpark , and big data technologies . The ideal candidate will play a key role in designing, building, and optimizing scalable data pipelines and analytics solutions to support business decision-making.

Key Responsibilities :

Design, develop, and maintain scalable data pipelines using Databricks and PySpark .

Work with large-scale structured and unstructured data from various sources.

Optimize data workflows for performance and reliability.

Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.

Implement data quality checks, monitoring, and alerting mechanisms.

Ensure data security and compliance with governance policies.

Participate in code reviews and contribute to best practices in data engineering.

Required Skills & Qualifications :

8 to 12 years of experience in data engineering or related roles.

Strong hands-on experience with Databricks and Apache Spark (PySpark) .

Proficiency in Python and SQL.

Experience with cloud platforms such as Azure , AWS , or GCP (preferably Azure).

Solid understanding of ETL / ELT processes , data warehousing , and data modeling .

Familiarity with Delta Lake and Parquet formats.

Experience with CI / CD pipelines and version control (e.g., Git).

Excellent problem-solving and communication skills.

Preferred Qualifications :

Knowledge of data governance , security , and compliance standards.

Exposure to real-time data processing using tools like Kafka or Spark Streaming.

For More Details

Contact : Magimai

Mobile : 8220698292

Email ID : MagimaiTamilAzhagan.Francis@sgsco.com