Senior Data Engineer

Job Summary :

We are seeking an experienced Data Engineer with strong expertise in AWS cloud services and Databricks to design and implement scalable, high-performance data pipelines.

Key Responsibilities :

Design, develop, and maintain data pipelines and workflows using AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena) and Databricks .

Leverage Databricks for data engineering, advanced analytics, and machine learning workloads.

Collaborate with data scientists, analysts, and stakeholders to deliver reliable and scalable data solutions.

Implement data governance, quality checks, and monitoring frameworks .

Ensure high availability, scalability, and cost-effectiveness of data solutions.

Required Skills :

7+ years of experience in data engineering .

Strong hands-on experience with AWS cloud services (S3, Redshift, Glue, EMR, Athena, Lambda, Kinesis).

Expertise in Databricks (PySpark, Delta Lake, ML pipelines).

Proficiency in Python and SQL for data transformation and querying.

Strong understanding of data warehousing, data modeling, and big data frameworks .

Experience with workflow orchestration tools (Airflow, Step Functions).

Preferred Qualifications :

Experience with real-time / streaming data (Kafka, Spark Streaming).

Knowledge of infrastructure as code (Terraform / CloudFormation).

Exposure to data security, compliance, and governance practices.