Senior Data Engineer II - Kafka / Spark

Description :

Our client is on the lookout for a Data Engineer - Senior II to architect and maintain high-performance data platforms that fuel decision-making and innovation.

If you enjoy designing scalable pipelines, optimizing data systems, and leading with technical excellence, youll thrive in our fast-paced, outcome-driven culture.

Youll take ownership of building reliable, secure, and scalable data infrastructurefrom streaming pipelines to data lakes. Working closely with engineers, analysts, and business teams, youll ensure that data is not just available, but meaningful and impactful across the organization.

Requirements :

• 5 to 7 years of experience in data engineering
• Architect and maintain scalable, secure, and reliable data platforms and pipelines
• Design and implement data lake / data warehouse solutions such as Redshift, BigQuery, Snowflake, or Delta Lake
• Build real-time and batch data pipelines using tools like Apache Airflow, Kafka, Spark, and DBT
• Ensure data governance, lineage, quality, and observability
• Collaborate with stakeholders to define data strategies, architecture, and KPIs
• Lead code reviews and enforce best practices
• Mentor junior and mid-level engineers
• Optimize query performance, data storage, and infrastructure
• Integrate CI / CD workflows for data deployment and automated testing
• Evaluate and implement new tools and technologies as required
• Demonstrate expert-level proficiency in Python and SQL
• Possess deep knowledge of distributed systems and data processing frameworks
• Be proficient in cloud platforms (AWS, GCP, or Azure), containerization, and CI / CD processes
• Have experience with streaming platforms like Kafka or Kinesis and orchestration tools
• Be highly skilled with Airflow, DBT, and data warehouse performance tuning
• Exhibit strong leadership, communication, and mentoring skills

(ref : hirist.tech)