Senior Data Engineer - Python

Description : Position Overview :

We are looking for a highly skilled and motivated Senior Data Engineer to join our dynamic team. You will play a key role in designing, implementing, and optimizing data architectures and pipelines to support scalable data solutions for our business.

Qualifications :

• 6-9 years of experience in data engineering, with a focus on building and managing data pipelines.
• Strong proficiency in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
• Experience in building data pipelines with data warehouses like Snowflake, Redshift
• Experience in processing unstructured data stored from S3 using Athena, Glue etc.
• Hands-on experience with Kafka for real-time data streaming and messaging.
• Solid understanding of ETL processes, data integration, and data pipeline optimization.
• Proficiency in programming languages like Python, Java, or Scala for data processing.
• Experience with Apache Spark for big data processing and analytics.
• Familiarity with cloud platforms like AWS, GCP, or Azure for data infrastructure is a plus.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Key Responsibilities :

Cassandra, etc.) to manage and optimize large datasets.

(ref : hirist.tech)