Job Title : Data Engineer
We are seeking a skilled Data Engineer with 3+ years of experience to design, build, and maintain our robust and scalable data infrastructure. You will play a key role in developing reliable data pipelines, ensuring data availability, and supporting our data-driven initiatives.
Key Responsibilities :
- Design, construct, install, and maintain highly scalable data pipelines using Python, SQL, and Airflow.
- Manage and optimize data storage and retrieval across our diverse database systems, including ClickHouse, MySQL, and Snowflake.
- Develop and deploy containerized data applications within a Kubernetes environment on major cloud platforms (AWS / Azure).
- Collaborate with data analysts and scientists to provide clean, transformed data for analytics and machine learning projects.
- Implement best practices for data governance, version control (Git), and pipeline reliability.
Qualifications & Required Skills :
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience.3+ years of professional experience in a data engineering role.Strong proficiency in Python (Pandas, NumPy, Requests, SQLAlchemy) and advanced SQL.Hands-on experience with ClickHouse and MySQL.Proven expertise in building and orchestrating pipelines with Apache Airflow.Experience with Docker, Kubernetes, and working in Linux / Unix environments.Familiarity with cloud services (AWS, Azure) and cloud data warehouses (Snowflake).(ref : hirist.tech)