Job Description :
We are seeking a Senior Data Engineer who has strong design, developments skills and upkeeps scalability, availability and excellence when building the next generation of our data pipelines and platform.
You are an expert in various data processing technologies and data stores, appreciate the value of clear communication and collaboration, and devote to continual capacity planning and performance fine-tuning for emerging business growth.
As the Senior Data Engineer, you will be mentoring Junior engineers in the team.
Job Requirements :
- Must have 5+ years of experience in Data Engineering field, with a proven track record of exposure in Big Data technologies such as Hadoop, Amazon EMR, Hive, Spark.
- Expertise in SQL technologies and at least one major Data Warehouse technology (Snowflake, RedShift, BigQuery etc.
- Must have experience in building data platform designing and building data model, integrate data from many sources, build ETL and data-flow pipelines, and support all parts of the data platform.
- Programming proficiency in Python and Scala, with experience writing modular, reusable, and testable code, including robust error handling and logging in data engineering applications.
- Hands-on experience with AWS cloud services, particularly in areas such as S3, Lambda, Glue, EC2, RDS, and IAM.
- Experience with orchestration tools such as Apache Airflow, for scheduling, monitoring, and managing data pipelines in a production environment.
- Familiarity with CI / CD practices, automated deployment pipelines, and version control systems (e.g., Git, GitHub / GitLab), ensuring reliable and repeatable data engineering workflows.
- Data Analysis skill can make arguments with data and proper visualization.
- Energetic, enthusiastic, detail-oriented, and passionate about producing high-quality analytics deliverable.
- Must have experience in developing application with high performance and low latency.
- Ability to take ownership of initiatives and drive them independently from conception to delivery, including post-deployment monitoring and support.
- Strong communication and interpersonal skills with the ability to build relationships with stakeholders, understand business requirements, and translate them into technical solutions.
- Comfortable working cross-functionally in a multi-team environment, collaborating with data analysts, product managers, and engineering teams to deliver end-to-end data solutions.
Good To Have :
Experience in Web Services, API integration, Data exchanges with third parties is preferred.Experience in Snowflake is a big plus.Experience in NoSQL technologies (MongoDB, FoundationDB, Redis) is a plus(ref : hirist.tech)