Senior Data Engineer

Responsibilities

• Watch Reels and YouTube videos every day and level up on your fashion sense.
• Develop and optimize ETL workflows using Spark within our Databricks/Delta Lake Lakehouse following Medallion architecture.
• Work with cloud analytics and ML platforms, including BigQuery, Athena, EMR, and SageMaker.
• Manage ingestion and integration using Airbyte.
• Enable downstream analytics and reporting through well-modeled datasets for tools like Power BI.
• Write maintainable and scalable code, and know when to trade code quality for faster delivery
• Communicate with both technical and non-technical teams to identify and solve roadblocks in advance.
• Suggest and implement 10x improvements in the current systems that technology can enable.
• Solve new business problems using technology every day.
  
  

Requirements

• If you are a content creator yourself or have worked closely in the social media space, we like you already: )
• Business-oriented problem-solving mindset.
• Willing to work in a fast-paced startup environment and follow Agile practices.
• 4+ years of software engineering experience. At least 2 years of experience in building data pipelines.
• Willingness to learn new stacks and technologies to solve new business problems.
• Proficient in using Linux-based systems (any of Ubuntu/CentOS/MacOS/etc. ) and Bash.
• Proficient and experienced in using Git for collaborative development.
• Aware of common design patterns, good coding, and documentation practices.
• Above everything, willing to learn continuously and keep improving.
  
  

This job was posted by Rajshree Bisht from Wishlink.
Skills Required
Git, Spark, Power Bi, Bash, Emr, BigQuery, Linux