Role : Senior Data Engineer
Position Type : Full-Time Contract (40hrs / week)
Contract Duration : Long Term
Work Schedule : 8 hours / day (Mon-Fri)
Location : Hybrid(3x days onsite) - Pune, India
Duties / Day-to-Day Overview :
- Demonstrate a deep knowledge of, and ability to operationalize, leading data technologies and best practice
- Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production
- We develop real products. You need to be an expert in design, coding, and scripting
- Facilitate problem diagnosis and resolution in technical and functional areas
- Encourage change, especially in support of data engineering best practices and developer satisfaction
- Write high-quality code that is consistent with our standards, creating new standards as necessary
- Demonstrate correctness with pragmatic automated tests
- Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices
- Develop strong working relationships with others across levels and functions
- Participate in, and potentially coordinate, Communities-of-Practice in those technologies in which you have an interest
- Participate in continuing education programs to grow your skills both technically and in the Williams-Sonoma business domain
- Serve as a member of an agile engineering team and participate in the team's workflow
Top Requirements (Must Haves) :
5+ years of experience working with big data technologies in enterprise environmentsProven ability to design, build, and optimize distributed, scalable, and reliable data pipelines for both batch and real-time processingHands-on experience with Databricks and Apache Spark, including Spark Structured Streaming for real-time data ingestionProficiency with Kafka for event-driven architecturesStrong SQL skills and experience working with cloud data warehouses such as SnowflakeFamiliarity with data modeling, performance tuning, and data governance best practicesExperience with ETL development and data manipulation; Java experience is a plusAbility to work collaboratively in cross-functional teams and translate business requirements into technical solutions