Senior Data Pipeline Engineer

Who we are?

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo.

The primary purpose of all of us, at Searce, is driving intelligent, impactful & futuristic business outcomes using new-age technology. This purpose is driven passionately by HAPPIER people who aim to become better, everyday.

What are we looking for?

Searce is looking for a Lead Data Engineer who is able to work with business leads, analysts, data scientists and fellow engineers to build data products that empower better decision making. Someone who is passionate about the data quality of our business metrics and geared up to provide flexible solutions that can be scaled up to respond to broader business questions.

What you'll do as a Lead Data Engineer with us?

1. Understand the business requirements and translate these to data services to solve the business and data problems

2. Develop and manage the transports / data pipelines (ETL / ELT jobs) and retrieve applicable datasets for specific use cases using cloud data platforms and tools

3. Explore new technologies and tools to design complex data modelling scenarios, transformations and provide optimal data engineering solutions

4. Build data integration layers to connect with different heterogeneous sources using various approaches

5. Understand data and metadata to support consistency of information retrieval, combination, analysis and reporting

6. Troubleshoot and monitor data pipelines to have high availability of reporting layer

7. Collaborate with many teams - engineering and business, to build scalable and optimized data solutions and propose ways to improve platform and tools

8. Effectively manages workstreams for self and 2 to 3 analysts to support delivery

What are the must-haves to join us?

Is Education overrated? Yes. We believe so. But there is no way to locate you otherwise. So we might look for at least a Bachelor’s degree in Computer Science and

1. 7-10 years of experience with building the data pipelines or data ingestion for both Batch / Streaming data from different sources to data warehouse / data lake

2. Experience leading and delivering data warehousing and analytics projects, including using cloud technologies such as EMR, Lambda, Cloud Storage, BigQuery, etc.

3. Experience of at-least 2 to 3 projects building and optimizing BigData data pipelines, architectures and datasets

4. Handson experience / knowledge with SQL / Python / Java / Scala programming, understanding of SQL is a must

5. Experience with any cloud computing platforms like AWS (S3, Lambda functions, RedShift, Athena), GCP (GCS, Dataflow, Dataproc, Pub / Sub, Bigquery), Azure (Blob / Azure, Synapse) etc.

6. Knowledge of version control software such as Git and experience in working with relevant hosting services (e.G. Azure DevOps, Github, Bitbucket, Gitlab)

7. Strong experience working with relevant Python & R packages and ecosystems (e.G. pandas, NumPy, scikit-learn, tidyverse, data tables)

8. Extensive experience in developing complex stored procedures and transformations

9. Experience / knowledge with Big Data tools (Hadoop, Hive, Spark, Presto)

So, If you are passionate about tech, future & what you read above (we really are!), apply here to experience the ‘Art of Possible’