Design, develop & maintain data platform services for varied use cases such as Data Extraction, Data Processing, Data Ingestion, Data Observability and Data Discovery.Own and operate the analytical data warehouse / data lake.Manage the deployment of services onto multiple data centres across the globe.Enable performance monitoring and auto-scaling of the platform services.Contribute to establishing and enforcing coding & operational best practices for the team.Who should apply
- 3-5 years of experience in data engineering, BI engineering, and data warehouse development.
- Excellent command of one or more programming languages, preferably Python or Java.
- Excellent SQL skills.
- Knowledge of Flink, Airflow.
- Knowledge of DBT.
- Experience working with Kubernetes.
- Strong knowledge of architecture & internals of Apache Spark with multiple years of hand-on experience.
- Experience working with distributed SQL engines like Athena / Presto.
- Experience in building ETL Data Pipelines.
- Ability to cut through the buzzwords and pick the right tools for building systems centred on core principles of reliability, scalability and maintainability.
Role : Data Engineer
Industry Type : IT Services & Consulting
Department : Data Science & Analytics
Employment Type : Full Time, Permanent
Role Category : Data Science & Machine Learning
Education
UG : Any Graduate
PG : Any Postgraduate
Skills Required
Coding, Data Engineer, Loans, Spark