Senior Data Engineer - Scala / Python

Job Summary :

We are seeking a highly skilled and experienced Senior Data Engineer to design, build, and maintain robust data pipelines and infrastructure that enable data-driven decision-making across the organization.

The ideal candidate will have deep expertise in data architecture, ETL processes, and cloud data platforms.

You will collaborate closely with data scientists, analysts, and software engineers to ensure high-quality, scalable, and reliable data Responsibilities :

• Design, develop, and maintain scalable and efficient data pipelines for batch and real-time processing.
• Build and optimize data architectures, data models, and storage solutions to support analytics and business intelligence needs.
• Collaborate with cross-functional teams including data scientists, analysts, and product managers to understand data requirements and deliver data solutions.
• Implement ETL / ELT processes to ingest data from various structured and unstructured sources.
• Ensure data quality, consistency, and reliability through robust validation and monitoring frameworks.
• Develop and maintain data warehouses, data lakes, and related infrastructure using cloud platforms (AWS, Azure, GCP).
• Optimize database performance and manage large-scale distributed data processing systems.
• Implement data security and governance best practices to ensure compliance with regulations.
• Mentor junior data engineers and contribute to the continuous improvement of engineering

standards and practices.

BigQuery.

(ref : hirist.tech)