Data Engineer

Data Engineer

Remote role based in India.

• Note - This is a full time, remote, salaried position through Red Elk Consulting, llc, based in India. This role is 100% focused and dedicated to supporting Together Labs, as a consultant, and includes; salary, benefits, vacation, and a local India - based support team

We are seeking an experienced and motivated Data Engineer to join our dynamic data team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines, managing our data warehouse infrastructure, and supporting analytics initiatives across the organization. You will work closely with data scientists, analysts, and other stakeholders to ensure data quality, integrity, and accessibility, enabling the organization to make data-driven decisions.

RESPONSIBILITIES

Design and Develop Data Pipelines : Architect, develop, and maintain robust and scalable data pipelines for ingesting, processing, and transforming large volumes of data from multiple sources in real-time and batch modes .

Data Warehouse Management : Manage, optimize, and maintain the data warehouse infrastructure, ensuring data integrity, security, and availability. Oversee the implementation of best practices for data storage, partitioning, indexing, and schema design.

ETL Processes : Design and build efficient ETL (Extract, Transform, Load) processes to move data across various systems while ensuring high performance, reliability, and scalability.

Data Integration : Integrate diverse data sources (structured, semi-structured, and unstructured data) into a unified data model that supports analytics and reporting needs.

Support Analytics and BI : Collaborate with data analysts, data scientists, and business intelligence teams to understand data requirements and provide data sets, models, and solutions that support their analytics needs.

Data Quality and Governance : Establish and enforce data quality standards, governance policies, and best practices. Implement monitoring and alerting to ensure data accuracy, consistency, and completeness.

Operational Excellence : Drive the development of automated systems for provisioning, deployment, monitoring, failover, and recovery. Implement systems to monitor key performance metrics, logs, and alerts with a focus on automation and reducing manual intervention.

Cross-functional Collaboration : Work closely with product, engineering, and QA teams to ensure the infrastructure supports and enhances development workflows and that services are deployed and operated smoothly at scale.

Incident Management & Root Cause Analysis : Act as a first responder to data production issues, leading post-mortems and implementing long-term solutions to prevent recurrence. Ensure all incidents are handled promptly with a focus on minimizing impact.

Security & Compliance : Ensure our infrastructure is designed with security best practices in mind, including encryption, access control, and vulnerability scanning.

Continuous Improvement : Stay up-to-date with industry trends, technologies, and best practices, bringing innovative ideas into the team to improve reliability, performance, and scale.

QUALIFICATIONS

Education & Experience :

Technical skills :

Soft Skills :