We're seeking a highly motivated Senior Data Engineer with 7-8+ years of experience to design, deploy, and maintain robust data pipelines and cloud-native data solutions. In this critical role, you'll support cutting-edge AI / ML initiatives, optimize complex data systems, and ensure seamless data flow for advanced analytics.
If you're a hands-on engineer with a passion for building scalable data infrastructure in the cloud and optimizing database performance, we encourage you to apply!
Key Responsibilities
- Data Pipeline Development : Design, develop, and maintain highly scalable and reliable data pipelines for both batch and real-time processing, ensuring data quality and integrity.
- Cloud Data Solution Deployment : Lead the deployment and management of cloud-based data solutions and services on major cloud platforms such as AWS, Azure, or Google Cloud Platform.
- CI / CD & Automation : Implement and optimize CI / CD pipelines for automated deployment of data infrastructure, applications, and configurations using infrastructure-as-code principles.
- Database Management : Administer, manage, and optimize performance for both relational databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB), ensuring robust backup, recovery, and replication strategies.
- Infrastructure Oversight : Oversee server provisioning, deployment, configuration, and monitoring of the entire data infrastructure in cloud and hybrid environments.
- AI / ML Collaboration : Collaborate closely with AI / ML teams to streamline data workflows, optimize data ingestion for model training, and ensure efficient data delivery for model inference.
- Security & Compliance : Implement and maintain robust security measures, ensure data integrity, and adhere to compliance standards across all data systems and pipelines.
- Performance Monitoring & Troubleshooting : Proactively monitor system performance, identify bottlenecks, and troubleshoot complex data infrastructure and database-related issues to ensure high availability and reliability.
Ideal Candidate Profile
Experience : 7-8+ years of progressive experience in data engineering and infrastructure deployment roles.Database Expertise : Strong expertise in database management and optimization for PostgreSQL, MySQL, and MongoDB. This includes performance tuning, indexing, backup / restore, and high availability configurations.Cloud Platforms : Hands-on experience with at least two major cloud platforms (AWS, Google Cloud Platform, or Azure) and proficiency in deploying and managing data services within these environments.Infrastructure as Code : Proven experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Azure Resource Manager).CI / CD Proficiency : Proficiency with CI / CD tools and practices using platforms like Jenkins, GitLab CI / CD, or GitHub Actions.Scripting Skills : Strong scripting skills in Python for automation, data processing, and infrastructure management.Server / Database Administration : Solid understanding of server and database administration principles in cloud and hybrid environments.AI / ML & MLOps : Familiarity with AI / ML data workflows, feature engineering, and MLOps concepts is a significant plus.Soft Skills : Excellent communication, collaboration, and problem-solving skills, with the ability to work effectively in cross-functional teams.(ref : hirist.tech)
Skills Required
Google Cloud Platform, Cloudformation, Postgresql, Performance Monitoring, Jenkins, Terraform, Database Management, Mysql, Mongodb, Security Compliance, Azure, Python, Aws