Role Overview :
We are seeking an experienced Lead Data Engineer to design, develop, and scale data infrastructure while mentoring a team of engineers. The role involves collaborating with cross-functional teams, defining data requirements, and driving AI-powered data solutions that deliver high impact.
Key Responsibilities :
- Design and optimize SQL Server database architectures for performance, scalability, and high availability.
- Build and maintain data pipelines & ETL processes for large-scale integration.
- Implement DevOps practices (CI / CD automation) for data workflows.
- Develop and oversee Python-based applications for analytics and AI model deployment.
- Collaborate with data scientists to enable AI-driven insights and solutions.
- Ensure data governance, compliance, and security across data platforms.
- Research and adopt new technologies to enhance infrastructure efficiency.
Requirements :
10+ years of experience in data engineering / database development2+ years of team leadership or management experienceStrong expertise in SQL Server (performance tuning, indexing, HA)Advanced Python skills (Pandas, NumPy, PySpark, SQLAlchemy, APIs)Experience with DevOps (Azure DevOps / GitHub Actions), CI / CD, Docker, KubernetesProficiency in cloud platforms (Azure preferred)Knowledge of real-time data processing (Kafka, Spark Streaming)Strong knowledge of data modeling & data warehousingExcellent communication and collaboration skillsBonus Skills :
Certifications (Azure Data Engineer / DevOps Engineer)Familiarity with MLOps tools (MLflow, Kubeflow)Knowledge of AI / ML frameworks (TensorFlow, PyTorch, scikit-learn)Experience with web scraping (Beautiful Soup, Scrapy, Selenium)Why join us ?
Lead impactful projects with AI & cloud-first data solutionsWork fully remote with a collaborative, innovative teamOpportunities for continuous learning & growth in modern data tech(ref : hirist.tech)