Data Engineer

As a Data Engineer, you will be responsible for architecting and maintaining the robust data pipelines that power our clients' analytical and AI-driven initiatives. You will work closely with data scientists, product managers, and cloud architects to transform raw, disparate data into clean, structured assets that fuel business decision-making. This role is pivotal in ensuring the reliability and scalability of our data infrastructure, directly impacting the efficiency of machine learning models and the accuracy of enterprise-level reporting.

Key Responsibilities :

Development :

- Solution & Application Development : Co-lead the technical execution of our solution roadmap, translating concepts and design prototypes into functional, production-grade applications spanning Python desktop tools, Databricks Apps, and Power Platform business applications.

- Backend Engineering : Co-lead the development of backend logic, data pipelines, and server-side automation to handle data processing, business rules, and integrations with enterprise systems.

- AI & Data Integration : Collaborate closely with data engineering and AI specialists to connect application components to back-end services, including knowledge stores, vector databases, and machine learning models.

- AI Engineering : Build production LLM applications such as chatbots, copilots, agents, and AI-assisted review and classification workflows.

- End-to-End Solution Architecture : Design complete operational systems - data model, automation logic, user interface, and deployment - evaluating multiple solution paths for scalability, maintainability, and business fit.

- Process Re-engineering & Automation : Assess existing business processes, identify automation opportunities, and deliver solutions that achieve measurable efficiency gains.

- Cross-Functional Collaboration : Work in an agile environment with product managers, UX/UI designers, and business stakeholders to rapidly iterate on features and deliver an exceptional user experience.

- Technical Leadership : Champion best practices in code quality, testing, performance, and documentation.

Version Control & CI/CD Automation :

- Utilize GitHub for source control, versioning, and collaborative development.

- Implement CI/CD pipelines using GitHub Actions to automate application deployment.

Collaboration & Stakeholder Communication :

- Work closely with data engineers, analysts, and business teams to gather requirements and design solutions.

- Document technical specifications and best practices for efficient handover and knowledge sharing.

This role is for you if you have the below.

Educational Qualifications :

- Qualifications : Graduate or a post graduate degree in Information Technology or a related field from Tier 1/Tier 2 institute.

Required Skillset :

- 5 - 7 years building and deploying applications and automation solutions in an enterprise environment, including web apps (e.g., Databricks Apps).

- Strong programming skills in Python, including application development with complex business logic, error handling, and logging.

- Experience with LLMs : prompt engineering, RAG (Retrieval-Augmented Generation), and model evaluation techniques for generative AI.

- Experience with Azure AI Foundry, Azure OpenAI Service, or enterprise LLM deployment.

- Experience of building chatbots, agents, or enterprise LLM applications.

- Demonstrated experience integrating applications across systems using RESTful APIs.

- Power Platform : Experience building and delivering solutions on the Microsoft Power Platform, including Power Apps and Power Automate, for business applications, workflow automation, and approvals.

- Data Engineering : Experience with SQL Server and T-SQL (stored procedures, views) and building scheduled data integration jobs (e.g., SSIS or comparable ETL/ELT).

Preferred Technical & Functional Skills :

- Experience with data visualization libraries or analytics platforms such as Databricks or Power BI.

- An understanding of risk management, compliance, or governance domains.

- Knowledge of multi-agent systems, LangChain, or Semantic Kernel.

- Frontend : Experience building responsive, maintainable user interfaces with modern web frameworks (e.g., Vue.js, React), JavaScript, JSON, and API integrations.

(ref:hirist.tech)