Senior GenAI Engineer

Grid Dynamics is seeking an AI Expert (Senior Engineer) to spearhead the development of local Large Language Models (LLMs) for Personally Identifiable Information (PII) detection across our vast data ecosystem. This role involves building and fine-tuning custom LLMs that can identify PII in documents, databases, knowledge graphs, source code, and other knowledge-sharing platforms. The models must effectively handle data at scale (50+ PB of data) and remain up-to-date with continuous retraining on a quarterly or monthly basis.

As the AI Senior Engineer, you will design and implement these AI solutions using technologies like Ray, llama.cpp, ollama, vLLM, and PyTorch, deploying them on Azure cloud and on-premises infrastructure for efficient, large-scale operation. You will also develop generative AI agents that leverage data schemas and metadata to improve PII detection accuracy. Collaboration is key : you will work closely with data engineering, security, and compliance teams to ensure the AI models meet business requirements and align with industry regulations (GDPR, CCPA, PCI DSS, etc.).

Essential Functions

• Design, train, fine-tune, and optimize local LLMs or other NLP models for PII detection across diverse data types (documents, databases, knowledge graphs, code, and other knowledge-sharing formats).
• Develop generative AI agents (on Autogen / Langgraph) for schema- and metadata-based PII detection to enhance identification of sensitive data.
• Work with cutting-edge AI frameworks (Ray, llama.cpp, ollama, vLLM, PyTorch) to deploy and scale models efficiently in a distributed environment.
• Implement and optimize AI / ML solutions on Azure cloud and on-premise infrastructure, ensuring high performance and reliability.
• Collaborate with data engineering, security, and compliance teams to align AI solutions with business needs and regulatory requirements.
• Lead a small team of AI engineers, providing mentorship, code reviews, and technical guidance to drive project success.
• Maintain and monitor model performance, retraining models on a quarterly or monthly basis to handle 50+ PB of evolving data and to improve accuracy over time.
• Ensure AI models follow best practices and compliance standards, adhering to security requirements and regulations (GDPR, CCPA, PCI DSS, etc.).

Qualifications

Would be a plus

We offer

About Us

Grid Dynamics (NASDAQ : GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.

Skills Required

Azure Cloud, Pytorch, Python