Role Summary
We're looking for a Principal Search / AI Engineer to join our team of search experts and serve as technical lead on large-scale search modernization projects and programs for Fortune-1000 clients. You will collaborate with our established search practice to design, build, and optimize AI-powered search platforms that deliver rich content and product discovery experiences. In this role, you'll drive technical excellence across multi-year digital transformation initiatives, lead solution architecture, and mentor engineering teams while implementing cutting-edge search solutions enhanced with AI and agentic capabilities for our retail, e-commerce, and enterprise clients.
Key Responsibilities
Search Platform Leadership
- Lead technical architecture and strategy for complex search modernization programs spanning multiple years and teams
- Drive end-to-end ownership of Lucene-based search platforms (Solr / Elasticsearch / OpenSearch) including schema design, index pipelines, scaling, and monitoring
- Architect high-throughput, low-latency Java services that expose search functionality via REST / gRPC APIs
- Design and implement advanced search relevance strategies including semantic search, hybrid approaches, and AI-enhanced ranking
- Perform sophisticated relevance tuning leveraging BM25, TF-IDF, vector similarity, and learning-to-rank methodologies
AI and Agentic Search Innovation
Prototype and productionize next-generation search features including faceted navigation, autocomplete / type-ahead, spell-checking, vector search, and hybrid retrievalLead integration of AI-powered conversational search, intelligent query understanding, and agentic workflows to enable natural-language and multi-turn search experiencesArchitect and implement agentic AI frameworks (LangGraph, LangChain) for multi-agent search workflows and intelligent content discoveryTechnical Leadership and Collaboration
Partner with data scientists and ML engineers to deploy and optimize PyTorch-based ranking models for query understanding, embeddings, and re-rankingLead design and implementation of data pipelines (Python / Java / Spark / Dataflow) to generate training signals from user behavior analyticsMentor and guide engineering teams on search best practices, performance optimization, and emerging AI technologiesDrive technical decision-making across cross-functional teams and stakeholder groupsQuality and Operational Excellence
Establish comprehensive metrics, alerting, and automated testing frameworks to guarantee SLA compliance at enterprise scaleLead performance profiling and capacity planning for indexes serving hundreds of millions of documents or SKUsDrive continuous improvement initiatives for search relevance, performance, and user experience metricsRequired Qualifications
8+ years building enterprise-scale back-end systems in Java (Spring Boot or similar) with demonstrated focus on performance, scalability, and reliability5+ years hands-on leadership experience with Lucene-based search engines (Apache Solr, Elasticsearch, or OpenSearch) including advanced index design, relevance tuning, and cluster operations3+ years experience as technical lead on large-scale search or platform modernization programs for enterprise clientsProven track record delivering AI-enhanced search solutions handling 100M+ documents / SKUs at Fortune-1000 scale (e-commerce, media, enterprise content, or similar)Deep understanding of information retrieval concepts including tokenization, analyzers, BM25, TF-IDF, vector similarity, semantic search, and machine learning integrationStrong proficiency in Python for data manipulation, ML model integration, and prototypingExtensive experience with cloud-native architectures, Docker / Kubernetes, CI / CD, and enterprise deployment (AWS, GCP, or Azure)Demonstrated leadership in mentoring engineers and driving technical excellence across teamsPreferred / Bonus Skills
Expert-level understanding of Lucene-based search engines and their underlying architecture, performance characteristics, and optimization strategiesHands-on experience with modern search platform ecosystem including Algolia, Coveo, Lucidworks, Constructor.io, or Vertex AI SearchProven experience implementing agentic AI frameworks (LangGraph, LangChain) and orchestrating multi-agent search workflowsAdvanced experience embedding and serving PyTorch models for Learning-to-Rank, embeddings, conversational AI, and generative re-rankingDeep knowledge of vector databases and similarity search (OpenSearch / ES K-NN, Milvus, Pinecone, Weaviate, Chroma)Experience designing streaming data pipelines (Apache Kafka, Pub / Sub, Apache Flink) for real-time indexing and personalizationActive contributions to open-source information retrieval / ML projects, published research, or recognized technical thought leadershipExperience with cloud-native search services (AWS CloudSearch, GCP Vertex AI Search, Azure Cognitive Search) and hybrid architecturesBackground in natural language processing, transformer models, and large language model integrationTechnical marketing and thought leadership experience including creating and publishing blog posts, white papers, presenting at professional conferences, and maintaining active presence on professional social media platformsLeadership and Soft Skills
Proven technical leader who can balance architectural vision with pragmatic delivery timelinesExcellent communication skills for presenting complex technical concepts to C-level executives, product stakeholders, and engineering teamsPassionate advocate for engineering excellence, continuous learning, and staying current with search, ML, and AI agent technologiesStrong collaborative mindset aligned with Grid Dynamics' co-innovation model and client partnership approachExperience building and scaling high-performing engineering teams in consulting or client services environmentsWhat We Offer
Technical Leadership Impact : Drive search architecture that shapes digital experiences for millions of users across Fortune-1000 brandsGrowth and Learning : Generous budget for conferences, certifications, courses, and dedicated R&D time with our search practiceCutting-Edge Technology : Work with the latest in AI, cloud-native architectures, and the freedom to propose innovative solutionsCollaborative Culture : Join our established team of search experts in an engineering-led environment that values knowledge sharing and technical excellenceProject Variety : Lead diverse search modernization initiatives across e-commerce, content management, enterprise search, and emerging AI-powered discovery experiencesGlobal Impact : Contribute to digital transformation programs that reach millions of end users worldwide