Senior Data Engineer

Location: Mumbai, Maharashtra (Onsite)

Experience: 5+ years

Employment Type: Full-time

About the Role:

We're seeking a Senior Data Engineer with deep expertise in large-scale data scraping and end-to-end data architecture design. This role focuses on building the backbone of our AI-driven systems—from developing responsive, semantic scraping frameworks to architecting robust, scalable data pipelines from the ground up. You'll play a key role in ensuring that our data infrastructure is intelligent, efficient, and future-ready.

Key Responsibilities:

• Design and implement scalable web scraping systems capable of handling high-volume, high-velocity data sources.
• Develop responsive and semantic scraping solutions using advanced AI and NLP methods to extract meaningful, context-rich information.
• Architect and build data pipelines from scratch, integrating structured and unstructured data across multiple platforms.
• Establish reliable, fault-tolerant data architectures for long-term scalability and maintainability.
• Integrate scraped data into RAG (Retrieval-Augmented Generation) and other intelligent workflows.
• Continuously enhance scraping performance, pipeline efficiency, and data quality through automation and innovation.

Required Skills and Qualifications:

• 5+ years of experience in data engineering, data scraping, and pipeline development.
• Proven track record of building end-to-end data systems from the ground up.
• Deep knowledge of web scraping tools (Scrapy, Selenium, BeautifulSoup) and anti-blocking, concurrent scraping strategies.
• Strong understanding of AI-driven data extraction, NLP, and semantic enrichment.
• Experience implementing RAG pipelines and integrating LLMs with retrieval systems.
• Familiarity with cloud infrastructure (AWS/GCP/Azure) and CI/CD best practices.

Why Join Us:

• Build cutting-edge, AI-powered data scraping ecosystems at production scale.
• Shape the data architecture roadmap for next-generation intelligent systems.
• Collaborate with a highly skilled, forward-thinking engineering team.
• Competitive salary, challenging projects, and high growth potential.

If you're passionate about turning large-scale web data into meaningful, AI-ready insights, we want you on our team.

Skills Required
Nlp, Gcp, Cloud Infrastructure, Azure, Aws, SCRAPY, Selenium