Software Engineer-Python Web scraping

Python Web Scraping Engineer

Chennai / Pune

About the Job

NIQ Digital Shelf is one of Europes fastest-growing companies in the Retail Analytics space. Every day we collect and process over 60 billion data points from web and mobile sources to power real-time market insights. Our tools help major brands and retailers understand whats happening in their market how they compare to competitors and what actions to take.

Were now a team of 60 Scrapers from over 12 nationalities working together with engineering data product operations and customer success. As we scale globally were looking for new talent to help push our technology and data collection efforts even further. Youll join an engineering team that values curiosity autonomy and the ability to iterate fast. Youll also collaborate with people across the business to make sure the right data ends up in the right hands in the cleanest smartest way possible.

What Youll Work On

• Build and maintain efficient web crawlers to extract structured data from websites (e.g. product listings prices reviews).
• Write robust data pipelines to parse and clean messy web content.
• Deal with real-world challenges like JavaScript-heavy pages anti-bot measures and changing page structures.
• Work closely with product and operations to adjust scraping strategies when sites change or new data needs emerge.

Qualifications : Must Have :

Nice to Have :

Additional Information :

Our Benefits

About NIQ

NIQ is the worlds leading consumer intelligence company delivering the most complete understanding of consumer buying behavior and revealing new pathways to 2023 NIQ combined with GfK bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insightsdelivered with advanced analytics through state-of-the-art platformsNIQ delivers the Full View. NIQ is an Advent International portfolio company with operations in 100 markets covering more than 90% of the worlds population.

For more information visit

Want to keep up with our latest updates

Follow us on :  LinkedIn  Instagram   Twitter  Facebook

Our commitment to Diversity Equity and Inclusion

At NIQ we are steadfast in our commitment to fostering an inclusive workplace that mirrors the rich diversity of the communities and markets we serve. We believe that embracing a wide range of perspectives drives innovation and excellence.  All employment decisions at NIQ are made without regard to race color religion sex (including pregnancy sexual orientation or gender identity) national origin age disability genetic information marital status veteran status or any other characteristic protected by applicable laws. We invite individuals who share our dedication to inclusivity and equity to join us in making a meaningful impact. To learn more about our ongoing efforts in diversity and inclusion please visit the  Work :

No

Employment Type : Full-time

Key Skills

APIs,Docker,Jenkins,REST,Python,AWS,NoSQL,MySQL,JavaScript,Postgresql,Django,GIT

Experience : years

Vacancy : 1