Automation and Scraping EngineerAIMLEAP • Republic Of India, IN
Automation and Scraping Engineer
AIMLEAP • Republic Of India, IN
30+ days ago
Job descriptionDesign, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources. Optimize scraping pipelines for scalability, reliability, and performance. Work with Scrapy and related Python frameworks / libraries for crawler development. Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content. Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance. Implement AI / ML-based solutions in scraping workflows, such as : Using LLMs for content parsing / cleaning. Automating CAPTCHA solving and anti-bot evasion. Improving data matching, deduplication, and entity recognition. Collaborate with data engineers and product teams to ensure scraped data quality and usability. Maintain proper documentation, testing, and CI / CD practices for scraper code. Bachelor's degree in computer science, IT, or related field. Strong programming skills in Python (Scrapy, Requests, Playwright / Selenium). Proficiency in JavaScript for handling browser automation and dynamic sites. Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling). Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX). Experience working with databases (SQL / NoSQL) for storing and processing scraped data. Hands-on experience in AI / ML tools (e.G., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction / processing. Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments. Strong problem-solving skills for dealing with anti-bot measures and rate limits. Excellent communication and collaboration skills.
Python / JavaScript Developer – Web Scraping - 4 to 7 years
Experience : 4 to 7 Years
Location : Remote
Mode of Engagement : Full-time
No of Positions : 3
Educational Qualifications : Bachelor's degree in Computer Science, Information Technology
Industry : IT / Software Development
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
- Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
- Skilled in JavaScript for web scraping and automation tasks.
- Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
- Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
- Passionate about leveraging advanced technologies to solve complex data challenges
Key Responsibilities
Qualifications
Create a job alert for this search
Automation Engineer • Republic Of India, IN
Related jobs
)
API Automation Engineer
GC Technologies Pvt Ltd • Republic Of India, IN
Infosys Limited Virtual Drive on 13th Dec 2025 : .Pune / BLR / Gurgaon / Noida / CHN / HYD / TVM.Serving or not working can only be considered.
Stick to budget and check documents PF, UAN, payslip availability,...Show more
Last updated: 1 day ago • Promoted
Google Workspace Automation Engineer
Atidan Technologies • Pune, Republic Of India, IN
Developer to support the design, development, automation, and optimization of solutions across the Google Workspace ecosystem.
The developer will be responsible for enhancing collaboration, migratin...Show more
Last updated: 17 hours ago • Promoted • New!
Automation and Instrumentation Engineer
BioTalent Search® • Pune, Republic Of India, IN
Assist in design and installation of field instrumentation and control systems.Review P&IDs, instrument index, loop diagrams, and datasheets.
Support in selection and sizing of instruments (flow, pr...Show more
Last updated: 30+ days ago • Promoted
Qa Automation Engineer
Applicantz • Pune, Republic Of India, IN
THIS IS A 5 MONTHS CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADERS.We are seeking a CI-CD Engineer to design, implement, and optimize continuous integration and delivery pipel...Show more
Last updated: 6 days ago • Promoted
Controls and Automation Engineer
Stellantis • Chennai, Republic Of India, IN
Work with corporate counterparts - understand the requirement and communicate effectively.Expertise in programming on Siemens TIA Portal V13 and above versions along with HMI and allied devices.New...Show more
Last updated: 14 days ago • Promoted
Servo Automation Solutions Engineer
BASE Automation • Chennai, Republic Of India, IN
Troubleshoot, commission, and support servo drive systems—predominantly Rockwell Automation (Kinetix series preferred), but exposure to other platforms (Siemens, Omron, Mitsubishi) is a plus.Lead o...Show more
Last updated: 5 days ago • Promoted
Automation and Deployment Engineer
Karix • Republic Of India, IN
Systems Engineer responsibilities include deploying product updates, identifying production issues and implementing integrations that meet customer needs.
The position works closely with internal te...Show more
Last updated: 30+ days ago • Promoted
Senior Automation Engineer
Movate • Chennai, Republic Of India, IN
The incumbent must have knowledge in software testing methodologies, automation best practices, and software development life cycle (SDLC).
The incumbent will lead, design and write automated script...Show more
Last updated: 30+ days ago • Promoted
Automation Engineer
Rakuten Symphony • Indore, Republic Of India, IN
Rakuten Symphony is reimagining telecom, changing supply chain norms and disrupting outmoded thinking that threatens the industry’s pursuit of rapid innovation and growth.Based on proven modern inf...Show more
Last updated: 17 days ago • Promoted
Automation and Controls Engineering Lead
Stellantis • Chennai, Republic Of India, IN
Work with corporate counterparts - understand the requirement and communicate effectively.Expertise in programming on Siemens TIA Portal V13 and above versions along with HMI and allied devices.New...Show more
Last updated: 14 days ago • Promoted
Web Scraping and Automation Engineer
S2T AI - AI-Powered Investigations • Republic Of India, IN
We're seeking a forward-thinking.AI tools to accelerate development and streamline data extraction processes.Join our India team and work at the intersection of traditional scraping expertise and c...Show more
Last updated: 30+ days ago • Promoted
Automation Engineer
eInfochips (An Arrow Company) • Pune, Republic Of India, IN
Infochips, an Arrow company (A $34 B, NASDAQ listed (ARW);.Ranked #104 on the Fortune List), is a leading global provider of product engineering and semiconductor design services.M deployments in 1...Show more
Last updated: 23 days ago • Promoted
Automation Engineer
Tata Consultancy Services • Chennai, Republic Of India, IN
Good-to-Have Experience in Appium / Test Complete / Cyara / RestAPI.Location : Chennai, Pune, Bangalore, Indore & Mumbai.
Interview Type : Weekday Virtual Drive.Show more
Last updated: 30+ days ago • Promoted
Shell Scripting and Automation Engineer
Tata Consultancy Services • Chennai, Republic Of India, IN
TCS has been a great pioneer in feeding the fire of young techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Role : Unix Shell...Show more
Last updated: 6 days ago • Promoted
Automation and Controls Engineer
V2Soft • Chennai, Republic Of India, IN
This role is to perform the Global CARE (Conveyor Automation Robotic Engineering) related controls tasks especially As an AGV (Automated Guided Vehicle) & AMR (Autonomous Mobile Robot) Specialist, ...Show more
Last updated: 13 days ago • Promoted
QE Automation Engineer
eGain Corporation • Pune, Republic Of India, IN
Fortune 500 clients and government agencies trust eGain AI knowledge solution to improve customer experience and reduce cost of service.
Top rated by Gartner, eGain AI Knowledge Hub orchestrates AI ...Show more
Last updated: 30+ days ago • Promoted
Automation Engineer
UltraTech Cement • Republic Of India, IN
Years of experience in Cement Industry.Diploma / B Tech in Instrumentation / Electronics.DSC, SAP, Operations, Switches, Safety, Instrument.
Must have experience on ABB DCS X 800A Programming and Proble...Show more
Last updated: 6 days ago • Promoted
QE Automation Engineer
Optum • Pune, Republic Of India, IN
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.The work you do with our team will directly improve health outcomes by connect...Show more
Last updated: 20 days ago • Promoted