This job offer is not available in your country.

Python API Developer - Web Scraping

Akira Consultancy Pvt. Ltd.Bangalore

30+ days ago

Job description

About the Role :

We are seeking a highly skilled Web Scraping & Python API Developer to build and maintain scalable data extraction systems from various websites and APIs. The ideal candidate has hands-on experience with web scraping frameworks, RESTful API development, and data integration techniques.

Responsibilities :

Design and develop robust, scalable web scraping scripts using Python (e.g., Scrapy, BeautifulSoup, Selenium).
Build and maintain RESTful APIs to serve scraped data to internal systems or clients.
Handle anti-bot mechanisms like CAPTCHAs, JavaScript rendering, and IP rotation.
Optimize scraping processes for speed, reliability, and data integrity.
Parse and normalize structured and unstructured data (HTML, JSON, XML).
Monitor and maintain scraping pipelines; handle failures and site structure changes.
Implement logging, error handling, and reporting mechanisms.
Collaborate with product managers and data analysts to define data requirements.
Ensure compliance with website terms of service and data use regulations.

Requirements :

3+ years of experience with Python, especially in data extraction and web automation.

Strong knowledge of web scraping libraries (Scrapy, BeautifulSoup, Requests, Selenium).

Experience with REST API development (FastAPI, Flask, or Django REST Framework).

Proficient with data handling libraries (Pandas, JSON, Regex).

Experience working with proxies, headless browsers, and CAPTCHA solving tools.

Familiarity with containerization (Docker) and deployment on cloud platforms (AWS, GCP, Azure).

Strong understanding of HTML, CSS, JavaScript (from a scraping perspective).

Experience with version control (Git) and agile development methodologies.

Nice to Have :

Experience with GraphQL scraping.

Familiarity with CI / CD pipelines and DevOps tools.

Knowledge of data storage solutions (PostgreSQL, MongoDB, Elasticsearch).

Prior experience with large-scale web crawling infrastructure.

Benefits :

Competitive salary and performance bonuses.

Flexible work hours and remote work option.

Opportunity to work on high-impact, data-driven products.

Learning budget for conferences, books, and courses.

(ref : hirist.tech)

Create a job alert for this search

Api Developer • Bangalore

Related jobs

Promoted
New!

Python Developer

IntraEdgeBangalore, IN

We are building a scalable AWS-based backend application that integrates with CrowdStrike and Palo Alto APIs to process and enforce Host / IP block requests. The application will log and audit each ac...Show moreLast updated: 4 hours ago

Promoted

Python Developer

People Prime WorldwideBengaluru, IN

Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018.It helps companies connect with remote software developers using AI-powered vetting and matching technology.Ori...Show moreLast updated: 30+ days ago

Promoted
New!

Python Developer

IQVIABengaluru, Karnataka, India

Strong understanding of object-oriented programming principles and design patterns.Proficiency in developing and hosting APIs using FastAPI (or similar frameworks). Experience with relational and / or...Show moreLast updated: 4 hours ago

Promoted
New!

Python Fullstack Developer

Brace Infotech Private LtdBengaluru, Karnataka, India

As a Senior Engineer II, you will work as the technical leader for the product(s) your team delivers.You will be counted on as a leader in your technology space, as you contribute to all areas of d...Show moreLast updated: 4 hours ago

Promoted
New!

Python developer

Axiom Software Solutions Limitedbangalore, India

Understanding of frameworks connected to Python, such as flask, Django, etc.The ability to use server-side templating languages. Understanding of Python’s threading restrictions and multiprocess arc...Show moreLast updated: 5 hours ago

Promoted

Python / JavaScript Developer – Web Scraping ( 4 to 7 Years)

AIMLEAPBengaluru, IN

Python / JavaScript Developer – Web Scraping - 4 to 7 years.Bachelor's degree in Computer Science, Information Technology. Strong expertise in web scraping with hands-on experience in large-scale data...Show moreLast updated: 1 day ago

Promoted
New!

Python Developer

AvathonBengaluru, Karnataka, India

AI with a powerful platform that enables businesses to harness the full potential of their operational data.Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-...Show moreLast updated: 4 hours ago

Promoted
New!

Senior Python developer

DMAIC Academy & ConsultancyBengaluru, IN

Designing, implementing, and maintaining web applications that meet the needs of our.Focus on engineering best practices and continuous improvement, and have lots of business.Excellent knowledge of...Show moreLast updated: 4 hours ago

Promoted
New!

Python Developer

TEKsystems Global Services in IndiaBangalore, IN

We're Hiring : Backend Developer – Python | AWS | CI / CD | Terraform.Infrastructure as Code (Terraform).If you're passionate about building scalable backend systems and automating cloud infrastructur...Show moreLast updated: 4 hours ago

Promoted
New!

Python API Developer

Aqilea (formerly Soltia)bangalore, India

We are a consulting company with a bunch of technology-interested and happy people!.We love technology, we love design and we love quality. Our diversity makes us unique and creates an inclusive and...Show moreLast updated: 11 hours ago

Promoted
New!

Python Developer

Techvariabangalore, India

Architect, design, and develop enterprise applications with multi-tenant and modular capabilities.Build and maintain robust backend services using FastAPI / Django with PostgreSQL.Develop modern, res...Show moreLast updated: 5 hours ago

Promoted
New!

Senior Full Stack Developer – AWS / Go / Python / Next.js

Asgard.worldBengaluru, IN

Senior Full Stack Developer – AWS | Go | Python | Next.We’re looking for an exceptional.If you love designing and delivering scalable solutions across the stack — from robust cloud backends to mode...Show moreLast updated: 4 hours ago

Promoted
New!

Python Developer

SmartQBengaluru, Karnataka, India

We are a leading B2B Food-Tech company built on 4 pillars-great people, great food, great experience, and greater good.Solving complex business problems with our heart and analyzing possible soluti...Show moreLast updated: 4 hours ago

Promoted
New!

Python Developer

True Blue HR ConsultantsBengaluru, Karnataka, India

Design, develop, and maintain high-quality, scalable, and secure Python-based applications and microservices, with a strong focus on backend development. Build and enhance web applications using mod...Show moreLast updated: 4 hours ago

Promoted
New!

Python Developer

CodeWithSenseBengaluru, Karnataka, India

We build AI-powered products and scalable web / mobile solutions for global clients across FinTech, FoodTech, e-commerce, and Healthcare. We also provide Staff Augmentation.DevOps practices, and reduc...Show moreLast updated: 4 hours ago

Promoted
New!

Python Developer

Innovatily IncBangalore Urban, Karnataka, India

Innovatily is seeking a skilled and experienced Python Developer with a strong hands-on experience in python libraries.Your expertise in Python will contribute to the development of innovative algo...Show moreLast updated: 4 hours ago

Promoted
New!

Python Developer

EdgeVerveBengaluru, Karnataka, India

EdgeVerve AI Next, part of Infosys Topaz, enables the scaling of Applied AI across the enterprise.Built from the ground up to leverage the power of Generative AI, the AI Next platform bridges silos...Show moreLast updated: 4 hours ago

Promoted
New!

Senior Python Developer - Flask Exp - Greenfield Role - Custom Software Development

CareerXperts ConsultingGreater Bengaluru Area, India

It is an engineering-first company focused on solving deep tech challenges.They partner with innovative organizations to build complex, scalable, and mission-critical systems.Their foundation is ro...Show moreLast updated: 4 hours ago

Promoted
New!

AWS Python Developer

Quinnoxbangalore, India

Please send your resume to the following email address along with Job Title as the subject line to.A proven track record as a Senior Developer with 5 to 7 years of experience in AWS, Python, and Po...Show moreLast updated: 5 hours ago

Promoted
New!

Python Developer

NAGRABangalore Urban, Karnataka, India

Our portfolio of award-winning products and services spans traditional video security, cybersecurity, cloud-based video and streaming solutions, turn-key D2C solutions for the sports industry, and ...Show moreLast updated: 4 hours ago