Talent.com
No longer accepting applications
Data Engineer (Apply in 3 Minutes)

Data Engineer (Apply in 3 Minutes)

Publicis Global Delivery (PGD)Bengaluru, Karnataka, India
6 hours ago
Job description

Note : It's a Data Scrapping / Web Scrapping based role for Bangalore & Gurugram location.

Mandatory Skills : Python and any scrapping framework (Scrapy, Selenium, Playwright, or BeautifulSoup).

Role : Data Acquisition Engineer

Location : Bangalore / Gurgaon

Experience : 3-5 years

An ideal candidate has minimum 3 years of hands-on programming experience in Python, HTML and JavaScript. Candidate has demonstrable knowledge in web development or web scraping and is comfortable working with JSON / XML files to extract data.

As a Data Engineer focused on web crawling and platform data acquisition,

  • You will design, develop, and maintain large-scale web scraping pipelines to extract valuable platform data.
  • You will be responsible for implementing scalable and resilient data extraction solutions, ensuring seamless data retrieval while working with proxy management, anti-bot bypass techniques, and data parsing.
  • Optimizing scraping workflows for performance, reliability, and efficiency will be a key part of your role.
  • Additionally, you will ensure that all extracted data maintains high quality and integrity.

Our expectations from the right candidate :

  • Strong experience in Python and web scraping frameworks such as Scrapy, Selenium, Playwright, or BeautifulSoup.
  • Knowledge of distributed web crawling architectures and job scheduling.
  • Familiarity with headless browsers, CAPTCHA-solving techniques, and proxy management to handle dynamic web challenges.
  • Experience with data storage solutions, including SQL, and cloud storage.
  • Understanding of big data technologies like Spark and Kafka (a plus).
  • Strong debugging skills to adapt to website structure changes and blockers.
  • Create a job alert for this search

    Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Data Engineer 2

    Data Engineer 2

    YubiBangalore Urban, Karnataka, India
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show moreLast updated: 30+ days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsBengaluru, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    CoffeeBeansBengaluru, Karnataka, India
    Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of del...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer [T500-20510]

    Lead Data Engineer [T500-20510]

    ANSRBengaluru, Karnataka, India
    ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    BrothersTechhosur, tamil nadu, in
    Remote (Night Shift - Flexible).Must have excellent English written and verbal communication skills.The ideal candidate should be experienced in data engineering on. Snowflake Azure -ADF, Microsoft ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesBangalore, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    MareanaBengaluru, Karnataka, India
    Mareana is looking for experienced Data Engineer with a strong development background using, RDMS, graph database and NoSQL platforms. This role is responsible for developing and enhancing Mareana’s...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer with Snowflake Experience- Contract

    Data Engineer with Snowflake Experience- Contract

    Gravity Infosolutions, Inc.hosur, tamil nadu, in
    Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical. Most data to be migrated is already in Snowflake...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer_Immediate Joiners

    Data Engineer_Immediate Joiners

    VXI Global Solutionshosur, tamil nadu, in
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXhosur, tamil nadu, in
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    GEMRAJ TECHNOLOGIES LIMITEDhosur, tamil nadu, in
    We are currently seeking a Data Engineer to join our technology team.In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure.The ideal candidate i...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Trantorhosur, tamil nadu, in
    We are seeking a data engineer to design, implement, and optimize cloud-based data pipelines using Microsoft Azure services, including ADF, Synapse, and ADLS. Develop and maintain ETL / ELT pipelines ...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgehosur, tamil nadu, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Impetushosur, tamil nadu, in
    Strong ability to write clean and efficient code.Good understanding of Spark SQL for distributed data processing.Experience with large datasets and structured data manipulation.Ability to write que...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2SoftBangalore Urban, Karnataka, India
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 12 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Tata Consultancy Servicesbangalore, karnataka, in
    Minimum of 8-10 years of relevant data science, Business Intelligence, or data analytics experience – preferably with a digital media or digital advertising company. Experience delivering products i...Show moreLast updated: 12 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradhosur, tamil nadu, in
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionhosur, tamil nadu, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 1 day ago
    • Promoted
    2921 - AWS Data Engineer

    2921 - AWS Data Engineer

    EXLBangalore Urban, Karnataka, India
    Job Title – Data Warehouse Developer.We are looking for a Data Warehouse Developer with strong expertise in SQL and a deep understanding of Data Warehouse (DWH) concepts. The role involves designing...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgehosur, tamil nadu, in
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago