Talent.com
Data Acquisition Engineer - Python / SQL

Data Acquisition Engineer - Python / SQL

Sureminds SolutionsBangalore
20 days ago
Job description

Description :

Job Opportunity : Data Engineer Acquisition (Web Crawling & Data Extraction)

We are seeking a highly skilled and passionate Data Engineer Acquisition to join our growing Data Operations Team!

If you enjoy building intelligent data pipelines, solving complex crawling challenges, and working with large-scale datasets, this role is perfect for you.

Role Overview :

As a Data Engineer focused on web crawling & platform data acquisition, you will :

  • Design, develop & maintain large-scale web scraping pipelines
  • Build scalable & resilient data extraction systems
  • Work with anti-bot techniques, proxy management & dynamic parsing
  • Ensure high-quality, high-integrity acquired data across regions
  • Continuously optimize scraping workflows for performance & reliability

Key Responsibilities :

  • Build & maintain crawlers and parsers using cutting-edge tools
  • Automate scraping workflows for accurate platform data collection
  • Implement proxy handling, CAPTCHA bypass & headless browser automation
  • Leverage Python, HTML, JavaScript for data extraction
  • Optimize pipelines for speed, resilience & efficiency
  • Debug website structural changes & fix blockers
  • Ensure the data remains accurate, clean & consistent
  • Collaborate with cross-functional teams to improve data quality
  • Work with JSON, XML & SQL-based data stores
  • Skills & Experience Needed :

  • Minimum 3+ years of programming experience
  • Strong Python expertise
  • Experience in HTML, JavaScript, DOM
  • Hands-on experience with web scraping tools / frameworks :
  • Scrapy
  • Selenium
  • Playwright
  • BeautifulSoup
  • Knowledge of distributed crawling & job scheduling
  • Familiarity with headless browsers & proxy rotation techniques
  • Experience handling CAPTCHA challenges
  • SQL & cloud storage experience
  • Good to have : Spark, Kafka
  • Good To Have :

  • Experience in asynchronous scraping
  • Cloud platforms (AWS / GCP / Azure)
  • CI / CD & automation pipeline exposure
  • Python design patterns
  • Soft Skills :

  • Strong problem-solving & analytical ability
  • Excellent communication & documentation
  • Team player & proactive mindset
  • Ability to adapt to changing web structures
  • Why Join Us?

  • Opportunity to work on sophisticated data acquisition projects
  • Exposure to global-scale platforms & distributed systems
  • Career growth in fast-evolving data engineering space
  • Collaborative, learning-oriented environment
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Bangalore

    Related jobs
    • Promoted
    • New!
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAPhosur, tamil nadu, in
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show moreLast updated: less than 1 hour ago
    • Promoted
    Data Engineer

    Data Engineer

    AscendionBengaluru, Karnataka, India
    Location : Bengaluru, Chennai, Hyderabad and Pune (Hybrid Work model) Job Summary : We are looking for a talented GCP BigQuery Developer with strong SQL skills and basic proficiency in Python t...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyanthosur, tamil nadu, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intelliashosur, tamil nadu, in
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    HCLTechGreater Bengaluru Area, India
    F2F Hackathon scheduled on 22nd Nov 2025.If you are passionate about building scalable data solutions on Google Cloud and enjoy solving real-time data engineering challenges, this is the perfect op...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inchosur, tamil nadu, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 18 days ago
    • Promoted
    Data engineer - AWS - Inperson drive

    Data engineer - AWS - Inperson drive

    Live ConnectionsGreater Bengaluru Area, India
    Show moreLast updated: 1 day ago
    • Promoted
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma Consultancyhosur, tamil nadu, in
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show moreLast updated: 3 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Acme ServicesBengaluru, Karnataka, India
    We are hiring sharp, hands-on Data Engineers to build scalable data solutions and drive performance across both traditional and cloud-based data platforms. Key Roles and Responsibilities.Strong comm...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connectionshosur, tamil nadu, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Pyspark

    Databricks Pyspark

    Tata Consultancy ServicesGreater Bengaluru Area, India
    Greetings from Tata Consulting Services.TCS is Hiring for Azure Databricks & Pyspark.Location : Bangalore / Chennai / Mumbai / Delhi / Hyderabad. Required Technical Skill - Azure Databricks & Pyspark.Show moreLast updated: 1 day ago
    • Promoted
    Senior Python Developer (Programming)

    Senior Python Developer (Programming)

    Jobseekerspage.comhosur, tamil nadu, in
    HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show moreLast updated: 3 days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Live Connectionshosur, tamil nadu, in
    Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    K&K Talentshosur, tamil nadu, in
    This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai. Tableau | ETL / ELT | SQL | Python | Snow...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesGreater Bengaluru Area, India
    We are hiring for Data Engineer!!!.Python, Pyspark, Databricks, AWS cloud architecture.Previous experience as a data engineer or in a similar role. Must have experience with AWS Python, Pyspark,AWS,...Show moreLast updated: 1 day ago
    • Promoted
    Python Software Engineer

    Python Software Engineer

    Teamware Solutionshosur, tamil nadu, in
    Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt Ltd.Role : Python Software Engineer - IC.Location : Bangalore / Hyderabad / pune / Mumbai. Shift : (Flexibility Required) / ...Show moreLast updated: 1 day ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC Grouphosur, tamil nadu, in
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 3 days ago