Talent.com
Data Collection and Insights Architect
Data Collection and Insights ArchitectOpptra • Republic Of India, IN
No longer accepting applications
Data Collection and Insights Architect

Data Collection and Insights Architect

Opptra • Republic Of India, IN
30+ days ago
Job description

About Opptra


Opptra is a digital-first omnichannel distributor helping global brands enter and scale across

Asia’s fastest-growing consumer markets — India, Southeast Asia, and the GCC. Founded by

Binny Bansal (co-founder of Flipkart), Opptra operates on a stock-and-sell model, purchasing

inventory upfront and running end-to-end operations from market entry strategy through to

post-purchase experience. With 28 global brands, 18 warehouses, and presence across 15+

marketplaces, Opptra is building the operating system for brand expansion in Asia.


The Role

We are looking for a hands-on, data-obsessed leader to build and own Opptra’s external data

intelligence layer — the crawling, collection, structuring, and delivery of market, competitor, and

category data that powers critical business decisions across the company. This data, combined

with Opptra’s internal operational data, will feed into analytics and decision systems used by

multiple teams across platforms and geographies.


This is not a reporting role. You will architect and build the data pipelines, crawlers, and

real-time feeds that become a core competitive advantage for Opptra — enabling everything

from what to buy and how to price it, to which brands to onboard in which country.


What You’ll Own

1. External Data Collection & Crawling Infrastructure

  • Design, build, and maintain scalable crawling systems to collect structured data from
  • marketplaces, competitor sites, and public data sources across India, SEA, and GCC.

Data to be collected includes (but is not limited to):

  • Product listings, pricing, promotions, and discounts across platforms
  • Category rankings, bestseller lists, search result positions
  • Competitor assortment, new launches, and catalogue changes
  • Customer ratings, reviews, and sentiment signals
  • Ad placement data, sponsored product visibility, and share-of-voice metrics
  • Brand presence and market penetration signals by country
  • Handle anti-scraping mechanisms, rate-limiting, geo-restrictions, and platform-specific nuances across 15+ marketplace environments.
  • Build real-time and near-real-time data feeds where speed of insight matters (e.G., competitor price changes, flash sale monitoring, ad bid landscapes).


2. Data Structuring, Quality & Enrichment

  • Normalize and structure heterogeneous data from diverse platforms into a unified,
  • queryable data layer that different teams can consume reliably.
  • Build entity resolution and matching systems to map products, brands, and categories
  • consistently across marketplaces and regions.
  • Implement data quality monitoring, anomaly detection, and freshness tracking to ensure
  • data reliability for downstream decision-making.
  • Enrich external data with taxonomy, categorization, and metadata tagging relevant to
  • Opptra’s category focus (consumer electronics, home & kitchen, babycare, FMCG, etc.).


3. Decision Support Across Business Functions

  • The data you collect and organize will directly power decisions across:
  • Performance Marketing Competitor ad spend signals, keyword opportunity mapping, category share-of-voice, price position relative to competition — feeding real-time bidding and budget allocation decisions.
  • Pricing & Promotions Competitive price monitoring, discount depth analysis, marketplace fee structures, and margin-optimal price recommendations across platforms and regions.
  • Buying & Inventory Demand signals from search trends, bestseller velocity, seasonal patterns, and category growth indicators to inform what to buy, how much, and when Brand Onboarding Market attractiveness scoring by country and category, whitespace identification, competitive landscape assessment, and brand-market fit analysis to guide which brands to pursue and where.
  • Category Intelligence Category size estimation, growth trajectories, consumer preference shifts, and regulatory landscape changes across target markets.


4. Integration with Internal Data & Analytics

  • Work closely with internal data engineering and analytics teams to combine external
  • intelligence with Opptra’s operational data (sales, inventory, logistics, marketing
  • performance).
  • Build unified data products and dashboards that give platform teams, country heads, and
  • category managers a single view combining market context with internal performance.
  • Ensure data pipelines are production-grade, well-documented, and serve both batch
  • analytics and real-time operational needs.


5. Scale & Innovation

  • Continuously expand coverage to new platforms, data sources, and geographies as
  • Opptra scales.
  • Explore and integrate alternative data sources (social listening, creator/influencer
  • performance data, regulatory databases, trade data).
  • Leverage AI/ML to automate data extraction from unstructured sources, improve entity
  • matching, and generate predictive signals from collected data.


What We’re Looking For: Must Have

  • 5–10 years of experience in data engineering, web scraping/crawling at scale, or market data infrastructure roles.
  • Deep hands-on expertise with large-scale crawling frameworks (Scrapy, Playwright,
  • Puppeteer, or custom solutions) and techniques to handle dynamic pages, CAPTCHAs, and anti-bot measures.
  • Strong proficiency in Python and SQL;
    experience with data pipeline orchestration tools Airflow, Dagster, or similar).
  • Experience building and operating real-time or near-real-time data pipelines (Kafka,Flink, or equivalent).
  • Proven track record of collecting, structuring, and delivering e-commerce or marketplace data at scale.
  • Experience with cloud infrastructure (AWS preferred) for deploying and scaling crawling workloads.
  • Strong understanding of data quality, monitoring, and observability practices.

Strong Plus

  • Experience working with Asian marketplace platforms
  • Background in e-commerce, retail analytics, or competitive intelligence.
  • Experience applying ML/NLP for entity matching, product categorization, or sentiment
  • analysis on marketplace data.
  • Familiarity with pricing optimization, assortment planning, or demand forecasting use
  • cases.
  • Exposure to multiple Asian markets and understanding of regional platform variations.

The Mindset We Value

  • Builder mentality- You want to create systems from scratch, not just maintain them
  • Obsession with data freshness and accuracy- You understand that stale data is worse than no data.
  • Cross-functional fluency —you can translate a pricing team’s question into a data pipeline spec
  • Comfort with ambiguity— marketplace ecosystems change constantly;
    you adapt fast
  • Ownership orientation —You think about data as a product, not just a feed.

Why Opptra

  • Build the data backbone of Asia’s most ambitious brand distribution platform, operating
  • across three of the world’s fastest-growing consumer regions.
  • Work alongside a leadership team.
  • who understand the power of data-driven operations at scale.
  • Your work will directly influence millions of dollars in buying, pricing, and marketing
  • decisions across 28+ global brands.
  • Early-stage impact with real infrastructure — Opptra has the operational scale (18
  • warehouses, 15+ platforms) but the data intelligence layer is being built ground-up.
Create a job alert for this search

Data Collection and Insights Architect • Republic Of India, IN

Similar jobs

Data Architect

FortreaRepublic Of India, IN

Informatics at Fortrea is a high profile, high impact team that focuses on creating innovative data-driven solutions to improve the speed, cost, and quality of drug development.Contribute to archit...Show more

 • Promoted

Senior Data Platform Architect

Americana RestaurantsRepublic Of India, IN

Senior CDP Developer (Customer Data Platform).Build and manage real-time data pipelines and event tracking (RT2, APIs, SDKs).Work on customer data integration, profiles, and identity management.Int...Show more

 • Promoted

Data Architect

Optimum Solutions Pte LtdChennai, Republic Of India, IN

The Technical architect oversees design and own a scalable, secure, and.Build robust data ingestion and processing layers using modern platforms.Enable seamless data integration from diverse enterp...Show more

 • Promoted

Data Architect

KANINIChennai, Republic Of India, IN

At KANINI, we’re committed to building an environment where people can bring their best selves to work.We are looking for an experienced.You will lead the design of scalable data ecosystems, modern...Show more

 • Promoted

Azure Databricks Architect

Tata Consultancy ServicesChennai, Republic Of India, IN

Cloud, Data, Integration, and Analytics platforms.Azure‑based data architectures.Azure Data Factory (ADF) and related services.Integration & security designs.Design, build, and maintain efficient, ...Show more

 • Promoted

Data Architect

OptiSol Business SolutionsChennai, Republic Of India, IN

The ideal candidate will not only build robust data foundations but also leverage.AI-driven recommendations, and predictive reporting.AI adoption, and architecture best practices.RDBMS design, data...Show more

 • Promoted

Data Architect

MitratechRepublic Of India, IN

At Mitratech, we are a team of technocrats focused on building world-class products that simplify operations in the Legal, Risk, Compliance, and HR functions.We are a close-knit, globally dispersed...Show more

 • Promoted

Collections & Dispute Resolution Analyst

HCLTechChennai, Republic Of India, IN

HCLTech-Mega Walk-in for OTC Collection (Order Management, Dispute Management) on 9th & 10th Apr at Navallur, Chennai.ETA 3 - HCL Navalur Block 1, Sandhya Infocity, OMR, Rajiv Gandhi Salai, Navalur...Show more

 • Promoted

Cloud Data Architect, Azure

Tata Consultancy ServicesChennai, Republic Of India, IN

Cloud, Data, Integration, and Analytics platforms.Azure‑based data architectures.Azure Data Factory (ADF) and related services.Integration & security designs.Design, build, and maintain efficient, ...Show more

 • Promoted

Data Governance and Lakehouse Architect (GCP)

ThreatXIntelChennai, Republic Of India, IN

Cybersecurity, IT Staffing, and Consulting company delivering end-to-end technology and security solutions.ThreatXIntel is the official hiring partner.We are seeking a highly experienced.BigQuery, ...Show more

 • Promoted

Data Collections Associate

Input Zero TechnologiesRepublic Of India, IN

Part of the broader Data organization, the Document Collections team is responsible for.SLA’s and uploaded into Addepar to allow the various Data Ops teams to process.This role’s primary responsibi...Show more

 • Promoted

Data Architect

Aurigo Software TechnologiesRepublic Of India, IN

We are seeking an experienced Data Architect to design and implement our enterprise data architecture, with a focus on Data Warehouse/Data Lake / Data Mesh.This position offers an opportunity to sh...Show more

 • Promoted

Ai & Data Architect

CloudFronts - AI First Microsoft Solutions PartnerRepublic Of India, IN

AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI/ML solutions, data engineering, and analytics.The role i...Show more

 • Promoted

Lakehouse Data Architect

ALESAYI HOLDING | العيسائي القابضةChennai, Republic Of India, IN

Build and maintain all data pipelines feeding the Databricks lakehouse, ensuring clean, timely, and governed data flows from every source across the Investment Division’s five portfolio clusters an...Show more

 • Promoted

Data Collection and Synthesis Specialist

CareerXperts ConsultingRepublic Of India, IN

We are looking for a Research Assistant who can go beyond surface-level information and deliver structured, high-quality insights.This role requires curiosity, attention to detail, and the ability ...Show more

 • Promoted

Data Architect

L&T Technology ServicesChennai, Republic Of India, IN

Competent to perform all programming and provide oversight for architecture assessment and design for development assignments without close supervision;.Lead Architecture design of end-to-end enter...Show more

 • Promoted

Global Data Ecosystem & Integration Architect

SodexoRepublic Of India, IN

The Platform Lead Architect will be responsible for defining the Platform Framework and Platform Capabilities, Platform Policies and ensuring their implementation by Sodexo Platform Teams (the Inte...Show more

 • Promoted

Data Architect

Persistent SystemsIndia

We are seeking an experienced Data Architect to design scalable, secure, and high-performance data solutions leveraging Snowflake, Power BI, and Azure for enterprise applications in the Pharma/Life...Show more