What Makes Web Data Investable

The first time I sat through an institutional buyer's diligence on one of our datasets, the questions surprised me. Nobody asked how much data we had. They asked when each row had been observed. Whether the history had ever been edited. What happens, operationally, on the day a source breaks. It was less like a sales call and more like an audit, and it taught me more about the alternative-data market than anything I have read about it.

Web data is the largest category of what investors call alternative data: prices, inventory, listings, hiring, reviews, foot traffic's digital cousins. Most funds now touch it somewhere in their process. But there is a wide gap between web data that is interesting and web data an institution will actually pay for and put into production, and the gap is not about volume.

What the buyers are really buying

Timeliness is the obvious part: the web shows you the economy before official numbers do. Breadth matters too, though it is misunderstood. One retailer's prices are an anecdote; the same measurement repeated identically across hundreds of sources becomes an instrument, and the word that matters in that sentence is "identically."

The less obvious asset is history. You cannot go back and start collecting three years ago. Whoever started measuring early owns the back-history, and backtests eat back-history. I have seen buyers pass on technically superior datasets because a worse competitor had four more years of tape. It feels unfair. It is also rational, and it means the best time to start collecting a signal is well before the demand for it is proven.

And then there is the one that decides deals: provenance. Can the vendor say, for any row, when it was observed, from where, under what conditions, and prove it has not been touched since. Data is easy to have. Defensible provenance is the scarce thing, and it is getting scarcer as generated content floods the open web.

The alternative-data market is projected to grow ~19×Column chart. The alternative data market is estimated at 7.2 billion dollars in 2023 and projected to reach 135.7 billion by 2030.The alternative-data market is projected to grow ~19×Global alternative-data market size, USD billions. 52.1% projected CAGR, 2023–2030$0B$50B$100B$150BMarket size (USD billions)$7.2B2023$135.7B2030 (projected)≈ 19× the 2023 marketSource: Grand View Research, Alternative Data Market Report (2023–2030)
View data table
Global alternative-data market size
YearMarket sizeCAGR 2023–2030
2023$7.2B52.1%
2030 (projected)$135.7B

Where datasets fail diligence

The failure patterns are surprisingly consistent.

Retroactive edits are the classic one. Collection history has bugs, and the temptation to quietly clean the past is constant. But a dataset whose January can change in March is useless for backtesting and dangerous in production, so the discipline has to be point-in-time: corrections happen forward, or as explicitly versioned restatements, never silently.

Undocumented methodology changes are subtler. You improve a collector, coverage jumps, and to any model consuming the feed your improvement is indistinguishable from a market event. A good chunk of the false alpha I have seen in web-derived signals traced back to a collection change nobody wrote down, not to anything that happened in the world. The fix is boring: a change log, published, tied to the series.

Then there is coverage honesty. Sources block, redesign, and break; gaps happen to everyone. The difference between vendors is whether gaps are declared or papered over. Institutions can work around missing data. Interpolated data presented as observed is a different thing, and discovering it ends relationships.

Compliance questions used to come last in diligence and now come first: where does this data's right to exist come from, is it public, does collecting it involve deceiving anyone. Precise answers here are a competitive asset. Vague ones are a red flag that experienced buyers treat as disqualifying.

Alternative data went from edge to standardColumn chart. Adoption of alternative data among private fund managers rose from 62% in 2023 to 67% in 2024 to 90% in 2025.Alternative data went from edge to standardShare of private fund managers (PE, hedge funds, VC) using alternative data0%50%100%Share of managers (%)62%202367%202490%2025+28 pp since 2023Source: Lowenstein Sandler 2025 Alternative Data Survey
View data table
Private fund managers using alternative data
YearShare
202362%
202467%
202590%

What the AI wave actually changes

On the supply side, the economics moved. Turning messy web signals into clean panels used to require expensive humans at every step, which kept most niche datasets uneconomical to build. Model-assisted extraction, entity resolution, and continuous anomaly detection bent that cost curve. Sources that were too small, too varied, or too unstable to justify a team are becoming feasible for a system with human review at the edges. The frontier of what counts as collectable is moving outward fast.

On the demand side, funds are pointing their own models at purchased data, and models are unforgiving consumers. A human analyst reads the vendor's caveats; a model happily learns a methodology artifact as if it were alpha. So the premium is shifting further toward exactly the boring virtues above: point-in-time discipline, change logs, declared gaps. The datasets that win are not the biggest. They are the ones a machine can consume safely without a human explaining the footnotes.

Web-scraped data has become a major source for fundsColumn chart. Web scraping as an alternative-data source rose from 37% of firms in 2023 to 57% in 2024, holding near 56% in 2025.Web-scraped data has become a major source for fundsShare of investment firms using web scraping as an alternative-data source0%20%40%60%Share of investment firms (%)37%202357%202456%2025+20 pp in one yearSource: Lowenstein Sandler 2025 Alternative Data Survey
View data table
Investment firms using web scraping as a data source
YearShare
202337%
202457%
202556%

The questions that sort the market

If you are evaluating web-derived data, in either direction of the table, a handful of questions does most of the work:

Vendors who answer in writing, with specifics, are rare, and funds notice. I have watched procurement teams forgive weaker coverage because the provenance answers were airtight, and I have watched bigger datasets die in diligence because they could not produce a change log.

That, more than any AI angle, is the state of this market: production of web data is getting cheaper every quarter, and trust in it is not. The vendors and the funds that internalize which of those two is the bottleneck will be the ones that get the next decade right.

David Martin Riveros is the CEO and Founder of Iceberg Data and a speaker in the Chief AI Officer (CAIO) executive program at Universidad del Rosario. He builds AI systems that collect and analyze web data at scale. More about David · Get in touch

New essays by email, on AI for data collection and analysis.