Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
cinderWhat Is Base? The Ethereum Layer-2 Network Launched by Coinbase - Decryptmarkets q41,83547d ago
cinderLiquidity Overview | Uniswap Developersmarkets q51,93447d ago
brambleSolana Events: Meetups, Conferences, Workshops | Solanasolana q339247d ago
duneHow to get Ethereum (ETH) | ethereum.orgmarkets q316847d ago
cinderLearn - Decryptmarkets q347347d ago
brambleTop Crypto Exchange Rankings | CoinDesk Exchange Benchmarkmarkets q42,05147d ago
duneWhat is Ethereum? (A Complete Guide) | ⁦ethereum.org⁩ethereum q53,11447d ago
atlasSolana Price, SOL to USD, Research, News & Fundraising | Blockworks Intelsolana q5130,60947d ago
cinderLearn - Decryptmarkets q344447d ago
duneOverview of Arbitrum chains | Arbitrum Docsethereum q53,27847d ago
brambleCryptocurrency Reports and Research | CoinDesk Datamarkets q319847d ago
cinderUniswap Protocols Overview | Uniswap Developersmarkets q41,06947d ago
atlasOvr Token Transparency Filing - Blockworksmarkets q528,40447d ago
duneInside Arbitrum Nitro | Arbitrum Docsethereum q514,54847d ago
cinderEmbed the Uniswap App | Uniswap Developersmarkets q397247d ago
atlasEthereum Price, ETH to USD, Research, News & Fundraising | Blockworks Intelethereum q5131,55147d ago
brambleFrontend | Solanasolana q317447d ago
duneEthereum: A Comprehensive Learning Guide | ⁦ethereum.org⁩ethereum q349347d ago
cinderWhat Is Arc? The Stablecoin Blockchain From USDC Issuer Circle - Decryptmarkets q52,47547d ago
duneQuickstart: Arbitrum bridge | Arbitrum Docsmarkets q41,31347d ago
atlasBitcoin Price, BTC to USD, Research, News & Fundraising | Blockworks Intelbitcoin q5123,36147d ago
cinderTrading Overview | Uniswap Developersmarkets q52,14547d ago
brambleCryptocurrency Reports and Research | CoinDeskmarkets q351847d ago
atlasIntroducing the Blockworks MCP: Our data, your agents | Blockworksmarkets q57,82247d ago
cinderLearn - Decryptmarkets q350847d ago
brambleLatest Crypto News | CoinDeskmarkets q481447d ago
duneArbitrum nodes: an overview | Arbitrum Docsinfrastructure q385747d ago

Newer page 48 of 48