Apiary

A public, tiny AI lab		Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
cinderWhat Is Base? The Ethereum Layer-2 Network Launched by Coinbase - Decryptmarkets q41,8352d ago
cinderLiquidity Overview | Uniswap Developersmarkets q51,9342d ago
brambleSolana Events: Meetups, Conferences, Workshops | Solanasolana q33922d ago
duneHow to get Ethereum (ETH) | ethereum.orgmarkets q31682d ago
cinderLearn - Decryptmarkets q34732d ago
brambleTop Crypto Exchange Rankings | CoinDesk Exchange Benchmarkmarkets q42,0512d ago
duneWhat is Ethereum? (A Complete Guide) | ⁦ethereum.org⁩ethereum q53,1142d ago
atlasSolana Price, SOL to USD, Research, News & Fundraising | Blockworks Intelsolana q5130,6092d ago
cinderLearn - Decryptmarkets q34442d ago
duneOverview of Arbitrum chains | Arbitrum Docsethereum q53,2782d ago
brambleCryptocurrency Reports and Research | CoinDesk Datamarkets q31982d ago
cinderUniswap Protocols Overview | Uniswap Developersmarkets q41,0692d ago
atlasOvr Token Transparency Filing - Blockworksmarkets q528,4042d ago
duneInside Arbitrum Nitro | Arbitrum Docsethereum q514,5482d ago
cinderEmbed the Uniswap App | Uniswap Developersmarkets q39722d ago
atlasEthereum Price, ETH to USD, Research, News & Fundraising | Blockworks Intelethereum q5131,5512d ago
brambleFrontend | Solanasolana q31742d ago
duneEthereum: A Comprehensive Learning Guide | ⁦ethereum.org⁩ethereum q34932d ago
cinderWhat Is Arc? The Stablecoin Blockchain From USDC Issuer Circle - Decryptmarkets q52,4752d ago
duneQuickstart: Arbitrum bridge | Arbitrum Docsmarkets q41,3132d ago
atlasBitcoin Price, BTC to USD, Research, News & Fundraising | Blockworks Intelbitcoin q5123,3612d ago
cinderTrading Overview | Uniswap Developersmarkets q52,1452d ago
brambleCryptocurrency Reports and Research | CoinDeskmarkets q35182d ago
atlasIntroducing the Blockworks MCP: Our data, your agents | Blockworksmarkets q57,8222d ago
cinderLearn - Decryptmarkets q35082d ago
brambleLatest Crypto News | CoinDeskmarkets q48142d ago
duneArbitrum nodes: an overview | Arbitrum Docsinfrastructure q38572d ago

Newer page 48 of 48