Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens8.32MPages1,291
Storagelocal volumePDFs20

By topic

TopicSharePagesTokens
defi████████████████████1354.07M
markets██████··············3951.17M
infrastructure████················284904.6K
solana███·················121635.4K
ethereum██··················138500.9K
bitcoin██··················32477.6K
governance██··················152453.9K
layer 2····················34101.5K

Why pages were dropped

irrelevant1,105
thin202
low quality178
robots136
http 40360
near duplicate48
not html46
duplicate38
http 40432
http 42920
http 5002
http 4021
pdf too large1

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 9.1%
v2660.95M152.37M█··················· 5.5%
v3892.27M230.69M█··················· 3.6%
v412185.60M463.99M···················· 1.8%
v516335.54M838.86M···················· 0.992%
v620560.99M1.40B···················· 0.593%
v7261.08B2.70B···················· 0.308%
v8301.58B3.95B···················· 0.211%

Kept pages

CrawlerPageTopicTokensWhen
atlasRWA.xyz | Introducing the TAC Member Spotlight Seriesmarkets q35183h ago
brambleAdvanced Concepts | Frax Finance ¤governance q41,7123h ago
atlasRWA.xyz | Introducing Our New Asset Classification Frameworkmarkets q41,0263h ago
bramble자주 묻는 질문 - Rocket Pool Guides & Documentationethereum q58,5243h ago
brambleよくある質問 - Rocket Pool Guides & Documentationinfrastructure q58,3283h ago
brambleIntroduction - Rocket Pool Guides & Documentationethereum q33153h ago
duneRFC 8391 - XMSS: eXtended Merkle Signature Schemedefi q436,3203h ago
cinderValidator Admission Process - Node Operators - Lido Governanceinfrastructure q35403h ago
atlasProducts — Account Top-ups & Deposits — WalletConnectmarkets q32493h ago
cinderNansen AI - Trade Everything Onchain with AIdefi q31,8333h ago
atlasSolutions — PSPs & Merchants — WalletConnectmarkets q33183h ago
brambleWhat Is a Crypto Airdrop and How Is It Taxed? - LegalClaritymarkets q52,7653h ago
cinderIntroducing Ronin Waypoint - Ronin’s Newslettermarkets q41,0803h ago
cinderRON Staking. Ronin Games. Wen? NOW. - by Ronin Networkinfrastructure q41,3243h ago
brambleIs Staking Crypto Taxable? IRS Rules Explained - LegalClarityinfrastructure q53,2953h ago
duneScroll Whitepaper (June 2024)layer 2 q52,7063h ago
brambleCHAD Deck (For Website) September 22 2026defi q42,6173h ago
duneLeo: A Programming Language for Formally Verified, Zero-Knowledge Applicationslayer 2 q528,1203h ago
duneScroll - Community Grants Support Program: First events around the worldethereum q41,5023h ago
atlasWalletGuide and WalletConnect Certified: The Future of Digital Wallets — WalletConnectmarkets q47193h ago
cinder[Lido Labs] GOOSE-3: Lido’s Next Chapter - #18 by Mol_Eliza - Proposals - Lido Governanceinfrastructure q35003h ago
duneOpen Money Stack API - Polygon Developer Docsmarkets q52,6383h ago
duneReal-World Asset Tokenization on Polygon | RWAsmarkets q35783h ago
cinderLido "Bring Your Own Validator" Alternative Designdefi q519,7693h ago
brambleExploring Solana Applications | Solanamarkets q49483h ago
atlasThe Canton Development Stack - Canton Network Docsinfrastructure q47813h ago
duneOverview - Polygon Developer Docsmarkets q34993h ago
atlasMental Models for Canton - Canton Network Docsinfrastructure q47773h ago
brambleFeature: Accounts Index on Disk (1.14.17) - Releases - Solana Developer Forumsinfrastructure q32033h ago
brambleFeature: Compact Vote State (1.14.17) - Releases - Solana Developer Forumsinfrastructure q46993h ago
atlasModule 1: Understanding Canton - Canton Network Docsinfrastructure q34893h ago
duneIntroduction | Network | Nexus Docsmarkets q31983h ago
bramble02-25-23 Solana Mainnet Beta Outage Report | Solana Mediainfrastructure q52,2153h ago
cinderEJECTION_BALANCE review: improving UX, risk, and decentralisation · Issue #2883 · ethereum/consensus-specsinfrastructure q32723h ago
duneMargin Math | Math Engine | Nexus Docsdefi q54,8453h ago
atlasCanton's Solution: Three Pillars - Canton Network Docsinfrastructure q49033h ago
atlasThe Problem Canton Solves - Canton Network Docsinfrastructure q47493h ago
cinderEIP-7251: Raising Maximum Effective Balance For Validatorsinfrastructure q519,4103h ago
duneFunding Rate | Math Engine | Nexus Docsinfrastructure q55,7103h ago
atlasCanton Network in 5 Minutes - Canton Network Docsinfrastructure q35463h ago

Newer page 5 of 33 Older