Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
duneOPerating-manual/Security Council Charter v0.1.md at main · ethereum-optimism/OPerating-manual · GitHubgovernance q52,46447d ago
duneGitHub - ethereum-optimism/superchain-ops: superchain-ops allows builders to create and execute tasks on EVM chains. · GitHubethereum q53,30547d ago
brambleHow DeFi Development Corp Built Its Digital Asset Accounting Infrastructure with TRES | Crypto Accounting and Web3 Treasury | TRES Financedefi q352547d ago
duneGuide to Season 8 - Metagovernance - Optimism Collectivegovernance q52,10747d ago
duneFranklinDAO (Penn Blockchain) - Delegate Communication Thread - Delegate Updates - Optimism Collectivegovernance q493947d ago
dune[FINAL] Velodrome: Fostering Inclusive Governance through Leading Optimism Builders and Long-term Users - ARCHIVED & OLD Missions - Optimism Collectivegovernance q52,36147d ago
duneProtocol Delegation Self-Nominations - #14 by maxlomu - Elections - Optimism Collectivegovernance q343347d ago
brambleStaying Safe on Solana | Solanamarkets q41,13947d ago
duneSynthetix Ambassadors Phase 0 Delegation - 2M OP tokens - #51 by Oxytocin - Delegates 🏛 - Optimism Collectivegovernance q350047d ago
atlasHow to Apply for a Grant | CoW Protocol Documentationgovernance q350047d ago
dune[DRAFT PROPOSAL]: Protocol Delegation Program - #44 by lavande - Reflection Period Proposal - Optimism Collectivegovernance q468947d ago
atlasCoW Swap Affiliate Program | CoW Protocol Documentationmarkets q485747d ago
brambleSteak Proposal - A Solana Proposal For Memecoins - Research - Solana Developer Forumsinfrastructure q53,95847d ago
cindereToro USA Securities Inc. _ Form CRS _ August 2025.docxmarkets q41,72847d ago
duneGovernance Update #4 - Governance Updates - Optimism Collectivegovernance q41,07747d ago
atlasCoW Swap Widget | CoW Protocol Documentationmarkets q56,10947d ago
bramblesRFC 00015: Interfaces - sRFC - Solana Developer Forumsmarkets q52,35547d ago
duneSeason 7 Nominations: Audit Request Team on the Developer Advisory Board - #2 by m4rio.eth - Elections - Optimism Collectivegovernance q338647d ago
brambleValidator FAQ | Solana: Build crypto apps that scaleinfrastructure q52,60447d ago
cinderLive Bitcoin Price, Charts & News - BTC Today | eTorobitcoin q363547d ago
brambleTokens | Solana Beachsolana q323847d ago
duneGitHub - defi-wonderland/opUSDC · GitHubinfrastructure q53,47247d ago
brambleAccount details | Solana Beachsolana q337747d ago
brambleTransactions | Solana Beachsolana q42,26347d ago
duneERC-7802: Crosschain Token Interface - ERCs - Fellowship of Ethereum Magiciansmarkets q41,53847d ago
duneToken Bridging - OP Stack Specificationmarkets q42,30647d ago
cinderEtherscan Login Pagemarkets q52,99847d ago
cinderNFT | ERC-721 | Address: 0x5835e72a...c34287981 | Etherscanmarkets q53,26647d ago
duneOptimism Documentationinfrastructure q42,04647d ago
cinderBancor (BNT) | ERC-20 | Address: 0x1f573d6f...d79a7ff1c | Etherscandefi q59,73647d ago
cinderSecurity | Lido Docsinfrastructure q372547d ago
cinder🌐 Mainnet | Lido Docsinfrastructure q522,42947d ago
cinderTransactions | ethereum.orgethereum q53,33147d ago
cinderDigital Asset Tokenization: Technical framework and Considerations.pptxmarkets q41,87247d ago
cinderFireblocks Governance and Policies Enginegovernance q477547d ago
cinderCrypto Enterprise-Grade Security Platform | Fireblocksdefi q356147d ago
cinder🏦 Vault Owners, Curators, and Stakers | Lido Docsethereum q334247d ago
cinderstVaults Building blocks | Lido Docsdefi q337447d ago
cinderNode Operator Admission: Nansen as stVault Professional Operator - stVaults Identification - Lido Governanceinfrastructure q476847d ago
cinderNansen ETH Vaultinfrastructure q468547d ago

Newer page 32 of 48 Older