Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
duneProtocol Architecture | Succinct Docsethereum q41,3291d ago
cinderCommunity Staking Module - #127 by Aleksandra_G - Proposals - Lido Governancegovernance q52,2391d ago
atlasTotal Crypto Spot Exchange Volume — Daily | The Blockmarkets q537,7811d ago
cinderMigrate an Existing Validator | Obol Documentationinfrastructure q41,0591d ago
duneUsecases | Succinct Docsinfrastructure q33541d ago
atlasRWA.xyz | Tokenized U.S. Treasury Fundsmarkets q41,7221d ago
cinderAdd More Validators | SSVinfrastructure q32611d ago
duneMantle Upgrades to OP Succinct on Mainnet, Creating the World’s Largest ZK Rolluplayer 2 q46641d ago
cinderLinea Native Yield - Protocol Design - Lineaethereum q53,4961d ago
atlasSolutions — Fintechs & Neobanks — WalletConnectmarkets q32961d ago
brambleMaximize earnings with Solana staking | Solflareinfrastructure q41,2891d ago
cinderIntroducing Lido V3: Ethereum Staking Infrastructureinfrastructure q51,8571d ago
brambleDownload Solflare: Free Solana Wallet Extension & Mobile Appsolana q33991d ago
cinderLido V3 Whitepaper - HackMDinfrastructure q515,7101d ago
duneBase Adds ZK Proofs to Base Azul with SP1layer 2 q46671d ago
cinderIntroducing Native Yield: Sustainable DeFi Rewards from Bridged ETH | Linea Blogethereum q47981d ago
duneCode of Conduct Council - Retrospective Season 5 - Council Communication Threads - Optimism Collectivemarkets q42,9591d ago
duneProtocol Upgrade: Superchain Registry...markets q31781d ago
cinderHoodi: Lido V3 testnet-2 (Archived) | Lido Docsinfrastructure q32241d ago
bramblesolana-improvement-documents/proposals/0388-bls12-381-syscalls.md at main · solana-foundation/solana-improvement-documents · GitHubdefi q54,0941d ago
duneGovernance: Roles - OP Atlasgovernance q33071d ago
bramblesolana-improvement-documents/proposals/0302-bn254-g2-syscalls.md at main · solana-foundation/solana-improvement-documents · GitHubsolana q39671d ago
cinderTop Proof of Stake Tokens | Staking Rewardsinfrastructure q31221d ago
brambleLarger Transaction Sizes | Solana Mediamarkets q54,8071d ago
duneOptimism Documentationgovernance q52,2141d ago
bramblesolana-improvement-documents/proposals/0392-rent-increase-adaptations.md at main · solana-foundation/solana-improvement-documents · GitHubsolana q53,0241d ago
duneGovernance Fund Phase 1: How to Create a Proposal - Governance Fund: Phase 1 - Optimism Collectivegovernance q33791d ago
brambleRent Reduction on Solana: A Data-Backed Analysis | Solana Mediamarkets q54,8601d ago
atlasSmart Contract Paradigm Shift - Canton Network Docsethereum q35701d ago
cinderdYdX Community Launches First-Ever DYDX Buyback Programmarkets q41,1021d ago
bramblesolana-improvement-documents/proposals/0437-incremental-rent-reduction.md at main · solana-foundation/solana-improvement-documents · GitHubsolana q48851d ago
atlasChoose Your Path - Canton Network Docsinfrastructure q32601d ago
duneSpecial Voting Cycle #16c Roundup - Voting Cycles - Optimism Collectivegovernance q31871d ago
atlasWhat is Canton Network? - Canton Network Docsinfrastructure q48781d ago
duneDeveloper Advisory Board Operating Budget Seasons 8 and 9 - Renewal - Optimism Collectivegovernance q52,5681d ago
duneNascent.xyz | Crypto’s AirTag Moment: Unlocking Mass Adoption with Web Proofsmarkets q52,5751d ago
cinderReGOOSE: Updated goals for Lido in the light of MVI and restaking - Proposals - Lido Governanceinfrastructure q53,1621d ago
cinderReward curve with capped issuance - HackMDinfrastructure q34841d ago
cinderOn Settlement Finality | Ethereum Foundation Bloginfrastructure q54,1401d ago
cinderCirculating Supply Equilibrium for Ethereum and Minimum Viable Issuance during the Proof-of-Stake Era - Economics - Ethereum Researchinfrastructure q59,1321d ago

Newer page 30 of 48 Older