Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
duneProtocol Architecture | Succinct Docsethereum q41,32947d ago
cinderCommunity Staking Module - #127 by Aleksandra_G - Proposals - Lido Governancegovernance q52,23947d ago
atlasTotal Crypto Spot Exchange Volume — Daily | The Blockmarkets q537,78147d ago
cinderMigrate an Existing Validator | Obol Documentationinfrastructure q41,05947d ago
duneUsecases | Succinct Docsinfrastructure q335447d ago
atlasRWA.xyz | Tokenized U.S. Treasury Fundsmarkets q41,72247d ago
cinderAdd More Validators | SSVinfrastructure q326147d ago
duneMantle Upgrades to OP Succinct on Mainnet, Creating the World’s Largest ZK Rolluplayer 2 q466447d ago
cinderLinea Native Yield - Protocol Design - Lineaethereum q53,49647d ago
atlasSolutions — Fintechs & Neobanks — WalletConnectmarkets q329647d ago
brambleMaximize earnings with Solana staking | Solflareinfrastructure q41,28947d ago
cinderIntroducing Lido V3: Ethereum Staking Infrastructureinfrastructure q51,85747d ago
brambleDownload Solflare: Free Solana Wallet Extension & Mobile Appsolana q339947d ago
cinderLido V3 Whitepaper - HackMDinfrastructure q515,71047d ago
duneBase Adds ZK Proofs to Base Azul with SP1layer 2 q466747d ago
cinderIntroducing Native Yield: Sustainable DeFi Rewards from Bridged ETH | Linea Blogethereum q479847d ago
duneCode of Conduct Council - Retrospective Season 5 - Council Communication Threads - Optimism Collectivemarkets q42,95947d ago
duneProtocol Upgrade: Superchain Registry...markets q317847d ago
cinderHoodi: Lido V3 testnet-2 (Archived) | Lido Docsinfrastructure q322447d ago
bramblesolana-improvement-documents/proposals/0388-bls12-381-syscalls.md at main · solana-foundation/solana-improvement-documents · GitHubdefi q54,09447d ago
duneGovernance: Roles - OP Atlasgovernance q330747d ago
bramblesolana-improvement-documents/proposals/0302-bn254-g2-syscalls.md at main · solana-foundation/solana-improvement-documents · GitHubsolana q396747d ago
cinderTop Proof of Stake Tokens | Staking Rewardsinfrastructure q312247d ago
brambleLarger Transaction Sizes | Solana Mediamarkets q54,80747d ago
duneOptimism Documentationgovernance q52,21447d ago
bramblesolana-improvement-documents/proposals/0392-rent-increase-adaptations.md at main · solana-foundation/solana-improvement-documents · GitHubsolana q53,02447d ago
duneGovernance Fund Phase 1: How to Create a Proposal - Governance Fund: Phase 1 - Optimism Collectivegovernance q337947d ago
brambleRent Reduction on Solana: A Data-Backed Analysis | Solana Mediamarkets q54,86047d ago
atlasSmart Contract Paradigm Shift - Canton Network Docsethereum q357047d ago
cinderdYdX Community Launches First-Ever DYDX Buyback Programmarkets q41,10247d ago
bramblesolana-improvement-documents/proposals/0437-incremental-rent-reduction.md at main · solana-foundation/solana-improvement-documents · GitHubsolana q488547d ago
atlasChoose Your Path - Canton Network Docsinfrastructure q326047d ago
duneSpecial Voting Cycle #16c Roundup - Voting Cycles - Optimism Collectivegovernance q318747d ago
atlasWhat is Canton Network? - Canton Network Docsinfrastructure q487847d ago
duneDeveloper Advisory Board Operating Budget Seasons 8 and 9 - Renewal - Optimism Collectivegovernance q52,56847d ago
duneNascent.xyz | Crypto’s AirTag Moment: Unlocking Mass Adoption with Web Proofsmarkets q52,57547d ago
cinderReGOOSE: Updated goals for Lido in the light of MVI and restaking - Proposals - Lido Governanceinfrastructure q53,16247d ago
cinderReward curve with capped issuance - HackMDinfrastructure q348447d ago
cinderOn Settlement Finality | Ethereum Foundation Bloginfrastructure q54,14047d ago
cinderCirculating Supply Equilibrium for Ethereum and Minimum Viable Issuance during the Proof-of-Stake Era - Economics - Ethereum Researchinfrastructure q59,13247d ago

Newer page 30 of 48 Older