Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens8.35MPages1,298
Storagelocal volumePDFs23

By topic

TopicSharePagesTokens
defi████████████████████1364.08M
markets██████··············3991.19M
infrastructure████················286904.8K
solana███·················121635.4K
ethereum██··················138500.9K
bitcoin██··················32477.6K
governance██··················152453.9K
layer 2····················34101.5K

Why pages were dropped

irrelevant1,120
thin208
low quality179
robots153
http 40360
near duplicate48
not html46
duplicate38
http 40435
http 42920
http 5002
http 4021
pdf too large1

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 9.1%
v2660.95M152.37M█··················· 5.5%
v3892.27M230.69M█··················· 3.6%
v412185.60M463.99M···················· 1.8%
v516335.54M838.86M···················· 0.995%
v620560.99M1.40B···················· 0.595%
v7261.08B2.70B···················· 0.309%
v8301.58B3.95B···················· 0.211%

Kept pages

CrawlerPageTopicTokensWhen
cinderEJECTION_BALANCE review: improving UX, risk, and decentralisation · Issue #2883 · ethereum/consensus-specsinfrastructure q32724h ago
duneMargin Math | Math Engine | Nexus Docsdefi q54,8454h ago
atlasCanton's Solution: Three Pillars - Canton Network Docsinfrastructure q49034h ago
atlasThe Problem Canton Solves - Canton Network Docsinfrastructure q47494h ago
cinderEIP-7251: Raising Maximum Effective Balance For Validatorsinfrastructure q519,4104h ago
duneFunding Rate | Math Engine | Nexus Docsinfrastructure q55,7104h ago
atlasCanton Network in 5 Minutes - Canton Network Docsinfrastructure q35464h ago
duneClosed Loop | Math Engine | Nexus Docsinfrastructure q57,2084h ago
brambleA Framework for Governance - Introduction - #3 by cfl0ws - Governance - Solana Developer Forumsgovernance q31844h ago
duneSystem | Math Engine | Nexus Docsdefi q54,2554h ago
atlasUSDC Rewards - Coinbase Developer Documentationmarkets q32014h ago
atlasOverview - Coinbase Developer Documentationmarkets q33614h ago
duneGlobal Model | Math Engine | Nexus Docsdefi q521,1004h ago
cinderInformational | Ethereum Improvement Proposalsethereum q38574h ago
duneThe Engine, Formally | Math Engine | Nexus Docsmarkets q31,6074h ago
cinderEIP-1: EIP Purpose and Guidelinesethereum q57,4424h ago
duneBuilding the World’s Largest ZK Rollup with Mantlelayer 2 q49604h ago
cinder0x02 CSM Landscape - Proposals - Lido Governanceinfrastructure q52,9744h ago
cinderPolar - Delegate Thread - #23 by polar - Delegate Platform - Lido Governancegovernance q36174h ago
duneEVM Overview - Dune Docsethereum q31574h ago
bramblesolana.org/docs/SFDP_agreement_non-US.pdfsolana q55,2344h ago
brambleInstitutional Growth Lead- Japan @ Solana Foundationsolana q52,8424h ago
duneCurated Data Overview - Dune Docsethereum q33114h ago
brambleTokens | Solana Beachsolana q32404h ago
brambleAccount details | Solana Beachmarkets q54,0974h ago
cinderEthereum Node Operatorsmarkets q558,9064h ago
duneData Freshness - Dune Docsethereum q46184h ago
atlasOrder Lifecycle - Polymarket Documentationmarkets q35644h ago
brambleTokens | Solana Beachsolana q32404h ago
cinderSSV Lido Module (SSVLM) Proposal - #11 by Izzy - Proposals - Lido Governanceinfrastructure q32464h ago
duneData Trust & Reliability - Dune Docsinfrastructure q48374h ago
brambleTokens | Solana Beachmarkets q31574h ago
cinderCommunity Staking Module Committee - #23 by madlabman - Proposals - Lido Governancegovernance q31674h ago
brambleTokens | Solana Beachmarkets q31734h ago
cinderProposal: Wind Down the Simple DVT Module Regular Clusters - Proposals - Lido Governanceinfrastructure q51,9724h ago
cinderTechne Credential Programinfrastructure q31364h ago
duneProof Contests | Succinct Docsethereum q39264h ago
brambleStaking Facilities | MEV 🔥 Validator | Solana Beachinfrastructure q32804h ago
cinderMigrate an Existing Validator | Obol Documentationinfrastructure q49574h ago
duneQuickstart | Succinct Docsethereum q31,1164h ago

Newer page 6 of 33 Older