Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
cinderpaperhub.s3.amazonaws.com/18e91eb4db2114a06ea614f0384f2784.pdfdefi q526,84746d ago
cinderusenix.org/system/files/conference/nsdi16/nsdi16-paper-eyal.pdfbitcoin q517,37446d ago
atlasLetter to Treasury Secretary Yellen on FTX markets q495846d ago
dunedocs.anoma.foundation/mica-whitepaper-1.pdfmarkets q514,70846d ago
dunedocs.anoma.foundation/mica-whitepaper-2.pdfmarkets q515,78346d ago
cinderusenix.org/system/files/sec22-prunster.pdfmarkets q421,37546d ago
cinderfirebasestorage.googleapis.com/v0/b/firescript-577a2.appspot.com/o/imgs%2Fapp%2Fethrig%2FjiaI9X0AtR.pdf?alt=media&token=a2d910c6-07c7-4c15-875d-855ef887f310infrastructure q510,53046d ago
atlasLetter to Trump on Republican Budget Proposalgovernance q41,68646d ago
cinderThe Anoma Ecosystem | Explore the DOS Landscapedefi q324046d ago
cinderOKX, NYSE Parent File for Tokenized US Stock Platformmarkets q335646d ago
cinderWill Vivek Ramaswamy Focus on Crypto in his Gubernatorial Run?markets q41,23846d ago
cinderBitcoin ETFs Draw $241M as Ether Funds Swing to Outflowsbitcoin q336146d ago
cinderMetaplanet Reveals Net Income Strategy for Bitcoin Accumulationbitcoin q495346d ago
cinderStrategy Hits 848K Bitcoin as STRC Buybacks Surgebitcoin q361646d ago
cinderThe Limits to Blockchain Scalabilityinfrastructure q54,88146d ago
cinderWhy it's so important to go stateless · Dankrad Feistinfrastructure q53,04546d ago
duneAdvanced Configuration | Yedric.aiinfrastructure q42,74046d ago
cinderEthereum Data Structuresethereum q522,12446d ago
cinderResearch Index | Paradigmethereum q42,28646d ago
duneEmbedding the Widget | Yedric.aiinfrastructure q43,42046d ago
cinderResearch | Paradigmbitcoin q362846d ago
cinderThis week in Currents: The OpenSea Digest, September 25, 2026 | OpenSeamarkets q41,50546d ago
cinderThis week in Currents: The OpenSea Digest, October 2, 2026 | OpenSeaethereum q41,66346d ago
cinderInterfacemarkets q52,92646d ago
cinderProjects & Creatorsmarkets q54,88146d ago
cinderAnnouncementsmarkets q511,84146d ago
cinderNewsmarkets q526,47946d ago
cinderFeaturesmarkets q524,71346d ago
cinderObol V2: Looking Forwardinfrastructure q465646d ago
cinderGitHub - 0xfuturistic/pepc-distributed-validator-specs: Distributed Validator Specifications for PEPC · GitHubinfrastructure q41,08046d ago
cinderUnderstanding Based Rollups: PGA Challenges, Total Anarchy, and Potential Solutions - Economics - Ethereum Researchlayer 2 q54,77546d ago
cinderExpanding Mempool Perspectives - protocol-research-call - Ethereum Researchinfrastructure q41,78146d ago
cinderRollups = Bridges + Blockchains - Layer 2 - Ethereum Researchinfrastructure q52,81746d ago
cinderBased Rollups can reward Proposers First Come First Serve - Layer 2 - Ethereum Researchlayer 2 q495446d ago
cinderRollup Decentralisation Analysis Framework - #3 by mratsim - Layer 2 - Ethereum Researchlayer 2 q312046d ago
cinderMake Everything A Based Optimistic Rollup - Layer 2 - Ethereum Researchlayer 2 q361346d ago
cinderLayout of a Solidity Source File — Solidity 0.8.38-develop documentationethereum q41,91646d ago
cinderSolidity by Example — Solidity 0.8.38-develop documentationgovernance q59,02946d ago
cinderIntroduction to Smart Contracts — Solidity 0.8.38-develop documentationethereum q55,91946d ago
cinderContributing — Solidity 0.8.38-develop documentationethereum q54,88046d ago

page 1 of 48 Older