Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
atlasThe Canton Networkinfrastructure q468747d ago
atlascanton.network/hubfs/Canton%20Network%20Files/Canton%20Network%20Pilot%20Program/unlocking-collateral-mobility-through-tokenization-us-treasuries-use-case.pdfdefi q55,03547d ago
atlasCircle Research | Circlemarkets q41,16947d ago
brambleSolana Validator Geyser Plugins | Agavesolana q53,62847d ago
duneArchive - a16z cryptomarkets q488247d ago
brambleAccountsDB Replication for RPC Services | Agaveinfrastructure q41,80447d ago
atlasDeveloper Resources for Building with Circle | Circleinfrastructure q344547d ago
atlasCase Studies | USDC Use Cases | Circlemarkets q318947d ago
cinderUnbundling staking: Towards rainbow staking - Economics - Ethereum Researchinfrastructure q57,65447d ago
bramblesolana-program - crates.io: Rust Package Registrysolana q360047d ago
atlasStablecoin Repo Solutions | Circledefi q489547d ago
cinderElectra: Issuance Curve Adjustment Proposal - #11 by barnabe - EIPs core - Fellowship of Ethereum Magiciansethereum q327547d ago
cinderPaths toward single-slot finality - HackMDinfrastructure q54,67947d ago
duneToss and KOMSCO Test a Full Payment Cycle on the OP Stackinfrastructure q41,62147d ago
cinderElectra: Issuance Curve Adjustment Proposal - EIPs core - Fellowship of Ethereum Magiciansinfrastructure q53,34747d ago
atlasUnderstanding Proof-of-Stake | Stakininfrastructure q493947d ago
cinderEndgame Staking Economics: A Case for Targeting - Economics - Ethereum Researchinfrastructure q56,94547d ago
atlasIntroducing Pye: A New Chapter for Staking on Solanainfrastructure q495547d ago
cinderGitHub - pa7x1/ethereum-issuance · GitHubdefi q55,92247d ago
atlasIntroducing Canton Network: Blockchain Infrastructure for Global Financeinfrastructure q479647d ago
cinderLatest EIPs core topics - Fellowship of Ethereum Magiciansethereum q386447d ago
bramblesolana-improvement-documents/proposals/0178-static-syscalls.md at main · solana-foundation/solana-improvement-documents · GitHubsolana q381047d ago
atlasThe Ultimate Gem Wallet Staking Guidemarkets q483347d ago
duneGrants | Ethereum Korea Consortium Funding Programethereum q41,52947d ago
bramblesolana-sdk/define-syscall/src/lib.rs at master · anza-xyz/solana-sdk · GitHubdefi q56,63947d ago
atlasTop 10 Blockchain Networks to Watch in 2025 | Trends & Insightsinfrastructure q52,91647d ago
duneOP Governance Update #1 — June 9, 2022 - Governance Updates - Optimism Collectivegovernance q41,25247d ago
cinderLEGO Q2 2025 Report - Community Grants / Initiatives - Lido Governancegovernance q469247d ago
atlasStaking Rewards - DeFi Ratings | DeFi Ratingsdefi q317447d ago
cinderA Look At stETH Liquidityethereum q52,83747d ago
dune[grant update] Glo Dollar upgrade to funding RetroPGF Retrospective Report - Governance Fund Missions - Optimism Collectivedefi q52,13347d ago
brambleQuantumglow: Will Solana’s Performance Survive Quantum Computing? - Anzainfrastructure q41,36647d ago
duneGovernance Weekly Recap - #91 by Boardroom - Governance Updates - Optimism Collectivegovernance q52,29847d ago
duneThe Future of Optimism Governance - Metagovernance - Optimism Collectivegovernance q54,26147d ago
brambleReal World Assets | Solanasolana q334947d ago
duneOptimism Forum Weekly Recap (May 13, 2024 - May 19, 2024) - Updates and Announcements 📢 - Optimism Collectivegovernance q54,29347d ago
cinderThe Next Chapter for Lido | Lido Financeinfrastructure q52,43347d ago
atlasStakin by The Tie Validator | Solana Beachinfrastructure q327047d ago
atlasPolyglot Canton Whitepaper_Final_11_02_25infrastructure q536,56347d ago
cinderDepartment of Decentralisation - Lido Governanceinfrastructure q365647d ago

Newer page 25 of 48 Older