Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
brambleHelius Docs: Solana RPC, APIs & Data Streamingdefi q4140,78647d ago
atlasCanton Coin: A Canton-Network-native payment applicationinfrastructure q513,16247d ago
duneScroll - Announcing the Scroll Beta Testnet on Sepoliaethereum q52,01547d ago
cinderNode Operators - Lido Governanceinfrastructure q41,08247d ago
cinderSolana Wallet Tracker - See Who's Behind Any Wallet | Nansenmarkets q325447d ago
duneIntroducing Scroll, a new layer2 solution - Layer 2 - Ethereum Researchlayer 2 q52,06747d ago
cinderNew Ronin Validators! - by Ronin Networkinfrastructure q346647d ago
atlasEthereum (ETH) - Institutional staking solutionsinfrastructure q463547d ago
brambleClusters and Public RPC Endpoints | Solanasolana q41,14647d ago
cinderInstitutional Staking Infrastructure - Luganodesinfrastructure q344047d ago
cinderLido v3 Whitepaper RFC - Lido V3 - Lido Governanceinfrastructure q52,46047d ago
duneWallet Infrastructure for Payments Platforms | Polygonmarkets q474747d ago
cinderEIP-7251: Increase the MAX_EFFECTIVE_BALANCE - EIPs - Fellowship of Ethereum Magiciansinfrastructure q41,36047d ago
duneOpen Money Stack Payments API - Polygon Developer Docsmarkets q328447d ago
brambleLedger | Helium Documentationmarkets q41,45547d ago
atlasSolana Alpenglow: The Consensus Upgrade Improving Performanceinfrastructure q41,21947d ago
duneAsset directory | Nexus Docsmarkets q340647d ago
atlasGlamsterdam: Ethereum's Next Big Leap Toward a Faster, More Scalable Layer 1ethereum q493247d ago
brambleSalmon — Infraestrutura de carteira aberta para Solanasolana q41,17047d ago
duneNetworks | API Reference | Nexus Docsmarkets q53,10147d ago
brambleSalmon — Infraestructura de wallet abierta para Solanamarkets q41,14047d ago
duneRate Limits | API Reference | Nexus Docsmarkets q45,32847d ago
brambleSalmon — Open Wallet Infrastructure for Solanamarkets q475447d ago
duneAgent Keys | API Reference | Nexus Docsmarkets q53,08047d ago
cinderCommunity Staking Module - #141 by Aleksandra_G - Proposals - Lido Governanceinfrastructure q53,36447d ago
brambleWallet hardware criptovaluta Shield - EAL6+ | Solflaremarkets q368047d ago
atlasProvider API | Staking Rewards Infra Ratingsinfrastructure q334547d ago
cinderEth Docker | Lido Docsinfrastructure q369247d ago
duneGet Started | API Reference | Nexus Docsmarkets q56,44647d ago
cinder⚠️ Slashing Prevention | Lido Docsinfrastructure q475147d ago
duneSP1 Turbo: the world’s fastest zkVM just got fasterethereum q41,71047d ago
atlasValue Proposition | Staking Rewards Infra Ratingsinfrastructure q339847d ago
brambleShield Krypto-Hardware-Wallet - EAL6+ | Solflaremarkets q370647d ago
duneEngineering - Dune Docsmarkets q319947d ago
atlasSolana (SOL) Staking — Live 5.01% APY | Staking Rewardsinfrastructure q324347d ago
duneData Catalog - Dune Docsethereum q54,87747d ago
brambleExplore the world of Solana crypto | Solflaresolana q344547d ago
atlasCanton Network Whitepapersinfrastructure q331047d ago
cinderDeposit Security Committee manual | Lido Docsinfrastructure q41,19347d ago
cinderPol Lanski Delegate Thread - #19 by Lanski - Delegate Platform - Lido Governancegovernance q338447d ago

Newer page 29 of 48 Older