Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
brambleHelius Docs: Solana RPC, APIs & Data Streamingdefi q4140,7861d ago
atlasCanton Coin: A Canton-Network-native payment applicationinfrastructure q513,1621d ago
duneScroll - Announcing the Scroll Beta Testnet on Sepoliaethereum q52,0151d ago
cinderNode Operators - Lido Governanceinfrastructure q41,0821d ago
cinderSolana Wallet Tracker - See Who's Behind Any Wallet | Nansenmarkets q32541d ago
duneIntroducing Scroll, a new layer2 solution - Layer 2 - Ethereum Researchlayer 2 q52,0671d ago
cinderNew Ronin Validators! - by Ronin Networkinfrastructure q34661d ago
atlasEthereum (ETH) - Institutional staking solutionsinfrastructure q46351d ago
brambleClusters and Public RPC Endpoints | Solanasolana q41,1461d ago
cinderInstitutional Staking Infrastructure - Luganodesinfrastructure q34401d ago
cinderLido v3 Whitepaper RFC - Lido V3 - Lido Governanceinfrastructure q52,4601d ago
duneWallet Infrastructure for Payments Platforms | Polygonmarkets q47471d ago
cinderEIP-7251: Increase the MAX_EFFECTIVE_BALANCE - EIPs - Fellowship of Ethereum Magiciansinfrastructure q41,3601d ago
duneOpen Money Stack Payments API - Polygon Developer Docsmarkets q32841d ago
brambleLedger | Helium Documentationmarkets q41,4551d ago
atlasSolana Alpenglow: The Consensus Upgrade Improving Performanceinfrastructure q41,2191d ago
duneAsset directory | Nexus Docsmarkets q34061d ago
atlasGlamsterdam: Ethereum's Next Big Leap Toward a Faster, More Scalable Layer 1ethereum q49321d ago
brambleSalmon — Infraestrutura de carteira aberta para Solanasolana q41,1701d ago
duneNetworks | API Reference | Nexus Docsmarkets q53,1011d ago
brambleSalmon — Infraestructura de wallet abierta para Solanamarkets q41,1401d ago
duneRate Limits | API Reference | Nexus Docsmarkets q45,3281d ago
brambleSalmon — Open Wallet Infrastructure for Solanamarkets q47541d ago
duneAgent Keys | API Reference | Nexus Docsmarkets q53,0801d ago
cinderCommunity Staking Module - #141 by Aleksandra_G - Proposals - Lido Governanceinfrastructure q53,3641d ago
brambleWallet hardware criptovaluta Shield - EAL6+ | Solflaremarkets q36801d ago
atlasProvider API | Staking Rewards Infra Ratingsinfrastructure q33451d ago
cinderEth Docker | Lido Docsinfrastructure q36921d ago
duneGet Started | API Reference | Nexus Docsmarkets q56,4461d ago
cinder⚠️ Slashing Prevention | Lido Docsinfrastructure q47511d ago
duneSP1 Turbo: the world’s fastest zkVM just got fasterethereum q41,7101d ago
atlasValue Proposition | Staking Rewards Infra Ratingsinfrastructure q33981d ago
brambleShield Krypto-Hardware-Wallet - EAL6+ | Solflaremarkets q37061d ago
duneEngineering - Dune Docsmarkets q31991d ago
atlasSolana (SOL) Staking — Live 5.01% APY | Staking Rewardsinfrastructure q32431d ago
duneData Catalog - Dune Docsethereum q54,8771d ago
brambleExplore the world of Solana crypto | Solflaresolana q34451d ago
atlasCanton Network Whitepapersinfrastructure q33101d ago
cinderDeposit Security Committee manual | Lido Docsinfrastructure q41,1931d ago
cinderPol Lanski Delegate Thread - #19 by Lanski - Delegate Platform - Lido Governancegovernance q33841d ago

Newer page 29 of 48 Older