Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
brambleTokens | Solana Beachmarkets q315747d ago
cinderCommunity Staking Module Committee - #23 by madlabman - Proposals - Lido Governancegovernance q316747d ago
brambleTokens | Solana Beachmarkets q317347d ago
cinderProposal: Wind Down the Simple DVT Module Regular Clusters - Proposals - Lido Governanceinfrastructure q51,97247d ago
cinderTechne Credential Programinfrastructure q313647d ago
duneProof Contests | Succinct Docsethereum q392647d ago
brambleStaking Facilities | MEV 🔥 Validator | Solana Beachinfrastructure q328047d ago
cinderMigrate an Existing Validator | Obol Documentationinfrastructure q495747d ago
duneQuickstart | Succinct Docsethereum q31,11647d ago
duneProving World Chain: Scaling ZK to All Humanslayer 2 q41,27747d ago
brambleSubscribing to Events | Solanasolana q323247d ago
duneJohn Guibas - Succinctlayer 2 q41,47547d ago
brambleLoad a local json file keypair | Solanasolana q363547d ago
duneMantle | Institutional Infrastructure for Real-World Assetsmarkets q327947d ago
cinderFuture of the Curated Module | CMv2 Landscape - Proposals - Lido Governanceinfrastructure q54,54647d ago
cinderDual Governance 101: Explainergovernance q41,53647d ago
brambleRewind — Historical State & Simulation for Solana — Solana Vibe Stationsolana q41,80647d ago
brambleManage your billing - Chainstackmarkets q42,02647d ago
cinderA Brief Intro to Coprocessorsmarkets q53,98147d ago
brambleEthers ChainstackProvider Documentation - Chainstackethereum q341247d ago
brambleEthereum Endpoint Security | Quicknode Docsmarkets q476047d ago
brambleEthereum API Endpoints | Quicknode Docsinfrastructure q41,40247d ago
cinderEIPs/EIPS/eip-7002.md at master · ethereum/EIPs · GitHubinfrastructure q56,72747d ago
cinderLatest Protocol Design topics - Lineagovernance q363347d ago
brambleMike Hale | Quicknode Guidessolana q341247d ago
cinderLido V3: Ethereum Staking Infrastructure for a Diverse Product Line - Lido V3 - Lido Governanceinfrastructure q470547d ago
brambleHow to Fuzz Test Programs with Trident | Quicknode Guidesmarkets q510,53747d ago
cinderLido Staking Vaults (stVaults): Technical Design and Architecture - HackMDinfrastructure q522,05847d ago
brambleHow to Test Solana Programs with LiteSVM | Quicknode Guidesmarkets q57,06947d ago
duneIntroducing Confidential Transactions to OP Succinctethereum q456547d ago
brambleHyperliquid RPC | Quicknode Docsethereum q52,77047d ago
duneSP1 Hypercube: Proving Ethereum in Real-Timeethereum q41,07147d ago
cinderRisk assessment for community staking - Department of Decentralisation - Lido Governanceinfrastructure q355647d ago
brambleSolana QuickStart | Quicknode Docssolana q334547d ago
duneOptimism Chooses Succinct to Bring ZK to the Superchainlayer 2 q41,06947d ago
brambleSolana Infrastructure and APIs for Walletsmarkets q327747d ago
duneProof System - Base Documentationgovernance q41,40747d ago
cinderLido dual governance explainer (research distillation) - General - Lido Governancegovernance q53,71247d ago
brambleSolana Data Streaming - Helius Docsdefi q41,33447d ago
cinderOffline & Slashing Risks: Are Self-Cover Options Enough?infrastructure q54,24247d ago

Newer page 22 of 48 Older