Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
brambleTokens | Solana Beachmarkets q315721h ago
cinderCommunity Staking Module Committee - #23 by madlabman - Proposals - Lido Governancegovernance q316721h ago
brambleTokens | Solana Beachmarkets q317321h ago
cinderProposal: Wind Down the Simple DVT Module Regular Clusters - Proposals - Lido Governanceinfrastructure q51,97221h ago
cinderTechne Credential Programinfrastructure q313621h ago
duneProof Contests | Succinct Docsethereum q392621h ago
brambleStaking Facilities | MEV 🔥 Validator | Solana Beachinfrastructure q328021h ago
cinderMigrate an Existing Validator | Obol Documentationinfrastructure q495721h ago
duneQuickstart | Succinct Docsethereum q31,11621h ago
duneProving World Chain: Scaling ZK to All Humanslayer 2 q41,27721h ago
brambleSubscribing to Events | Solanasolana q323221h ago
duneJohn Guibas - Succinctlayer 2 q41,47521h ago
brambleLoad a local json file keypair | Solanasolana q363521h ago
duneMantle | Institutional Infrastructure for Real-World Assetsmarkets q327921h ago
cinderFuture of the Curated Module | CMv2 Landscape - Proposals - Lido Governanceinfrastructure q54,54621h ago
cinderDual Governance 101: Explainergovernance q41,53621h ago
brambleRewind — Historical State & Simulation for Solana — Solana Vibe Stationsolana q41,80621h ago
brambleManage your billing - Chainstackmarkets q42,02621h ago
cinderA Brief Intro to Coprocessorsmarkets q53,98121h ago
brambleEthers ChainstackProvider Documentation - Chainstackethereum q341221h ago
brambleEthereum Endpoint Security | Quicknode Docsmarkets q476021h ago
brambleEthereum API Endpoints | Quicknode Docsinfrastructure q41,40221h ago
cinderEIPs/EIPS/eip-7002.md at master · ethereum/EIPs · GitHubinfrastructure q56,72721h ago
cinderLatest Protocol Design topics - Lineagovernance q363321h ago
brambleMike Hale | Quicknode Guidessolana q341221h ago
cinderLido V3: Ethereum Staking Infrastructure for a Diverse Product Line - Lido V3 - Lido Governanceinfrastructure q470521h ago
brambleHow to Fuzz Test Programs with Trident | Quicknode Guidesmarkets q510,53721h ago
cinderLido Staking Vaults (stVaults): Technical Design and Architecture - HackMDinfrastructure q522,05821h ago
brambleHow to Test Solana Programs with LiteSVM | Quicknode Guidesmarkets q57,06921h ago
duneIntroducing Confidential Transactions to OP Succinctethereum q456521h ago
brambleHyperliquid RPC | Quicknode Docsethereum q52,77021h ago
duneSP1 Hypercube: Proving Ethereum in Real-Timeethereum q41,07121h ago
cinderRisk assessment for community staking - Department of Decentralisation - Lido Governanceinfrastructure q355621h ago
brambleSolana QuickStart | Quicknode Docssolana q334521h ago
duneOptimism Chooses Succinct to Bring ZK to the Superchainlayer 2 q41,06921h ago
brambleSolana Infrastructure and APIs for Walletsmarkets q327721h ago
duneProof System - Base Documentationgovernance q41,40721h ago
cinderLido dual governance explainer (research distillation) - General - Lido Governancegovernance q53,71221h ago
brambleSolana Data Streaming - Helius Docsdefi q41,33421h ago
cinderOffline & Slashing Risks: Are Self-Cover Options Enough?infrastructure q54,24221h ago

Newer page 22 of 48 Older