Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens8.37MPages1,307
Storagelocal volumePDFs25

By topic

TopicSharePagesTokens
defi████████████████████1364.08M
markets██████··············4041.20M
infrastructure████················290915.7K
solana███·················121635.4K
ethereum██··················138500.9K
bitcoin██··················32477.6K
governance██··················152453.9K
layer 2····················34101.5K

Why pages were dropped

irrelevant1,159
thin213
low quality180
robots168
http 40360
near duplicate48
not html46
duplicate38
http 40436
http 42920
http 5002
http 4021
pdf too large1

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 9.1%
v2660.95M152.37M█··················· 5.5%
v3892.27M230.69M█··················· 3.6%
v412185.60M463.99M···················· 1.8%
v516335.54M838.86M···················· 0.998%
v620560.99M1.40B···················· 0.597%
v7261.08B2.70B···················· 0.309%
v8301.58B3.95B···················· 0.212%

Kept pages

CrawlerPageTopicTokensWhen
brambleTokens | Solana Beachmarkets q31575h ago
cinderCommunity Staking Module Committee - #23 by madlabman - Proposals - Lido Governancegovernance q31675h ago
brambleTokens | Solana Beachmarkets q31735h ago
cinderProposal: Wind Down the Simple DVT Module Regular Clusters - Proposals - Lido Governanceinfrastructure q51,9725h ago
cinderTechne Credential Programinfrastructure q31365h ago
duneProof Contests | Succinct Docsethereum q39265h ago
brambleStaking Facilities | MEV 🔥 Validator | Solana Beachinfrastructure q32805h ago
cinderMigrate an Existing Validator | Obol Documentationinfrastructure q49575h ago
duneQuickstart | Succinct Docsethereum q31,1165h ago
duneProving World Chain: Scaling ZK to All Humanslayer 2 q41,2775h ago
brambleSubscribing to Events | Solanasolana q32325h ago
duneJohn Guibas - Succinctlayer 2 q41,4755h ago
brambleLoad a local json file keypair | Solanasolana q36355h ago
duneMantle | Institutional Infrastructure for Real-World Assetsmarkets q32795h ago
cinderFuture of the Curated Module | CMv2 Landscape - Proposals - Lido Governanceinfrastructure q54,5465h ago
cinderDual Governance 101: Explainergovernance q41,5365h ago
brambleRewind — Historical State & Simulation for Solana — Solana Vibe Stationsolana q41,8065h ago
brambleManage your billing - Chainstackmarkets q42,0265h ago
cinderA Brief Intro to Coprocessorsmarkets q53,9815h ago
brambleEthers ChainstackProvider Documentation - Chainstackethereum q34125h ago
brambleEthereum Endpoint Security | Quicknode Docsmarkets q47605h ago
brambleEthereum API Endpoints | Quicknode Docsinfrastructure q41,4025h ago
cinderEIPs/EIPS/eip-7002.md at master · ethereum/EIPs · GitHubinfrastructure q56,7275h ago
cinderLatest Protocol Design topics - Lineagovernance q36335h ago
brambleMike Hale | Quicknode Guidessolana q34125h ago
cinderLido V3: Ethereum Staking Infrastructure for a Diverse Product Line - Lido V3 - Lido Governanceinfrastructure q47055h ago
brambleHow to Fuzz Test Programs with Trident | Quicknode Guidesmarkets q510,5375h ago
cinderLido Staking Vaults (stVaults): Technical Design and Architecture - HackMDinfrastructure q522,0585h ago
brambleHow to Test Solana Programs with LiteSVM | Quicknode Guidesmarkets q57,0695h ago
duneIntroducing Confidential Transactions to OP Succinctethereum q45655h ago
brambleHyperliquid RPC | Quicknode Docsethereum q52,7705h ago
duneSP1 Hypercube: Proving Ethereum in Real-Timeethereum q41,0715h ago
cinderRisk assessment for community staking - Department of Decentralisation - Lido Governanceinfrastructure q35565h ago
brambleSolana QuickStart | Quicknode Docssolana q33455h ago
duneOptimism Chooses Succinct to Bring ZK to the Superchainlayer 2 q41,0695h ago
brambleSolana Infrastructure and APIs for Walletsmarkets q32775h ago
duneProof System - Base Documentationgovernance q41,4075h ago
cinderLido dual governance explainer (research distillation) - General - Lido Governancegovernance q53,7125h ago
brambleSolana Data Streaming - Helius Docsdefi q41,3345h ago
cinderOffline & Slashing Risks: Are Self-Cover Options Enough?infrastructure q54,2425h ago

Newer page 7 of 33 Older