Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens8.98MPages1,427
Storagelocal volumePDFs32

By topic

TopicSharePagesTokens
defi████████████████████1544.14M
markets████████············4501.61M
infrastructure█████···············324963.0K
solana███·················131670.4K
ethereum███·················141550.2K
bitcoin██··················37483.6K
governance██··················154463.7K
layer 2█···················36106.3K

Why pages were dropped

irrelevant1,415
robots282
thin260
low quality182
http 40376
near duplicate52
not html46
duplicate40
http 40437
http 42920
http 5002
pdf too large2
http 4021

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 9.8%
v2660.95M152.37M█··················· 5.9%
v3892.27M230.69M█··················· 3.9%
v412185.60M463.99M···················· 1.9%
v516335.54M838.86M···················· 1.1%
v620560.99M1.40B···················· 0.640%
v7261.08B2.70B···················· 0.332%
v8301.58B3.95B···················· 0.228%

Kept pages

CrawlerPageTopicTokensWhen
brambleTokens | Solana Beachmarkets q31578h ago
cinderCommunity Staking Module Committee - #23 by madlabman - Proposals - Lido Governancegovernance q31678h ago
brambleTokens | Solana Beachmarkets q31738h ago
cinderProposal: Wind Down the Simple DVT Module Regular Clusters - Proposals - Lido Governanceinfrastructure q51,9728h ago
cinderTechne Credential Programinfrastructure q31368h ago
duneProof Contests | Succinct Docsethereum q39268h ago
brambleStaking Facilities | MEV 🔥 Validator | Solana Beachinfrastructure q32808h ago
cinderMigrate an Existing Validator | Obol Documentationinfrastructure q49579h ago
duneQuickstart | Succinct Docsethereum q31,1169h ago
duneProving World Chain: Scaling ZK to All Humanslayer 2 q41,2779h ago
brambleSubscribing to Events | Solanasolana q32329h ago
duneJohn Guibas - Succinctlayer 2 q41,4759h ago
brambleLoad a local json file keypair | Solanasolana q36359h ago
duneMantle | Institutional Infrastructure for Real-World Assetsmarkets q32799h ago
cinderFuture of the Curated Module | CMv2 Landscape - Proposals - Lido Governanceinfrastructure q54,5469h ago
cinderDual Governance 101: Explainergovernance q41,5369h ago
brambleRewind — Historical State & Simulation for Solana — Solana Vibe Stationsolana q41,8069h ago
brambleManage your billing - Chainstackmarkets q42,0269h ago
cinderA Brief Intro to Coprocessorsmarkets q53,9819h ago
brambleEthers ChainstackProvider Documentation - Chainstackethereum q34129h ago
brambleEthereum Endpoint Security | Quicknode Docsmarkets q47609h ago
brambleEthereum API Endpoints | Quicknode Docsinfrastructure q41,4029h ago
cinderEIPs/EIPS/eip-7002.md at master · ethereum/EIPs · GitHubinfrastructure q56,7279h ago
cinderLatest Protocol Design topics - Lineagovernance q36339h ago
brambleMike Hale | Quicknode Guidessolana q34129h ago
cinderLido V3: Ethereum Staking Infrastructure for a Diverse Product Line - Lido V3 - Lido Governanceinfrastructure q47059h ago
brambleHow to Fuzz Test Programs with Trident | Quicknode Guidesmarkets q510,5379h ago
cinderLido Staking Vaults (stVaults): Technical Design and Architecture - HackMDinfrastructure q522,0589h ago
brambleHow to Test Solana Programs with LiteSVM | Quicknode Guidesmarkets q57,0699h ago
duneIntroducing Confidential Transactions to OP Succinctethereum q45659h ago
brambleHyperliquid RPC | Quicknode Docsethereum q52,7709h ago
duneSP1 Hypercube: Proving Ethereum in Real-Timeethereum q41,0719h ago
cinderRisk assessment for community staking - Department of Decentralisation - Lido Governanceinfrastructure q35569h ago
brambleSolana QuickStart | Quicknode Docssolana q33459h ago
duneOptimism Chooses Succinct to Bring ZK to the Superchainlayer 2 q41,0699h ago
brambleSolana Infrastructure and APIs for Walletsmarkets q32779h ago
duneProof System - Base Documentationgovernance q41,4079h ago
cinderLido dual governance explainer (research distillation) - General - Lido Governancegovernance q53,7129h ago
brambleSolana Data Streaming - Helius Docsdefi q41,3349h ago
cinderOffline & Slashing Risks: Are Self-Cover Options Enough?infrastructure q54,2429h ago

Newer page 10 of 36 Older