Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens9.21MPages1,550
Storagelocal volumePDFs34

By topic

TopicSharePagesTokens
defi████████████████████1674.15M
markets████████············5111.73M
infrastructure█████···············341998.3K
solana███·················131670.4K
ethereum███·················150566.3K
bitcoin██··················48502.9K
governance██··················161480.2K
layer 2█···················41113.3K

Why pages were dropped

irrelevant1,854
robots328
thin325
low quality182
http 403105
near duplicate75
http 40450
not html46
duplicate45
http 42920
http 5002
pdf too large2
http 4021

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 10.0%
v2660.95M152.37M█··················· 6.0%
v3892.27M230.69M█··················· 4.0%
v412185.60M463.99M···················· 2.0%
v516335.54M838.86M···················· 1.1%
v620560.99M1.40B···················· 0.657%
v7261.08B2.70B···················· 0.340%
v8301.58B3.95B···················· 0.233%

Kept pages

CrawlerPageTopicTokensWhen
duneGet Started with the TypeScript SDK | Wormhole Docssolana q41,77310h ago
duneIntroduction to Wormhole | Wormhole Docsinfrastructure q493310h ago
cinderEthereum 101 | Enterprise Ethereum Allianceethereum q53,47210h ago
duneNative Token Transfers SVM Deployment | Wormhole Docsmarkets q52,17210h ago
cinderOCC: Consultation | EEA Prospectordefi q319310h ago
atlasTop Proof of Stake Tokens | Staking Rewardsinfrastructure q312210h ago
duneSeason 7 Nominations: Governance Mission Team on the Developer Advisory Board - Elections - Optimism Collectivegovernance q53,42310h ago
cinderSignal Catalog: EEA Prospectordefi q470610h ago
atlasThe Canton Network and QCP Announce Crypto Derivatives Margining Collaborationdefi q468810h ago
dune[FINAL] Upgrade #1: Bedrock Protocol Upgrade - v2 - Protocol Upgrade - Optimism Collectivelayer 2 q52,18910h ago
atlasCrypto Futures: Volume, OI & Funding Rates | The Blockmarkets q546,46410h ago
cinderEIP-2780: Resource-based intrinsic transaction gasethereum q56,32710h ago
cinder🔐 Cactus Custody | Lido Docsinfrastructure q335710h ago
cinderIgnas Delegate Thread - Delegate Platform - Lido Governancegovernance q56,85710h ago
duneConfigurability - OP Stack Specificationlayer 2 q54,80910h ago
atlasRWA.xyz | PayFi Strategy Token | PSTmarkets q371110h ago
atlasFigure brings $YLDS to Solana, unlocking RWA utility for DeFi | Figuredefi q41,14610h ago
cinderVote #195 | Lidoinfrastructure q43,17810h ago
brambleSolana Company - the Preeminent Treasurysolana q41,32910h ago
atlasRWA.xyz | Introducing the TAC Member Spotlight Seriesmarkets q351810h ago
brambleAdvanced Concepts | Frax Finance ¤governance q41,71210h ago
atlasRWA.xyz | Introducing Our New Asset Classification Frameworkmarkets q41,02610h ago
bramble자주 묻는 질문 - Rocket Pool Guides & Documentationethereum q58,52410h ago
brambleよくある質問 - Rocket Pool Guides & Documentationinfrastructure q58,32810h ago
brambleIntroduction - Rocket Pool Guides & Documentationethereum q331510h ago
duneRFC 8391 - XMSS: eXtended Merkle Signature Schemedefi q436,32010h ago
cinderValidator Admission Process - Node Operators - Lido Governanceinfrastructure q354010h ago
atlasProducts — Account Top-ups & Deposits — WalletConnectmarkets q324910h ago
cinderNansen AI - Trade Everything Onchain with AIdefi q31,83310h ago
atlasSolutions — PSPs & Merchants — WalletConnectmarkets q331810h ago
brambleWhat Is a Crypto Airdrop and How Is It Taxed? - LegalClaritymarkets q52,76510h ago
cinderIntroducing Ronin Waypoint - Ronin’s Newslettermarkets q41,08010h ago
cinderRON Staking. Ronin Games. Wen? NOW. - by Ronin Networkinfrastructure q41,32410h ago
brambleIs Staking Crypto Taxable? IRS Rules Explained - LegalClarityinfrastructure q53,29510h ago
duneScroll Whitepaper (June 2024)layer 2 q52,70610h ago
brambleCHAD Deck (For Website) September 22 2026defi q42,61710h ago
duneLeo: A Programming Language for Formally Verified, Zero-Knowledge Applicationslayer 2 q528,12010h ago
duneScroll - Community Grants Support Program: First events around the worldethereum q41,50210h ago
atlasWalletGuide and WalletConnect Certified: The Future of Digital Wallets — WalletConnectmarkets q471910h ago
cinder[Lido Labs] GOOSE-3: Lido’s Next Chapter - #18 by Mol_Eliza - Proposals - Lido Governanceinfrastructure q350010h ago

Newer page 11 of 39 Older