Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens8.23MPages1,280
Storagelocal volumePDFs17

By topic

TopicSharePagesTokens
defi████████████████████1334.07M
markets██████··············3931.17M
infrastructure████················280835.4K
solana███·················120630.8K
ethereum██··················138500.9K
bitcoin██··················32477.6K
governance██··················150444.2K
layer 2····················34101.5K

Why pages were dropped

irrelevant1,079
thin201
low quality178
robots117
http 40360
near duplicate48
not html46
duplicate38
http 40429
http 42920
http 5002
http 4021
pdf too large1

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 9.0%
v2660.95M152.37M█··················· 5.4%
v3892.27M230.69M█··················· 3.6%
v412185.60M463.99M···················· 1.8%
v516335.54M838.86M···················· 0.981%
v620560.99M1.40B···················· 0.587%
v7261.08B2.70B···················· 0.304%
v8301.58B3.95B···················· 0.208%

Kept pages

CrawlerPageTopicTokensWhen
atlasFoundations - HubSpot docsmarkets q42,04117m ago
cinderNEST - Network Economic Support Tokenomics - #8 by katamarinaki - Proposals - Lido Governancemarkets q328319m ago
cinderLido Ecosystem Grants Organization (LEGO) Reports - #2 by Alex_L - General - Lido Governancegovernance q347819m ago
cinderLEGO Proposal - Members & Open Initiatives [cont.] - Proposals - Lido Governancegovernance q351919m ago
cinderCurve Proposal: Continue LDO Reward Initiative With 3,750,000 LDO (0.375%) - Proposals - Lido Governancegovernance q330919m ago
cinderAnnouncement: Onboarding for (Ethereum Wave 4) - Node Operators - Lido Governancegovernance q52,34219m ago
cinderThe Road to Trustless Ethereum Stakinginfrastructure q53,26619m ago
cinderEthereum MEV Extraction and Rewards Part 2 - Revisiting Stance in Light of ePBS - Department of Decentralisation - Lido Governanceinfrastructure q54,04419m ago
cinderStart Here - Lido Governanceethereum q326121m ago
cinderProposal to fund the Protocol Guild Pilot via a Lido Grant - The LIP - Lido Improvement Proposal - Process - Lido Governanceethereum q488322m ago
atlasDisputing Via the Oracle Dapp | UMA Documentationgovernance q327722m ago
brambleFuse Card: Spend Stablecoins Anywhere - Fuseinfrastructure q361222m ago
brambleIntroducing Virtual US Bank Accounts - Fusemarkets q343122m ago
brambleFuse Quickstart Guide - Fusemarkets q481522m ago
duneAddressing Voting Apathy in Optimism Governance - Delegate Updates - Optimism Collectivegovernance q53,59722m ago
cinderGitHub - ethereum/go-ethereum: Go implementation of the Ethereum protocol · GitHubethereum q52,42422m ago
bramblesolana-improvement-documents/proposals/0286-raise-block-limits-to-100M.md at main · solana-foundation/solana-improvement-documents · GitHubgovernance q363322m ago
duneGovernance Update #10 - Governance Updates - Optimism Collectivegovernance q41,11322m ago
cinderIrina Delegate Thread - #20 by irinat - Delegate Platform - Lido Governancegovernance q41,24422m ago
atlasSecured Finance to Provide Lending Protocol for Mitsubishi UFJ Trust and Banking’s Proof-of-Concept for Onchain Japanese Government Bond (JGB) Repo Transactionsmarkets q52,33422m ago
cinderCommunity Staking Module - Proposals - Lido Governanceinfrastructure q54,09022m ago
bramblesolana-web3.js/docs/web3js-v1-to-v3-migration.md at 648516f3116226f48b4d5fa52ae945817faccaab · solana-foundation/solana-web3.js · GitHubmarkets q52,19922m ago
duneGovernance Update #9 - Governance Updates - Optimism Collectivegovernance q488622m ago
atlasIntegrating with the Canton Network — Digital Asset’s platform documentationmarkets q479122m ago
cinderNEC-2: Recognition of stETH and wstETH Bridge Endpoints on Soneium as Canonical - Lido Multichain - Lido Governanceethereum q367222m ago
duneBOB Manifesto: Bringing Bitcoin’s Perspective to Optimism Governance - Delegate Updates - Optimism Collectivegovernance q338122m ago
cinder🔍 Node Operator Types | Lido Docsethereum q41,08422m ago
atlasOverview — Digital Asset’s platform documentationinfrastructure q42,18822m ago
dune[FINAL] Improving Governance Accessibility through Praise and Contribution Based Attestations - ARCHIVED & OLD Missions - Optimism Collectivegovernance q52,28522m ago
cinderFeatures & Services | Payment | Onchain OS Docsmarkets q366422m ago
atlasMulti-party applications — Digital Asset’s platform documentationinfrastructure q42,73022m ago
atlasTreasuries On-Chain: An industry case for changedefi q56,38822m ago
cinderLedger Wallet Provider - Ledger Developer Portalmarkets q330922m ago
cinderEtherscan CLI - Etherscanmarkets q332622m ago
duneCactus | Makoto Inoue ( matoken.eth )markets q373622m ago
cinderHow to Manage a Cryptocurrency Portfolio | Crypto Investmentmarkets q51,76122m ago
brambleTransaction Structure | Solanamarkets q41,86223m ago
duneGovernance Weekly Recap - Page 2 - Governance Updates - Optimism Collectivegovernance q56,72323m ago
cinderCrypto Market Caps | What Are They and Why Do They Matter?markets q51,83723m ago
duneMay 2023 - Governance Call OP Rewards Analytics Update - Accountability 🗂️ - Optimism Collectivegovernance q53,39223m ago

page 1 of 32 Older