Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
brambleFuse Quickstart Guide - Fusemarkets q481547d ago
duneAddressing Voting Apathy in Optimism Governance - Delegate Updates - Optimism Collectivegovernance q53,59747d ago
cinderGitHub - ethereum/go-ethereum: Go implementation of the Ethereum protocol · GitHubethereum q52,42447d ago
bramblesolana-improvement-documents/proposals/0286-raise-block-limits-to-100M.md at main · solana-foundation/solana-improvement-documents · GitHubgovernance q363347d ago
duneGovernance Update #10 - Governance Updates - Optimism Collectivegovernance q41,11347d ago
cinderIrina Delegate Thread - #20 by irinat - Delegate Platform - Lido Governancegovernance q41,24447d ago
atlasSecured Finance to Provide Lending Protocol for Mitsubishi UFJ Trust and Banking’s Proof-of-Concept for Onchain Japanese Government Bond (JGB) Repo Transactionsmarkets q52,33447d ago
cinderCommunity Staking Module - Proposals - Lido Governanceinfrastructure q54,09047d ago
bramblesolana-web3.js/docs/web3js-v1-to-v3-migration.md at 648516f3116226f48b4d5fa52ae945817faccaab · solana-foundation/solana-web3.js · GitHubmarkets q52,19947d ago
duneGovernance Update #9 - Governance Updates - Optimism Collectivegovernance q488647d ago
atlasIntegrating with the Canton Network — Digital Asset’s platform documentationmarkets q479147d ago
cinderNEC-2: Recognition of stETH and wstETH Bridge Endpoints on Soneium as Canonical - Lido Multichain - Lido Governanceethereum q367247d ago
duneBOB Manifesto: Bringing Bitcoin’s Perspective to Optimism Governance - Delegate Updates - Optimism Collectivegovernance q338147d ago
cinder🔍 Node Operator Types | Lido Docsethereum q41,08447d ago
atlasOverview — Digital Asset’s platform documentationinfrastructure q42,18847d ago
dune[FINAL] Improving Governance Accessibility through Praise and Contribution Based Attestations - ARCHIVED & OLD Missions - Optimism Collectivegovernance q52,28547d ago
cinderFeatures & Services | Payment | Onchain OS Docsmarkets q366447d ago
atlasMulti-party applications — Digital Asset’s platform documentationinfrastructure q42,73047d ago
atlasTreasuries On-Chain: An industry case for changedefi q56,38847d ago
cinderLedger Wallet Provider - Ledger Developer Portalmarkets q330947d ago
cinderEtherscan CLI - Etherscanmarkets q332647d ago
duneCactus | Makoto Inoue ( matoken.eth )markets q373647d ago
cinderHow to Manage a Cryptocurrency Portfolio | Crypto Investmentmarkets q51,76147d ago
brambleTransaction Structure | Solanamarkets q41,86247d ago
duneGovernance Weekly Recap - Page 2 - Governance Updates - Optimism Collectivegovernance q56,72347d ago
cinderCrypto Market Caps | What Are They and Why Do They Matter?markets q51,83747d ago
duneMay 2023 - Governance Call OP Rewards Analytics Update - Accountability 🗂️ - Optimism Collectivegovernance q53,39247d ago
cinderA Beginner’s Guide to Crypto Wallets | eToromarkets q52,67047d ago
atlasTokenizing assets opens up vast new opportunities for banks | American Bankermarkets q41,20447d ago
duneGovernance Weekly Recap - Governance Updates - Optimism Collectivegovernance q510,03347d ago
cinderCrypto Coins vs Tokens | Understanding the Differencesmarkets q52,62347d ago
atlasDigital Asset Raises $135 Million to Accelerate Adoption of Canton Networkinfrastructure q41,27647d ago
cinderDemystifying Decentralized Finance (DeFi)defi q51,73647d ago
dune[DRAFT PROPOSAL]: Protocol Delegation Program - #14 by Jonas - Reflection Period Proposal - Optimism Collectivegovernance q311647d ago
cinderLearn How Blockchain Technology Worksinfrastructure q41,46547d ago
cinderWhat Is Cryptocurrency? A Beginner's Guidemarkets q41,61547d ago
duneSeason 7 Nominations: Governance Mission Team on the Developer Advisory Board - #2 by wbnns - Elections - Optimism Collectivegovernance q336547d ago
cinderCrypto Coins vs Tokens | Understanding the Differencesmarkets q51,72247d ago
cinderInvesting in Ethereum | How to Buy ETHethereum q41,68547d ago
cinderA guide to Ethereum 2.0, the new Ethereum networkethereum q52,72747d ago

Newer page 17 of 48 Older