Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
duneSeason 6: Guide to Season 6 - Metagovernance - Optimism Collectivegovernance q51,86447d ago
cinderdefi-risk-rating/defi/ratings/Lido-stETH.md at master · The-TIE/defi-risk-rating · GitHubinfrastructure q512,37447d ago
atlasBuild — Digital Asset’s platform documentationinfrastructure q53,42547d ago
brambleGuides for Traders - Helius Docssolana q347347d ago
duneUpdates to the Standard Rollup Charter - Technical Proposals - Optimism Collectivegovernance q41,13047d ago
atlasOverview — Digital Asset’s platform documentationdefi q328547d ago
cinderRequest a Report | Staking Rewardsinfrastructure q38047d ago
duneoptimism/packages/contracts-bedrock/scripts/deploy/DeployOPChain.s.sol at 1bbf0a51e489a7c4413e266a3ee47fa0081ee517 · ethereum-optimism/optimism · GitHubethereum q522,14047d ago
cinderCommittees | Lido Docsgovernance q520,52447d ago
atlasUSDCx on Canton now available via Circle xReserve | Circlemarkets q367647d ago
cinderDynamic Buyback Program for LDO - Proposals - Lido Governancegovernance q54,78947d ago
brambleBackward Compatibility Policy | Agavesolana q41,04447d ago
brambleDevelopers: Resources and Information for Building on Solana | Solanasolana q322847d ago
dunesuperchain-registry/docs/ops.md at main · ethereum-optimism/superchain-registry · GitHublayer 2 q42,96547d ago
cinder[Hasu's GOOSE-2 Submission] A Product Line Approach to Grow Lido’s Staking Ecosystem - General - Lido Governanceinfrastructure q52,51747d ago
brambleTerminology | Solanamarkets q54,23547d ago
brambleStaking on Solana | Solanainfrastructure q470947d ago
brambleHome | Agaveinfrastructure q336847d ago
atlasCanton Coin: Flipping the Script on Tokenomicsmarkets q494747d ago
duneScroll - A Letter from Scroll: Mainnet is Here!ethereum q41,23847d ago
brambleSolanasolana q344047d ago
duneTo Ethereum, With Love: Announcing Polygon zkEVM Mainnet Beta on March 27thethereum q498747d ago
bramblePhantom Connect SDKs - Phantom developer documentationmarkets q490647d ago
duneUSDX | Nexus Docsdefi q327047d ago
cinder[REF] Introducing the Lido Contributors Group, including Pool Maintenance Labs and Argo Technology Consulting - General - Lido Governancegovernance q52,47947d ago
atlasBitcoin (BTC) - Institutional staking solutionsbitcoin q347047d ago
brambleHelium Wallet App | Helium Documentationmarkets q41,26547d ago
duneUma Roy - Succinctlayer 2 q41,49747d ago
atlasChainOps-as-a-Service by Stakin | Stakinlayer 2 q333847d ago
brambleShield Crypto Hardware Wallet - EAL6+ | Solflaremarkets q360547d ago
duneData Changelog - Dune Docsmarkets q56,57647d ago
brambleJupiter Wallet: The Best Solana Wallet to Trade, Earn & Managemarkets q353147d ago
atlasIntroducing Stacks: Bringing Smart Contracts and DeFi to Bitcoinbitcoin q51,69747d ago
cinderFAQ: Ethereum issuance reduction - Economics - Ethereum Researchinfrastructure q517,16347d ago
atlasEthereum (ETH) Staking — Live 2.54% APY | Staking Rewardsinfrastructure q328647d ago
brambleReduced Rent | Solana Mediasolana q41,66447d ago
brambleTower BFT | Agaveinfrastructure q42,35847d ago
duneIntroduction | Succinct Docsinfrastructure q352547d ago
cinderLiquid Buybacks: NEST execution with LDO/wstETH liquidity - Proposals - Lido Governanceethereum q55,23747d ago
duneWhat is Succinct? | Succinct Docslayer 2 q41,05247d ago

Newer page 34 of 48 Older