Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
duneSeason 6: Guide to Season 6 - Metagovernance - Optimism Collectivegovernance q51,8641d ago
cinderdefi-risk-rating/defi/ratings/Lido-stETH.md at master · The-TIE/defi-risk-rating · GitHubinfrastructure q512,3741d ago
atlasBuild — Digital Asset’s platform documentationinfrastructure q53,4251d ago
brambleGuides for Traders - Helius Docssolana q34731d ago
duneUpdates to the Standard Rollup Charter - Technical Proposals - Optimism Collectivegovernance q41,1301d ago
atlasOverview — Digital Asset’s platform documentationdefi q32851d ago
cinderRequest a Report | Staking Rewardsinfrastructure q3801d ago
duneoptimism/packages/contracts-bedrock/scripts/deploy/DeployOPChain.s.sol at 1bbf0a51e489a7c4413e266a3ee47fa0081ee517 · ethereum-optimism/optimism · GitHubethereum q522,1401d ago
cinderCommittees | Lido Docsgovernance q520,5241d ago
atlasUSDCx on Canton now available via Circle xReserve | Circlemarkets q36761d ago
cinderDynamic Buyback Program for LDO - Proposals - Lido Governancegovernance q54,7891d ago
brambleBackward Compatibility Policy | Agavesolana q41,0441d ago
brambleDevelopers: Resources and Information for Building on Solana | Solanasolana q32281d ago
dunesuperchain-registry/docs/ops.md at main · ethereum-optimism/superchain-registry · GitHublayer 2 q42,9651d ago
cinder[Hasu's GOOSE-2 Submission] A Product Line Approach to Grow Lido’s Staking Ecosystem - General - Lido Governanceinfrastructure q52,5171d ago
brambleTerminology | Solanamarkets q54,2351d ago
brambleStaking on Solana | Solanainfrastructure q47091d ago
brambleHome | Agaveinfrastructure q33681d ago
atlasCanton Coin: Flipping the Script on Tokenomicsmarkets q49471d ago
duneScroll - A Letter from Scroll: Mainnet is Here!ethereum q41,2381d ago
brambleSolanasolana q34401d ago
duneTo Ethereum, With Love: Announcing Polygon zkEVM Mainnet Beta on March 27thethereum q49871d ago
bramblePhantom Connect SDKs - Phantom developer documentationmarkets q49061d ago
duneUSDX | Nexus Docsdefi q32701d ago
cinder[REF] Introducing the Lido Contributors Group, including Pool Maintenance Labs and Argo Technology Consulting - General - Lido Governancegovernance q52,4791d ago
atlasBitcoin (BTC) - Institutional staking solutionsbitcoin q34701d ago
brambleHelium Wallet App | Helium Documentationmarkets q41,2651d ago
duneUma Roy - Succinctlayer 2 q41,4971d ago
atlasChainOps-as-a-Service by Stakin | Stakinlayer 2 q33381d ago
brambleShield Crypto Hardware Wallet - EAL6+ | Solflaremarkets q36051d ago
duneData Changelog - Dune Docsmarkets q56,5761d ago
brambleJupiter Wallet: The Best Solana Wallet to Trade, Earn & Managemarkets q35311d ago
atlasIntroducing Stacks: Bringing Smart Contracts and DeFi to Bitcoinbitcoin q51,6971d ago
cinderFAQ: Ethereum issuance reduction - Economics - Ethereum Researchinfrastructure q517,1631d ago
atlasEthereum (ETH) Staking — Live 2.54% APY | Staking Rewardsinfrastructure q32861d ago
brambleReduced Rent | Solana Mediasolana q41,6641d ago
brambleTower BFT | Agaveinfrastructure q42,3581d ago
duneIntroduction | Succinct Docsinfrastructure q35251d ago
cinderLiquid Buybacks: NEST execution with LDO/wstETH liquidity - Proposals - Lido Governanceethereum q55,2371d ago
duneWhat is Succinct? | Succinct Docslayer 2 q41,0521d ago

Newer page 34 of 48 Older