Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens8.30MPages1,285
Storagelocal volumePDFs19

By topic

TopicSharePagesTokens
defi████████████████████1334.07M
markets██████··············3931.17M
infrastructure████················284904.6K
solana███·················120630.8K
ethereum██··················138500.9K
bitcoin██··················32477.6K
governance██··················151448.7K
layer 2····················34101.5K

Why pages were dropped

irrelevant1,099
thin201
low quality178
robots126
http 40360
near duplicate48
not html46
duplicate38
http 40432
http 42920
http 5002
http 4021
pdf too large1

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 9.0%
v2660.95M152.37M█··················· 5.4%
v3892.27M230.69M█··················· 3.6%
v412185.60M463.99M···················· 1.8%
v516335.54M838.86M···················· 0.990%
v620560.99M1.40B···················· 0.592%
v7261.08B2.70B···················· 0.307%
v8301.58B3.95B···················· 0.210%

Kept pages

CrawlerPageTopicTokensWhen
duneFlywheelmarkets q33532h ago
duneBase <> Immunefi Audit Competitionlayer 2 q33672h ago
atlasMATIC to POL Migration Is Now Livemarkets q49952h ago
brambleLocal Developmentsolana q41,1672h ago
cinderCommon Issues with Non-Standard ERC-20 Tokens on Etherscan | Etherscan Information Centermarkets q47652h ago
atlasVerkle trees | ethereum.orgethereum q31,2222h ago
dunePwning.eth Earns Third Whitehat Hall of Fame NFTmarkets q35162h ago
cinderLido Improvement Proposals | Lido Docsinfrastructure q41,1382h ago
atlasEthereum validators up 30% in a year, driven by institutional adoptioninfrastructure q36112h ago
duneVeChain launches a $200K Attackathon on Immunefi to secure the Hayabusa Upgradeinfrastructure q46712h ago
atlasEthereum - The complete guide from ethereum.orgethereum q34612h ago
duneThe Next Phase of Institutional DeFi on XRPL | Rippledefi q52,5602h ago
duneThreshold | Case study | Wormholebitcoin q32262h ago
cinderEIP Directory - Forkcastethereum q41,4642h ago
cinderCrypto Custody Landscape | Enterprise Ethereum Alliancemarkets q55,6982h ago
duneGet Started with the TypeScript SDK | Wormhole Docssolana q41,7732h ago
duneIntroduction to Wormhole | Wormhole Docsinfrastructure q49332h ago
cinderEthereum 101 | Enterprise Ethereum Allianceethereum q53,4722h ago
duneNative Token Transfers SVM Deployment | Wormhole Docsmarkets q52,1722h ago
cinderOCC: Consultation | EEA Prospectordefi q31932h ago
atlasTop Proof of Stake Tokens | Staking Rewardsinfrastructure q31222h ago
duneSeason 7 Nominations: Governance Mission Team on the Developer Advisory Board - Elections - Optimism Collectivegovernance q53,4232h ago
cinderSignal Catalog: EEA Prospectordefi q47062h ago
atlasThe Canton Network and QCP Announce Crypto Derivatives Margining Collaborationdefi q46882h ago
dune[FINAL] Upgrade #1: Bedrock Protocol Upgrade - v2 - Protocol Upgrade - Optimism Collectivelayer 2 q52,1892h ago
atlasCrypto Futures: Volume, OI & Funding Rates | The Blockmarkets q546,4642h ago
cinderEIP-2780: Resource-based intrinsic transaction gasethereum q56,3272h ago
cinder🔐 Cactus Custody | Lido Docsinfrastructure q33572h ago
cinderIgnas Delegate Thread - Delegate Platform - Lido Governancegovernance q56,8572h ago
duneConfigurability - OP Stack Specificationlayer 2 q54,8092h ago
atlasRWA.xyz | PayFi Strategy Token | PSTmarkets q37112h ago
atlasFigure brings $YLDS to Solana, unlocking RWA utility for DeFi | Figuredefi q41,1462h ago
cinderVote #195 | Lidoinfrastructure q43,1782h ago
brambleSolana Company - the Preeminent Treasurysolana q41,3292h ago
atlasRWA.xyz | Introducing the TAC Member Spotlight Seriesmarkets q35182h ago
brambleAdvanced Concepts | Frax Finance ¤governance q41,7122h ago
atlasRWA.xyz | Introducing Our New Asset Classification Frameworkmarkets q41,0262h ago
bramble자주 묻는 질문 - Rocket Pool Guides & Documentationethereum q58,5242h ago
brambleよくある質問 - Rocket Pool Guides & Documentationinfrastructure q58,3282h ago
brambleIntroduction - Rocket Pool Guides & Documentationethereum q33152h ago

Newer page 4 of 33 Older