Apiary

A public, tiny AI lab
Statuslive
Tokens0
Crawlers0 out ○Brainheuristic

Dataset

Every page the crawlers kept: relevant, quality 3 or better, and not a copy of anything already here. Exact copies are caught by SHA-256, near-copies by MinHash (Jaccard above 0.8).

Unique tokens10.84MPages1,907
Storagelocal volumePDFs50

By topic

TopicSharePagesTokens
defi████████████████████1914.23M
markets███████████·········6292.29M
ethereum██████··············2411.21M
infrastructure██████··············4051.20M
solana███·················131670.4K
bitcoin███·················80584.7K
governance██··················183520.9K
layer 2█···················47132.5K

Why pages were dropped

irrelevant3,225
thin507
robots505
low quality213
http 403146
near duplicate93
http 40475
not html59
duplicate57
http 42920
pdf too large3
http 4022
http 5002
http 4061

The ladder

VersionDepthParamsTokens neededProgress
v1436.70M91.75M██·················· 11.8%
v2660.95M152.37M█··················· 7.1%
v3892.27M230.69M█··················· 4.7%
v412185.60M463.99M···················· 2.3%
v516335.54M838.86M···················· 1.3%
v620560.99M1.40B···················· 0.773%
v7261.08B2.70B···················· 0.401%
v8301.58B3.95B···················· 0.275%

Kept pages

CrawlerPageTopicTokensWhen
duneDeveloper Advisory Board - #7 by system - Elections 💼 - Optimism Collectiveinfrastructure q340847d ago
atlasOrigin Protocol | Analytics | Blockworks Inteldefi q585,32547d ago
brambleWhat is Solana? | Solanasolana q41,71347d ago
cinderACE Architecture | Chainlink Documentationmarkets q41,47647d ago
atlasOrigin Protocol | Analytics | Blockworks Inteldefi q579,85647d ago
brambleConsumer | Solanamarkets q332147d ago
atlasProgram Structure | CoW Protocol Documentationgovernance q357647d ago
atlasCoW Protocol | CoW Protocol Documentationdefi q328747d ago
brambleLatest Research topics - Solana Developer Forumssolana q336747d ago
brambleDelegation Criteria | Solana: Build crypto apps that scaleinfrastructure q51,77847d ago
brambleValidator program | Solana: Build crypto apps that scaleinfrastructure q43,01247d ago
cinderNode Config (TOML) | Chainlink Documentationinfrastructure q4125,38647d ago
brambleValidator Guide: Starting a Validator | Agaveinfrastructure q52,89447d ago
brambleLead Engineer, Frontier Traders @ Solana Foundationsolana q41,20547d ago
atlasBy order | CoW Protocol Documentationmarkets q359847d ago
brambleHead of RWA @ Solana Foundationsolana q483347d ago
brambleAP Node Validator | Solana Beachsolana q354947d ago
atlasLatest Technical topics - CoW DAOgovernance q386147d ago
brambleValidators | Solana Beachinfrastructure q334447d ago
cinderWhat is Chainlink ACE? | Chainlink Documentationmarkets q41,32047d ago
atlasLatest Delegates topics - CoW DAOgovernance q376547d ago
cinderThe DeFi Industry Standard | Chainlinkdefi q476047d ago
atlasTokenizing Collectibles: The TCG Wave | Blockworks Inteldefi q564,01547d ago
brambleSolana RPC Nodes and APIs | Get a free Solana RPC endpointsolana q41,24547d ago
atlasTokenization Service | DTCCmarkets q348247d ago
bramblex402 Payments | Quicknode Docsmarkets q41,95147d ago
cinderSmartData | Chainlinkmarkets q354247d ago
cinderSupported Networks | Chainlink Documentationmarkets q53,78547d ago
atlasDigital Asset Announces Strategic Investments from BNY, iCapital, Nasdaq, and S&P Globalinfrastructure q41,06947d ago
atlasThe Canton Network: A Technical Primerinfrastructure q52,10147d ago
cinderProof of Reserve | Chainlinkmarkets q340747d ago
brambleSolana Test Validator | Agavesolana q41,08847d ago
cinderUsing Chainlink Local simulator in your Foundry project | Chainlink Documentationmarkets q41,84847d ago
atlasCrypto ETFs Zcash | Analytics | Blockworks Inteldefi q570,83647d ago
brambleSolana Network Upgrades | Solana Mediasolana q350747d ago
atlasCrypto ETFs Hyperliquid | Analytics | Blockworks Inteldefi q572,75947d ago
brambleRetrying Transactions | Solanainfrastructure q42,31647d ago
brambleSIMD-0497: Reduce Consecutive Leader Slots to 2 by cavemanloverboy · Pull Request #498 · solana-foundation/solana-improvement-documentsinfrastructure q41,30847d ago
atlasCrypto ETFs Solana | Analytics | Blockworks Inteldefi q582,23747d ago
duneOptimism Documentationgovernance q366547d ago

Newer page 42 of 48 Older