thumbnail of bafkreieqxqfa6bz3mucgnh6yfyr3pd4szwvxh6fmfjspmsojwc5sk3q3ui
thumbnail of bafkreieqxqfa6bz3mucgnh6yfyr3pd4szwvxh6fmfjspmsojwc5sk3q3ui
bafkreieqxqfa6bz3mucg...
(614.58 KB, 427x399)
"Heinessen, the 4chan archiver" was the first website to automatically download 4chan /mlp/ images somewhat consistently for months. Copied:
. torrent? related to 221.89-GiB torrent magnet:?xt=urn:btih:79760b305316b095d30e7bdfa49b97d49f236618&dn=heinessen-mlp-images.tar -> an extracted version with extra data
. where? zb, offline, in MFS but not pinned /ipfs/QmcX2DkjkkXmCRBhGn6swbHrQKoY1WT1oXqSRVRYGTqYeY 24 hours due to problems and it contains 635,770 files total
. note? See below.

Extra data:
. "heinessen-mlp-images_hashes_via.txt" = "readme file"
. "heinessen-mlp-images_hashes.txt.zst" = precomputed data from months ago (which took days to compute); this contains stuff such as MD5 hashes which are relevant to Desuarchive /mlp/. I recently used it to see the file count: '$ zstd -cd /z0/data/1735f69/heinessen-mlp-images_hashes.txt.zst | head -n5499000 | grep "File: " | vim -'

As seen here - https://archive.ph/2014.10.15-042952/http://archive.heinessen.com/mlp/thread/17431556 - heinessen.com image links looked like this: http://archive.heinessen.com/boards/mlp/img/0174/31/1398400892326.png

238 GB here - https://gateway.pinata.cloud/ipfs/QmcX2DkjkkXmCRBhGn6swbHrQKoY1WT1oXqSRVRYGTqYeY - which contains more folders. Folders min+max (regarding the main 81 folders in "image/"):
. 1365/ QmNQ...csZk 310 MB
. 1401/ QmWh...SB8s 11 GB

I put less than 1% of QmcX...qYeY online - this 777-MB folder in there (1342/ QmZ9...3jZp):
https://cloudflare-ipfs.com/ipfs/QmbMVxkqhn5BJ5W8FVUA3eqDDQ8gumRAMgpEaD2Yhj7oQF

Which folder most likely matches to the extracted version of that /mlp/ full images tarball? QmeQ...JKUh:
> $ ipfs ls QmVVnfdiiTP5EoZvzJtBQjJPopwVszRwouKj49kU7SdaMK
> QmdDyrzbS2hv58gLViiJx4N3gm3wZApjEsCSHbn2JbMyai - archive.heinessen.com/
> QmQ6dXpo6MDD4FhcBgiV7XcBxCcWecer6KmbZhsYZ6WCjk 330789466 heinessen-mlp-images_hashes.txt.zst
> bafkreighdoq4cqjf3vt6qtbp54wx7pnznmrbeqfge37wmmazg4xfsip3hi 33995 heinessen-mlp-images_hashes_via.txt
> $ ipfs ls QmdDyrzbS2hv58gLViiJx4N3gm3wZApjEsCSHbn2JbMyai
> QmeQtFP9icmbqJ5RX7gj5vn6W2pz444YwhuSVy8P11JKUh - mlp/
> $ ipfs ls QmeQtFP9icmbqJ5RX7gj5vn6W2pz444YwhuSVy8P11JKUh
> QmX8TZXmP4z4F35w4wjwmiJvp2VRdLpvpAtzwfx6xvxAgW - image/
> $ # picrel from https://ipfs.io/ipfs/QmcX2DkjkkXmCRBhGn6swbHrQKoY1WT1oXqSRVRYGTqYeY/http-archive.heinessen.com-boards-mlp-img/archive.heinessen.com/mlp/image/1342/00/1342006351669.gif
238142756028 B (238 GB) = 221.8 GiB, so I think it contains everything from that .tar file. (It's 221.5 GiB not counting the ZST file.)