>>/9847/
> https://thereisnosanity.com/mlp.json -- 141 posts
> https://thereisnosanity.com/pone.json -- ~31,000 posts
Both files have all of the text on one line. I'm not complaining, but think it would be better if each thread JSON was on a different line. Or, this could be done:
. endchan-pone-thread-${number}.$(date +%s).json
.. each thread .json captured weekly or something
.. "date +%s" = Unix time
. etc.
But where to get all of the thread numbers? I guess the catalog has all of them.
>>/9892/
Also moved to cold storage:
. torrent? magnet:?xt=urn:btih:9b730c5d7c54bc0bb5f79f9a7b3180c0b8b7f6aa&dn=4chan_gif_2022_11.tar
. where? zb, offline /ipfs/QmZZB5jLgnRp4PwLYWoX7FTn82JGoWjZ195gwZbB7nbVZh HDD took <1 hour; 2024-03-20T01:53:07.347052650Z -> 2024-03-20T02:30:53.912151646Z
. (IPLD? QmZZ...bVZh contains...)
>>/9893/
> took about 9 hours
> Roughly, a 55% increase
Unscientific because 10s of thousands of other tiny files were rsyncing at that time, so that other unrelated 5 or more GB likely throws off the calculation.