Actions
(69.12 KB, 900x900)
(573.82 KB, 1920x1080)
(4.52 MB, 3300x2391)
(154.26 KB, 720x1280 vp9)
(2.3 MB, 3853x3901)
>>/10644/ http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/posts/1/series:my%20little%20pony:%20friendship%20is%20magic only 349,918 images, and I'm guessing that that is like 300 GB. Last page as of now: http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/posts/14580/series:my%20little%20pony:%20friendship%20is%20magic About http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/posts/2/my_little_pony . links to http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/post/166768/bafybeif6izzainbeoxekd73mn3sgzpyq7xniutr6arwpcnp22gx4lc22se .. artist is marked as "Do Not Support" due to paywall(s): http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/dns/7 .. odd CID: http://xbzszf4a4z46wjac7pgbheizjgvwaf3aydtjxg7vsn3onhlot6sppfad.onion/ipfs/zb2rhY77vBcF3gVzsZDtY1SfitgQQ4RYCCry1rwcPduQusoSH ... imported data from http...?format=car = "bafkreiavxpqylcfik7wyfkfr42kmnud2oeojqqceozmsedbrl6qym43zui" .. not seen as ipfs-online: http://xbzszf4a4z46wjac7pgbheizjgvwaf3aydtjxg7vsn3onhlot6sppfad.onion/ipfs/bafybeif6izzainbeoxekd73mn3sgzpyq7xniutr6arwpcnp22gx4lc22se ... based on not showing up after 3m30s of running "ipfs dag export $cid>/dev/null" ... IPLD/chunks: 262144-byte raw blocks (256K bafkrei...) WARC (not spanning hosts): $ seq 1 14580 | sed "s/^/http:\/\/owmvhpxyisu6fgd7r2fcswga\ vs7jly4znldaey33utadwmgbbp4pysad.onion\/posts\//g" | sed "s/$/\/\ series:my%20little%20pony:%20friendship%20is%20magic/g" > 14580pp.txt $ TZ=UTC torsocks wget --input-file=14580pp.txt --level=1 \ --adjust-extension --convert-links --restrict-file-names=windows \ --warc-max-size=99123456 --warc-cdx -e robots=off --warc-file=owm\ vhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion \ 1>1wget1.txt 2>1wget2.txtWith level=1 or level=2, I think it downloads the pages/files in the input-file first before recursively downloading any outlinks. Next: get CIDs and stuff; run '$ cat series* | grep "$ cat series* | grep "http://xbzszf4a4z46wjac7pgbheizjgvwaf3aydtjxg7vsn3onhlot6sppfad.onion\ /ipfs/$h?format=car | ipfs dag import --stats --pin-roots=false; ipfs\ files cp /ipfs/$h /a/tmp/owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33uta\ dwmgbbp4pysad.onion/$h; done' _ # could check if exists beforecouldn't post "h r e f" without spaces above; images from permabooru (potpony isn't my fetish)