a random pone banner

/pone/ - World of Equestria

A board for discussing all things animated horse.


New Reply on thread #10357
X
Max 20 files0 B total
[New Reply]

[Index] [Catalog] [Banners] [Logs]
Posting mode: Reply [Return]


thumbnail of golden_oaks_library_by_minibot_1_d5d2xlb-fullview.jpg
thumbnail of golden_oaks_library_by_minibot_1_d5d2xlb-fullview.jpg
golden_oaks_library_b... jpg
(180.82 KB, 1600x1200)
thumbnail of SometimesWhenArchivingYouNeedToRest.png
thumbnail of SometimesWhenArchivingYouNeedToRest.png
SometimesWhenArchivin... png
(349.75 KB, 800x427)
Welcome to Golden Oaks! Sit back and get /comfy/ and dive into the vast amounts of data across the web that has been generated by the MLP fandom.

What is Golden Oaks?
Golden Oaks is /endpone/'s archival and analysis thread devoted to the rather broad topic of the fandom itself. Active archival is a major feature, but a variety of topics are also active points of discussion. From analysis of trends and situations, to self reflection and representation (Some /tech/ discussion related to that end is welcome as well!).

What is Golden Oaks not?
Golden Oaks is not for the simple dissuasion of the latest scandal within the fandom or gossip about X. These subjects maybe relevant at times in the discussion of certain happenings and periods within the fandom, but the thread itself shouldn't dive into drama without reason.

What is this place?
This is the Endchan's pony board. While we are microscopic we have regular posting and a fairly distinct culture as can be with a handful of anons and drifters. /go/ welcomes outside contributions. Feel free to look around.
Current /NMAiE/:  >>/8915/

Announcement!
A new thread has been created: >>/10356/ /culture/ (...and More!) for better discussion of certain niche topics and deep dives when this thread is too cluttered or topics that maybe too tangential but still useful.


Earlier /go/ Threads:
 >>/9086/
 >>/3148/
thumbnail of PegasusAnchor.gif
thumbnail of PegasusAnchor.gif
PegasusAnchor gif
(5.55 MB, 359x360)
EMERGENCY! SHUTDOWN NOTICES, MASS DELETIONS AND OTHER ARCHIVAL SITUATIONS.

Special anchor post. Reserve for only impending shutdowns of websites or mass deletions (or at least when the there is a high potential for such).

Stuff like this: >>/8116/, >>/8983/, >>/9248/
thumbnail of CeberusAnchor.png
thumbnail of CeberusAnchor.png
CeberusAnchor png
(220.62 KB, 800x450)
General Updates

Updates on the various archiving related activities of the thread. Not every little update of course, but stuff that maybe more worthy or certain milestones. Completed scripts, important progress and what have you. Use your own discretion.

Posts more like this:> >>/8361/,  >>/9068/,   >>/9174/
thumbnail of Odds_and_Ends.gif
thumbnail of Odds_and_Ends.gif
Odds_and_Ends gif
(1.08 MB, 788x535)
Anypony can get started with something! Here is a simple (and incomplete for more in depth stuff) guide to for some suggestions on starting out.

Archiving:
Simply starting out:
Individualized archiving and keeping of records (especially interested in basic accounts and timelines of websites, see: >>/4085/). If you have any memories to share, that is nice as well! Even old screencaps and old accounts of what a place was like! {If thread seems too busy or it seems a bit off form main objectives, I again point to /culture/: >>/10356/)


For videos: Youtube (and other many other websites!) YT-DLP is the best thing available right now. 
https://github.com/yt-dlp/yt-dlp
Don't forget the comments! 
yt-dlp with --write-comments or this script here: https://github.com/egbertbouman/youtube-comment-downloader which That we had been using in the past rather intensively. NOTE: both not working for me as of writing this, uncertain if broken by a Youtube update or just something wrong on my end, don't have much time to test at the moment.



For full websites, the best option is grab-site from the Archive Team. It is a specialty tool that archives websites in the WARC file format:
https://github.com/ArchiveTeam/grab-site
Note that Windows support is experimental. 

Using Linux, you most likely have Wget already installed, it can do simple websites and single web pages easily enough, although more complicated sites will NOT work well. Can do WARCs, but a bit problematic(see:https://wiki.archiveteam.org/index.php/Wget_with_WARC_output) You can get a version of Wget with Powershell on Windows, but it is very different under the hood. By default, Windows does come with its own version of curl as well. I'm not sure how useful either of these are in archival context compared to their Linux counterparts at least potential usefulness in some situations. There is a version of GNU Wget for Windows but it appears to be very outdated.

httrack is a program that has seen some use around here in the past. It might have a use but it's web crawls are incompatible with WARCs: 
https://www.httrack.com/
It does have Windows support and I am still interested in investigating potential uses (weirdly, it sometimes was able to grab complex sites relatively well for me) but this is much lower tier option due to no-WARC support, it's own separate web-crawl format, and uncertainty of how active the developer is now.


Linux: You might want to have this installed for the tools mentioned above. No fear, you can do that in Windows now!
https://learn.microsoft.com/en-us/linux/install (need to look up some better Youtube tutorial or something.)
thumbnail of 3195882.gif
thumbnail of 3195882.gif
3195882 gif
(136.09 KB, 250x273)
 >>/10367/
More advanced:
This is very broad and something I don't feel like I can even attempt to cover with any sort of justice right now. A whole host of issues are faced with archival right now. There is significant issues on several fronts. All of the free data and generous terms of the 2000s and 2010s internet are dying. Plus a rise in censorship and desires to rein in the old civil libertarian spirit of the Internet (for good or ill, one cannot deny that a lot of things will be wrongly caught in the crossfire) Endangering too many things to count.  The central archives that underpin a lot of web history are also under potential risk for a variety of reasons. One bad lawsuit or the wrong person calling it quits (in the case of someplace like archive.today or The Pony Archive) might mean the loss of YEARS of archive work. I don't believe it is within the average person means to save everything everywhere but if a lot of people put a little effort a lot more could be saved then we expect if these places ever go down. Realistically, any long term advanced archiving should take these factors into account. 

Hardware: This really deserves it's own section. Simply downloading and storing fair bit is pretty easy now and can be done with Potato PCs and a few external hard drives. Full on data hoarding with a plan of keeping something available years or even decades requires a bit more careful planning.Plus plenty of inbetween! From an old Optiplex, cheap default configured NASes to full on enterprise grade servers. There is a lot of set ups that could work for a lot of different people. One thing to remember though: multiple backups! Not everyone can go full 3-2-1 method but unless your storing it short term it is good to have two copies of something at least. Also learn about bit rot!


Glossary:
For some of the terms you may see around here frequently (needs expansion but this is a start).
 
IPFS 
InterPlanetary File System: something that has been getting a lot of use around here lately. It is a distributed decentralized network and protocol. Think BiTTorrent without a central server (but more than that) would be a simple TL:DR. I like what Archivist said here on it: >>/10173/
> General idea, from one perspective. Are you interested in BitTorrent, but wish it was as elastic and expansive as the web? IPFS may be your solution! It takes good ideas from various things, such as HTTP and BitTorrent. Similar to the web, which has many various things, try not to rely on others to host IPFS data. In BitTorrent you can somewhat rely on other peers to host "important data" (read: some retarded TV show/movie/anime/video game/etc.) forever. Can't expect other peers to host your HTML or folder forever.

I could also invoke comparisons to ZeroNet and Freenet but I think those might be more obscure!

WARC
Web ARChive: a file format that is designed specifically for archiving websites. This isn't the same as downloading a single web page and is, to simply put it, much better at getting a site intact than most manual scraping.

ZFS 
Z File System: /g/, r/datahoarder, and many techbros best and only choice for the storage of anything ever. Using anything else is retarded by some people's definition. Very good for long term storage and protection against bit rot. Lots of other useful features! Depending on your use case, might not be necessary or ideal. 



Useful Links
https://wiki.archiveteam.org/ (The website of the archive team)
https://theponyarchive.com/ (The main and largest archive of the fandom right now)
https://desuarchive.org/ (Main archive of /mlp/ posts)
https://www.youtube.com/@DeletedPonyVideos/ (Randomly uploades deleted pony videos, sometimes useful, though it ain't the Library of Alexandria)
(Plenty more could and will be added here at some point). 

Note: I consider this guide to be incomplete and will hopefully have the chance to expand it in the future or even add a section or two. Certainly better guides for Windows users and more tools/archive links for othe
thumbnail of 551.png
thumbnail of 551.png
551 png
(596.19 KB, 1370x724)
Alright, this thread is now finally started! It only took like, what? 1 month late! That is the story of my life most of the time. Like most things, these can be a bit bumpy as I am often rushing to post while I have good Internet speed/access/uninterrupted time. All three of which sometimes come at a premium.

The guide is imperfect. Really, there is a lot of issues I could expand on. I focused on introductions to someone who is totally new to this and clarifications of a handful of things but I feel this could be better. Any suggestions here are welcomed of course.

Speaking of suggestions, /culture/. Anons were sometimes ambivalent on spiting the archiving section of the thread with the history and analysis sections. I understand both sides and have gone back and forth myself.  I am not going to ban cultural analysis and history here or archival on that thread as I feel the subjects are too intertwined. Right now, I consider /culture/ to not be a full split but a optional place where some topics can be moved too as needed. Will see where it goes from there.

Something I would like to highlight. YT's Comment Converter: >>/8361/ and  Feed-Analyzer programs: >>/8413/.I still haven't given up on these even if my life has been... complicated at times.Wherever you are, you still have may enteral salute.   As I said before, no pressure to restart on these yourself, though if you ever come by again, you're more than welcome on /endpone/!

Archivist, what can I say? You might have a chaotic posting style but you are saving TBs of data constantly. You also get pic related! Though, don't put pressure yourself, alright?

There are plenty of more anons who have contributed and lurked here. I thank you for your contributions and wish you all the best!
 >>/10357/
Previous thread:
. HTML:  >>/9086/
. JSON: https://endchan.org/pone/res/9086.json

To get the JSON/API version of a thread replace the "html" at the end of the URL with "json". JSON URL of a 4chan thread:
https://megalodon.jp/ref/2024-0507-0022-44/https://a.4cdn.org:443/wsr/thread/1458990.json

Showed up as binary data non-basic text jibberish in Megalodon for some reason. BTW, ウェブ魚拓 was updated to newer software or whatever in the start of 2024-05. Similar websites (rev.2024.05.10):
https://ja.wikipedia.org/wiki/ウェブアーカイブ#外部リンク

rsync information (has a duplicate "-S, --sparse" section):
https://ss64.com/bash/rsync_options.html
2019 video not in TPA - "13 Kitchen Hacks And Decor Ideas":
https://invidious.incogniweb.net/watch?v=deSdfZb1l5g&list=UUIJ44QRtVGm_gBh_deuL5ow&index=1600&listen=false
. Beheaded pony
. Unicorn milk

2018 video not in TPA - "16 My Little Pony Hacks And Crafts":
https://invidious.materialio.us/watch?v=hJPs9f0SDhI&list=UUIJ44QRtVGm_gBh_deuL5ow&index=1967
. Russian text, DIY "life hacks"
. There was maybe two or more other MLP-related videos by this channel, but I didn't bother

2023 video not in TPA - "Twilight Sparkle Inflation Spell Animation (Watch Carefully At The Description)":
https://invidious.reallyaweso.me/watch?v=9bczdRi7UGk&list=UUKj5UeZ-kt9T4ArZ7PqxEdg&index=10
. reupload of an original animation
. small channel

 >>/10358/
Booru.org is likely shutting down
https://desuarchive.org/mlp/thread/41078194#41092144
Sexy mare:
https://twibooru.org/369640?q=pasties%2C-anthro%2C-human

YouTube videos, accessibility - "Administrator has disabled this endpoint." (works without "&local=true" but with no proxy):
https://inv.tux.pizza/latest_version?id=ydYGVhLPTgo&itag=22&local=true

Working proxy (also "itag=18"):
https://invidious.lunar.icu/latest_version?id=ydYGVhLPTgo&itag=22&local=true

Doesn't get >720p with those numbers. "Even downloading at a low resolution such as 240p or 360p still is infinitely better than nothing (0p)." --https://wiki.archiveteam.org/index.php/YouTube
thumbnail of E3483890-C9CF-47C7-B022-55A2A0FCD379.jpeg
thumbnail of E3483890-C9CF-47C7-B022-55A2A0FCD379.jpeg
E3483890-C9CF-47C7-B0... jpeg
(27.1 KB, 299x299)
videos.json from WBM, pony-related channel now has at least one hidden video:
https://gateway.pinata.cloud/ipfs/bafkreidfyzdzx27esnexjtfiv5jom52u7n6yztrom6dnm3rg2lkubnobwq

Related to this channel which has some/all videos in TPA:
https://iv.ggtyler.dev/channel/UCzhBSigqirJ068ye_oN33ow

 >>/10359/
I see that you linked to "Comments Converter":
https://endchan.org/pone/preview/8361.html

Haven't learned a lot about that software, but I guess it does this: takes .info.json with YT comments -> outputs HTML where you can easily read the comments on the YouTube video.

 >>/10386/
> Sexy mare
Also Roseluck:
https://twibooru.org/3230646

pfp from npr video:
> https://web.archive.org/web/20240520154214/https://iv.ggtyler.dev/watch?v=MN-qXPyIDAs "Places to Avoid Getting Cut or Stabbed at All Cost"
thumbnail of 638EE7D5-5E08-4F15-B57B-0939FCA9B819.png
thumbnail of 638EE7D5-5E08-4F15-B57B-0939FCA9B819.png
638EE7D5-5E08-... png
(549.39 KB, 467x602)
In the previous thread I saw that gateway.ipfs.io is gone (redirects to ipfs.io). Not so bad, I found that site to be unimpressive. Worse: cf-ipfs.com seems to be gone now too (3-test). It redirects to ipfs.io or dweb.link: both of which performed significantly worse than CF gateways from what I've seen (TTFB). #FuckGoogle image from cyb.

 >>/10367/
> httrack might have a use
Use case: for some reason you can't use GNU/Linux and are like stuck with Windows 7. I have have tried various versions of wget for Windows and they were all horrible/unusable for writing .warc.gz
> but it's web crawls are incompatible with WARCs: https://www.httrack.com/
I was wondering about that in the past. Now I know.
 >>/10369/
> website archive.today
I recommend also using that site because Wayback Machine (WBM) sometimes deletes stuff. Multiple times, it seems that I got blocked from archive.ph. If I go there now in Brave, it shows a white page with the message "Welcome to nginx". However, if I go to that site in lynx browser, it works as expected.

 >>/10386/
Was saved here - video file showed up yesterday in WBM but not today:
https://web.archive.org/web/20240522100404/https://invidious.lunar.icu/latest_version?id=ydYGVhLPTgo&itag=22&local=true

HTTP 403:
https://invidious.perennialte.ch/latest_version?id=ydYGVhLPTgo&itag=22&local=true

Working proxy:
https://invidious.privacyredirect.com/latest_version?id=ydYGVhLPTgo&itag=22&local=true

 >>/10388/
> cf-ipfs.com redirects to ipfs.io or dweb.link: both of which performed significantly worse than CF gateways
I think I first noticed this in 2024-05-21 UTC. A 2024-05-20 12:41 UTC capture of cf-ipfs.com (no redirect to non- cf-ipfs.com):
https://cf-ipfs.com/ipfs/QmUamt7diQP54eRnmzqMZNEtXNTzbgkQvZuBsgM6qvbd57

That text file is basically this:
> # The Great Web
> The Great Web is a web that lasts. It is based on three simple ideas.
> ## Access
> Anyone who can store secret and compute digital signatures can use the Great Web. Humans, robots, animals, plants, and even mycelium can use it without discrimination and limits.
> ## Immutability
> Particles in the Great Web can survive through spacetime thanks to frozen content addressing. So the Great Web can last indefinitely.
> ## Universality
> The Great Web is built by connecting particles through cyberlinks. The result is universally acceptable language, dynamic but understandable and acceptable by anyone.
My little pony spotted at the beginning of this episode of a shitty commie series:
https://fmoviesz.to/tv/yellowjackets-30648/1-6

( ebook blocked by Pinata: https://gateway.pinata.cloud/ipfs/bafykbzacedpavr5qwaqwdmckccacz3nx42yicq27jh63t54nc35aemm5wih7m )
thumbnail of 4024F362-E08D-4167-A637-12ED8437C03B.png
thumbnail of 4024F362-E08D-4167-A637-12ED8437C03B.png
4024F362-E08D-4167-A6... png
(98.17 KB, 1334x750)
2013 video not in TPA - "PMV Wonderwall by Oasis":
https://iv.ggtyler.dev/watch?v=lXFi_YiO8yA

DuckDuckGo Search not working (3-test):
. me
. https://archive.ph/2024.05.23-123502/https://duckduckgo.com/?q=Oasis+%22Wonderwall%22+pmv&t=iphone&ia=web
. https://web.archive.org/web/20240523123532/https://duckduckgo.com/?q=Oasis+%22Wonderwall%22+pmv&t=iphone&ia=web
thumbnail of F75A94A6-2320-4FCC-AF64-60A76349884C.png
thumbnail of F75A94A6-2320-4FCC-AF64-60A76349884C.png
F75A94A6-2320-4FCC-AF... png
(1.21 MB, 1334x750)
Post on pony butt (cross-thread):  >>/10394/

 >>/10390/
> My little pony spotted at the beginning of this episode of a shitty commie series:...
Also maybe in the "eat the bugs" episode (pic related):
https://fmoviesz.to/tv/yellowjackets-30648/1-9

The premise of that series is stupid. A group of girls get stuck in the Canadian wilderness, in a forest, due to a plane crash. Plane crash survivors couldn't make it back to society after like a year. Just burn down the forest. That would get the attention of someone who could save you. And/or learn to live nomadically instead of continually living "stranded" in the same place.
thumbnail of BB.png
thumbnail of BB.png
BB png
(555.34 KB, 755x1024)
 >>/10390/ 
Certainly, pony references in the media count as on topic, even if briefly, in my book. 

 >>/10387/
The comment converter formats and sets up the YT videos to be used in a archive fashion where they can be viewed with avatars and more easily readable than YT's infinite scrolling format  (that was the idea anyway). Examples here: >>/8381/

 >>/10381/
> Booru.org is likely shutting down
Never liked that place but still a shame considering stuff might be lost in that mess.

 >>/10386/
>  "Even downloading at a low resolution such as 240p or 360p still is infinitely better than nothing (0p)
My mentality as well.

 >>/10388/
> I was wondering about that in the past. Now I know.
Found something of interest though not a full solution. National Library of Austria has tried to make a program that converts crawls:
https://github.com/nla/httrack2warc
Maybe not the most active development and has some potential issues of its own but good to note.
thumbnail of 638EE7D5-5E08-4F15-B57B-0939FCA9B819.png
thumbnail of 638EE7D5-5E08-4F15-B57B-0939FCA9B819.png
638EE7D5-5E08-... png
(549.39 KB, 467x602)
thumbnail of 638EE7D5-5E08-4F15-B57B-0939FCA9B819.png
thumbnail of 638EE7D5-5E08-4F15-B57B-0939FCA9B819.png
638EE7D5-5E08-... png
(549.39 KB, 467x602)
Here is a shortened link ( info page at https://mub.me/yxUpk/stats ):
https://mub.me/yxUpk
->
https://tpa.mares.workers.dev/?output=html&id=

Informs me of 2022 video not in TPA - "MLP:FIM | FULL PMV | Princess Celestia & Princess Luna | Tribute 8 | Running Up That Hill":
https://vid.puffyan.us/watch?v=61ajUKx0bUk&list=UUYMslvPvLBto4IWZVglCxNA&index=26

 >>/10406/
> https://github.com/nla/httrack2warc/zipball/master
Interesting. Also include httrack files to avoid possibility being called faked WARCs.
I think I did download this channel in the past:
https://vid.puffyan.us/watch?v=dO_IOb2HT7s&list=UUOOhgESdE6ncQ9l0WnWIObA&index=17
> Walk of Life PMV (Time Capsule Version)

 >>/10409/
While posting to Endchan on mobile there's a bug where an image attached to a post you made days ago gets automatically attached to the post you are currently writing. Press x to remove attachment. I didn't notice that and that's what happened with that post.
thumbnail of 296A5156-6966-4480-AE52-992F82825E9E.jpeg
thumbnail of 296A5156-6966-4480-AE52-992F82825E9E.jpeg
296A5156-6966-4480-AE... jpeg
(544.77 KB, 2000x2000)
How to download WARCs of .onion sites: use Linux+torsocks+wget. Linux+torsocks+grab-site doesn't work, but there might be another way to do that. Seen as deleted but linked in DDG as:
> https://github.com/uncensored-hidden-wiki/uncensored-hidden-wiki

> The Uncensored Hidden Wiki - GitHub

> The Uncensored Hidden Wiki is an open, community-driven directory of uncensored onion services accessible on the Tor network. This repository serves as the central hub for maintaining and updating the list of onion addresses, providing users with unrestricted access to the diverse content available on the deep and dark web.


pfp from npr video
> https://web.archive.org/web/20240531124523/https://invidious.protokolla.fi/watch?v=HF7ZlfJfIz8 - video by anti-reaction-content idiot

Channel w/that pfp has some MLP videos
> https://invidious.protokolla.fi/channel/UCBM8OEMsZJ_5N3iTADIumDw
In the previous /go/ thread 2 torrents - 4K MLP and 4chan-mlp - were seen as too offline. They are now both 100% available! Size of both combined = 1.5 TB.

 >>/10415/
In the previous thread it was pointed out that Google Cache no longer exists, so maybe Yandex Cache has that page which is in neither WBM nor archive.is:
https://yandex.com/search/touch/?text=github+uncensored-hidden-wiki%2F&search_source=yacom_touch_common&lr=102632&mda=0

Another 404'd non-archived webpage - text from DuckDuckGo Search:
> https://endchan.net/vpngate/preview/423.html
> endchan.net
> 뚜루루리 11/19/2023 (Sun) 19:40 No. 423 del. ni-chan http://plnemlsyla6h5t3nuoz2algzmy635ceuendnjwsmhwn2os5fxahshiad.onion/
thumbnail of anonymous.png
thumbnail of anonymous.png
anonymous png
(179.96 KB, 568x658)
 >>/10415/
> Channel w/that pfp has some MLP videos
and some/all of them are in TPA

 >>/10416/
> 2 torrents - 4K MLP and 4chan-mlp
One or both of those were created by AI or with AI in mind. I found this AI project to be interesting: Cyc (pronounced SYKE). However, Cyc's information is not publicly available - see https://wl.vern.cc/wiki/Cyc and https://cyc.com/platform/

> deleted
yandexwebcache.net does have it:
tm=1717401313&tld=com&lang=en&la=1716940032&text=github+uncensored-hidden-wikiurl=https%3A//github.com/uncensored-hidden-wikil10n=en&mime=html&sign=1b951122b8c6dc3148fbf9ae3930a8d6&keyno=0">https://web.archive.org/web/20240603075600/https://yandexwebcache.net/yandbtm?fmode=inject&tm=1717401313&tld=com&lang=en&la=1716940032&text=github+uncensored-hidden-wikiurl=https%3A//github.com/uncensored-hidden-wiki&l10n=en&mime=html&sign=1b951122b8c6dc3148fbf9ae3930a8d6&keyno=0

This image is
> https://gateway.pinata.cloud/ipfs/bafkreic2riyobkaiy5yz4y2enbwaxf6k4mtioml6of6kcvdogqrjtqnzvq?filename=1444000255762.png
thumbnail of bafkreiexnbos5mgnd776d4gcdul6fvkwwn6qmvdkmpqg2h6z5a6lrw7biq.gif
thumbnail of bafkreiexnbos5mgnd776d4gcdul6fvkwwn6qmvdkmpqg2h6z5a6lrw7biq.gif
bafkreiexnbos5mgnd776... gif
(194.15 KB, 240x180)
2012 video not in TPA - "[PMV] - Any Pony You Like" ("zero video editing"):
https://invidious.darkness.services/watch?v=Q40f3dXtU0I

TPA update - now "/[channel_id]/", was "/[channel_name]_[channel_id]/" - examples:
. https://tpa.mares.workers.dev/?output=html&id=iOOA0xpG640
. https://tpa.mares.workers.dev/?output=html&id=IphQgkRXccI

I have an IPFS folder for YouTube which contains both formats at the same time.

 >>/10417/
https://web.archive.org/web/20240603075600/https://yandexwebcache.net/yandbtm?fmode=inject&tm=1717401313&tld=com&lang=en&la=1716940032&text=github+uncensored-hidden-wiki/&url=https%3A//github.com/uncensored-hidden-wiki&l10n=en&mime=html&sign=1b951122b8c6dc3148fbf9ae3930a8d6&keyno=0 
attached image was not seen here https://derpibooru.org/search/reverse
thumbnail of 551.png
thumbnail of 551.png
551 png
(596.19 KB, 1370x724)
 >>/10415/
Always useful to know. Thanks! Has their ever been any pony .onion site, specifically? I imagine with how technically inclined the fandom is, probably. Note, not talking about tor gateways on their own. 

 >>/10410/
> mobile bug

I want to say I encountered this on desktop, but, it's been YEARS at this point. Like that is back in 2019.
2022 video not in TPA - "[PMV Collab] Back to You" (original animation, artsy):
https://invidious.yourdevice.ch/watch?v=G9qRJCHOldc

 >>/10381/
I have tens of gigabytes of subdomains from there, including this WARC (20-image gallery):
. https://cmcfeet.booru.org/ - small
.. https://gateway.pinata.cloud/ipfs/bafybeid3uiq57oapdhqsgt52jqdva4zc22nzomj7kqsj5bbug4frw2773m/cmcfeet.booru.org-2024-05-15-5add2f64/

About that subfolder: this -- https://archive.ph/?url=https://dweb.link/ipfs/bafkreidnzznfkc5dpkf37mjcqmlhbtyyewyd7zmwtwuraqm6mv6cvresia -- is a file in ../[...]. When trying to save it to archive.is, I got the "link shows up for my IP address but not archive.is's" which sometimes happens with dweb.link. https://archive.ph/wip/... timed out on the initial capture request. The odd/interesting part was the URLs that archive.today showed in /wip for that. It showed Cuckflare captcha -- https://dweb.link/cdn-cgi/challenge-platform/h/g/orchestrate/chl_page/v1 -- which I saw Protocol Labs add to ipfs.io recently/before. That's disturbing, but not my focus. That /wip URL also showed this non-Internet-routable IP address link -- https://10.8.211.1/html/index.html?origin=xxx -- which reveals something about how archive.ph or dweb.link works internally.

 >>/10419/
> Has their ever been any pony .onion site, specifically?
Yes.
 >>/10419/
 >>/10424/
I think I can recall some novelty stuff existing but I wouldn't know (and be traveled enough) to know every small corner of the Internet. Technically, this very site is a .onion ponysite (and  primarily how I access it) and is an odd random coroner of the internet. 

 >>/10424/
I presume you are talking about: >>/10381/
> booru.org

Weird that place is dying off. One of those places than has been around for ever but feels at this point like a rundown dead city like Detroit. Empty and broken, and yet, life still persists. I hope the displaced communities there can find better homes.

 >>/10406/
> National Library of Austria

Not on my bingo card. Why would they be using something like httrack and not some over engineered and hopelessly out of doubt corperate product? httrack sort of fits the bill on being a little dated but in my experience it isn't shit. It actually works pretty well and I believe I have seen it used to archive some early fandom chan content before.
thumbnail of 1954D931-2281-449E-BCFC-DEEE4C043E31.png
thumbnail of 1954D931-2281-449E-BCFC-DEEE4C043E31.png
1954D931-2281-449E-BC... png
(628.8 KB, 2160x1212)
thumbnail of 8E3BDC76-E662-4A63-9135-1397127CD606.png
thumbnail of 8E3BDC76-E662-4A63-9135-1397127CD606.png
8E3BDC76-E662-4A63-91... png
(26.23 KB, 133x133)
Thinking I didn't download this pony-related channel (banner attached):
https://iv.ggtyler.dev/channel/UCTRFOtVd_wwdQc6mCqaCHBA

2013 video not in TPA - "Bring me to life [PMV]":
https://archive.ph/ml6N0
> How can you see into my eyes like open doors?  Leading you down into my core where I've become so numb  Without a soul, my spirit's sleeping somewhere cold  Until you find it there and lead it back home  (Wake me up) wake me up inside (I can't wake up), wake me up inside  (Save me) call my name and save me from the dark  (Wake me up) bid my blood to run (I can't wake up) before I come undone  (Save me) save me from the nothing I've become  Now that I know what I'm without, you can't just leave me  Breathe into me and make me real, bring (bring) me (me) to life  (Wake me up) wake me up inside (I can't wake up), wake me up inside  (Save me) call my name and save me from the dark  (Wake me up) bid my blood to run (I can't wake up) before I come undone  (Save me) save me from the nothing I've become  Bring me to life  I've been livin' a lie  There's nothing inside  Bring me to life  Frozen (frozen) inside without your touch, without your love  Darling, only (only) you are the life among the dead  All this time, I can't believe I couldn't see  Kept in the dark, but you were there in front of me  I've been sleeping a thousand years, it seems  Got to open my eyes to everything  Without a thought, without a voice, without a soul  Don't let me die here, there must be something more  Bring me to life  (Wake me up) wake me up inside (I can't wake up), wake me up inside  (Save me) call my name and save me from the dark  (Wake me up) bid my blood to run (I can't wake up) before I come undone  (Save me) save me from the nothing I've become  Bring me to life  I've been livin' a lie (bring me to life)  There's nothing inside  Bring me to life

pfp from npr video
> https://web.archive.org/web/20240605074853/https://iv.ggtyler.dev/watch?v=oHEUKgmGcTY - main/only problem with TF2: aimbots; Way less important problems = IRL harassment, digital chat spam
Channel "ImmaLittlePip" has some MLP videos.
 >>/10358/
Booru.org is likely shutting down
https://desuarchive.org/mlp/thread/41078194#41092144
https://wiki.archiveteam.org/index.php?title=Deathwatch&diff=prev&oldid=52186
thumbnail of C87FA679-5D89-498D-A895-F19F724492BB.jpeg
thumbnail of C87FA679-5D89-498D-A895-F19F724492BB.jpeg
C87FA679-5D89-498D-A8... jpeg
(69.8 KB, 473x447)
thumbnail of 9B7CAA03-F5B5-4D93-9AC2-AC3A0381F3DE.png
thumbnail of 9B7CAA03-F5B5-4D93-9AC2-AC3A0381F3DE.png
9B7CAA03-F5B5-4D93-9A... png
(108.82 KB, 1334x750)
2014 video not in TPA - "My Little Pony Nightmare Moon Evanescence Bring Me Back to Life" (more than 7 million views!):
https://just4cats.tv/watch?v=4aERZKFU82Q

Image = recent featured Twifag image
> https://web.archive.org/web/20240601134252/https://twibooru.org/
Wonder if this is directed at someone specifically

Other image: 20ez 512M tile; there was a Doge 2048, what about an MLP 2048?
thumbnail of 3204933.jpg
thumbnail of 3204933.jpg
3204933 jpg
(482.29 KB, 2048x2048)
 >>/10430/
2014 video not in TPA - "My Little Pony Nightmare Moon Evanescence Bring Me Back to Life" (more than 7 million views!):
This is one of those things that shows that is always good to double check. Something can be prominent and everyone thinks someone else must've got it but no one did. I remember that video! Wasn't something of a fav but I would just randomly click through stuff and I saw it a few times.I might... might have it downloaded somewhere when I was trying to go through the old emo and edgy PMVs and other related pony content in some early archive attempt.

 >>/10426/
> ImmaLittlePip

I think I recall this channel too but not for any of their content; I remember the name sticking out in comments of other videos that weren't MLP related. Now, maybe a different commenter but I think this is the channel. Two for two in vague nostalgia today! 

 >>/10425/
> I think I can recall some novelty stuff existing but I wouldn't know (and be traveled enough) to know every small corner of the Internet.

Perhaps I should rephrase that question. I wonder if there any dedicated pony sites with their own purposes or communities that were hosted only/primarily on .onion?  I would think so but know of none. 

>  Technically, this very site is a .onion ponysite (and primarily how I access it) and is an odd random coroner of the internet.

True, but this .onion, and a place such as Derpibooru's, are only alternative gateways to normal internet sites  often the case for me as well. 
thumbnail of 5166391A-E379-46AC-92F3-ECCE8894DFDB.png
thumbnail of 5166391A-E379-46AC-92F3-ECCE8894DFDB.png
5166391A-E379-46AC-92... png
(98.65 KB, 1334x750)
thumbnail of 9950C2B9-8FE9-468D-9A40-127CE2804A66.png
thumbnail of 9950C2B9-8FE9-468D-9A40-127CE2804A66.png
9950C2B9-8FE9-468D-9A... png
(122.87 KB, 1334x750)
Older WBM "one time per day" error:
https://gateway.pinata.cloud/ipfs/bafkreid6qfilufsqpxg6djbuuhvi46jyf7u53jgkxc5gtg2tklxavzzgeq . Newer: also attached.

 >>/10430/
Playlists of that channel with that 7M video are a bit "schizo":
https://iv.ggtyler.dev/channel/UCFmHKYQIXFFF0Shx946E6WQ/playlists

 >>/10431/
https://archive.ph/2022.06.29-034501/http://bcts7bblfzr4qyckcp6bvxc2svlnbdtsxunl6dcd5mwxhjm5dpttbqad.onion/
thumbnail of C68A0971-C4DD-4097-AC51-2D2A1D7788AE.jpeg
thumbnail of C68A0971-C4DD-4097-AC51-2D2A1D7788AE.jpeg
C68A0971-C4DD-40... jpeg
(598.01 KB, 1279x1563)
2014 thread which includes an anon "dumping the shitty ocean book":
https://desuarchive.org/mlp/thread/21136218/#21138402

Some of the images are 404'd and I have some/all of those here:
https://gateway.pinata.cloud/ipfs/bafybeiaqw32yaqem3hrx2e2gay3rn3qu26lj272ydhr6dgnkjr3ebcxsoe/My%20Little%20Pony%20picturebooks/Under%20The%20Sparkling%20Sea/

 >>/10432/
"Host"=older. "Resource type"=newer. WBM discriminates against porn "resource types".

> bcts7bblfzr4qyckcp6bvxc2svlnbdtsxunl6dcd5mwxhjm5dpttbqad.onion
I have an incomplete WARC of that.
2012 video not in TPA - "(PMV) Applejack - I'm Yours [1080p HD]" (small/medium-size channel):
https://invidious.incogniweb.net/watch?v=175uhoGIJ2Y

I didn't see any MLP thing related to the 1963 film "Bye Bye Birdie"; title song:
https://invidious.incogniweb.net/watch?v=1t3cBTb3xPc
Similarities to MLP:
- Girly
- Saccharine sweet
- Happy/upbeat music
- Retro/older (G1 spin on it if you want)
- No reference to species ("hands", "pony")

"Better" or "more sensible" than some things which have been "ponified". Also, I could imagine a simple animation to go with it if someone wanted to try their hand at animating.

Speaking of music, this is one of the best sets from this specific radio program - "Sub Focus Essential Mix 2023 - BBC Radio 1" https://invidious.incogniweb.net/watch?v=Mgc5UNDaySQ ; for the most part: I like it and think it's a banger.

From a torrent, so maybe won't be very online - "My Little Pony Vänskap Är Magisk":
https://gateway.pinata.cloud/ipfs/bafybeibwxppsm6bb5iuetg5ql5obskhn3yrztweoqt5murxayzwm2scssq
thumbnail of 6412861B-8C66-4A09-8A10-F1B66A846B1F.jpeg
thumbnail of 6412861B-8C66-4A09-8A10-F1B66A846B1F.jpeg
6412861B-8C66-4A09-8A... jpeg
(25.5 KB, 524x185)
thumbnail of 6ADDFC26-F3BF-4513-86C4-3A071F640CA8.jpeg
thumbnail of 6ADDFC26-F3BF-4513-86C4-3A071F640CA8.jpeg
6ADDFC26-F3BF-4513-86... jpeg
(29.36 KB, 512x288)
thumbnail of EF8F2BC7-78FD-4019-8686-073E7F934614.jpeg
thumbnail of EF8F2BC7-78FD-4019-8686-073E7F934614.jpeg
EF8F2BC7-78FD-4019-86... jpeg
(45.98 KB, 515x491)
thumbnail of 5F369961-3952-4226-B992-780B1ADACBE4.jpeg
thumbnail of 5F369961-3952-4226-B992-780B1ADACBE4.jpeg
5F369961-3952-4226-B9... jpeg
(284.76 KB, 661x520)
thumbnail of B6B798F4-04B5-41EE-A205-2C1F9ACCDA2F.jpeg
thumbnail of B6B798F4-04B5-41EE-A205-2C1F9ACCDA2F.jpeg
B6B798F4-04B5-41EE-A2... jpeg
(17.06 KB, 318x89)
I basically searched Twibooru for this:
("human on pony action" OR "pony on human action") + "ai generated" + ("futa" OR "gay")

I found only a small amount of search results.

 >>/10389/
> cf-ipfs.com always redirecting to ipfs.io
Also unfortunate: cloudflare-ipfs.com has been redirecting to ipfs.io for ~weeks now. For example, this file which was deleted off of archive.org due to getting too many "bad" comments:
https://cloudflare-ipfs.com/ipfs/bafkreia32bgfd2vwoxy3xvq66ddzifq5isymbnarmwdgdq3qhdokoy3ksy?filename=MyLittlePonyFull_reviews.xml

CF gateways are basically all redirects now, so those are "no longer a thing". Users sometimes dislike CloudFlare for the right reasons, and sometimes for the wrong reasons. I can see Clownflare having less of a presence as being a positive. For example, when Cloudflare goes down (in the past/future) there was a big Internet blackout. That's one of the bad things about stuff being so heavily centralized. Crimeflare - criticisms of Cuckflare and whatever:
. http://crimeflare.eu.org/
. https://0xacab.org/dCF/deCloudflare/-/blob/master/README.md
. https://gitea.slowb.ro/dCF/deCloudflare
. https://geekflare.com/find-real-ip-address-of-website-powered-by-cloudflare/
> You cannot pass this invasive “browser check” without enabling JavaScript. This is a waste of five(or more) seconds of your valuable life.
> Do you really think Cloudflare has 100% uptime? You have no idea how many times Cloudflare goes down. If Cloudflare goes down, your customer cannot access your website.
> Cloudflare similarly prevents many people who have poor internet connectivity from accessing the websites behind it (for example, they could be behind 7+ layers of NAT or sharing the same IP, for example public Wi-Fi) unless they solve multiple image CAPTCHAs. In some cases, this will take 10 to 30 minutes to satisfy Google.	
> In the year 2020 Cloudflare switched from Google's reCAPTCHA to hCaptcha as Google intends to charge for its use. Cloudflare told you they care in your privacy(“it helps address a privacy concern”) but this is obviously a lie. It is all about money. "hCaptcha allows websites to make money serving this demand while blocking bots and other forms of abuse"

 >>/10441/
> Similarities to MLP
Forgot to post: "cute/beautiful/sexy"
I found it interesting to think about and experience how gets "lost in transition". In 2024, I uploaded a "many" images to Derpibooru (some/all autocopied to "altboorus"). I did that until I got permabanned for a stupid reason; wow that website went downhill. When uploading, I knew the source (mainly image file links and not webpages), but didn't include it in the upload most of the time. Just included the image+tags. More generally speaking, data can be shared like this:
1. Just the data
2. Data + minimalist metadata (title, tags)
3. Data + medium metadata (description, etc.)
4. Data + high metadata (filename, timestamps, etc.)

For De'p'u I was doing level 2 basically. For this other thing (blockchain/cryptocurrency-related) I was pretty much doing level 1. Even with only low/no metadata it can in some cases be a monumental task to "archive many things" or "all that you've got".

More on this topic: [insert here]

Also, I wrote a great IPFS alternative to individual image webpages to replace boorus. It doesn't do search result galleries (yet?).

 >>/10441/
Feeling like Ann-Margret is sexier than the other girl (in "Mad Men"):
. https://invidious.incogniweb.net/watch?v=s4TqjpcZ4Ow
. https://invidious.incogniweb.net/watch?v=zWxgk2y5RDA
. https://invidious.incogniweb.net/watch?v=FV-IbKB5dlo
thumbnail of F5614A36-8889-4951-AD04-9DC8EBEBDD75.jpeg
thumbnail of F5614A36-8889-4951-AD04-9DC8EBEBDD75.jpeg
F5614A36-8... jpeg
(188.14 KB, 850x1650)
^*I found it interesting to think about and experience how information gets "lost in transition". In 2024, I uploaded "many" images to

Helpful to provide even just an image file link in the source field in the likely event that the booru does not support no-derive images. (Also helpful to do that for other reasons.) Pic unrelated.
Videos of interest / rewatchable:
. PMV, LSD trip... https://endchan.org/.media/fc5dcd255243b8b233c96db1c2ae3c8b-videowebm.webm
. AI, harsh audio, neat https://endchan.org/.media/5d76809e813984402091e316e1f34152-videowebm.webm
. AI, less harsh audio https://endchan.org/.media/66230b33312a448be7043e6ca37383a9-videowebm.webm
. MLP parody of the opening credits of Friends https://gateway.pinata.cloud/ipfs/bafybeibb465xhmnuk3yiu2nlozuyhem7nnxtnwvwhpkoonubvtirrwfp6q
.. video file https://gateway.pinata.cloud/ipfs/bafybeige7xhxvnc7mx74tizlvilqwtzlkhfezgbz3p7btaqmx6ol2e6gr4
.. metadata:with tags https://sabrig1480.xyz/ZaxMXc6onnl7rzhHgmnYq7QanpQIkCTxH15LVQ2KdgM
.. metadata:time https://aralper.xyz/UwD_MnJn6U0rME_tyaQK8sFir7nwJBI9n7sKA6XcF-Y (showed up like 6 minutes later after AR add)

"5XX Server Error - Twibooru" captured here:
https://web.archive.org/web/20240529172052/https://twibooru.org/search/index?filter_id=2&page=247&q=ai+generated%2C-anthro

In the previous thread this question was asked: is there any Shonen anime-based MLP fanfic? Did see any of that, but I saw something similar... (BTW, Shonen animes are sometime/often formulaic.)

----

Time taken to rsync 15,989,596 mostly 1MB files (8,715,690,568,293 B = ~8.7 terabytes):
2024-06-03T18:54:24.618420660Z ->
2024-06-13T18:36:00.409436699Z
= 10 days which was the predicted time at 10 MB/s for 9 TB. Less than 1 TB/day.
 >>/10369/
> and a few external hard drives
Just make sure they aren't Western Digital 5TB easystore external HDDs; I'm one-million-percent sure that those are terrible and poorly designed, and they fail way too quickly. I think the My Passport external HDDs also suck, but I'm not entirely sure. (Best Buy sells these stinkers.) SSDs are OK for operations, but don't use them for long-term storage. They degrade after one year of not being plugged in (refreshes their electrical charge).

 >>/10449/
*Didn't see any of that
thumbnail of CDDC86DB-7271-45CD-B36A-105CCA5C2EE6.jpeg
thumbnail of CDDC86DB-7271-45CD-B36A-105CCA5C2EE6.jpeg
CDDC86DB-7271-45CD-B3... jpeg
(139.34 KB, 1024x1024)
This image: Rainbow Dash and the girls had a sleepover and repeated a certain phrase a certain amount of times before a candle-lit dark mirror. Unexpectedly, a monster of an unknown species appeared in the mirror.

In the past, there were posts about an IPFS search engine (multiple instances of this existed in the past but no longer work) and findability. Search engines are based on indexes. You can create indices of dags by running this:
> $ ipfs refs -r --format=" ->  = " [CID]
In the past I created scripts to index a dag (various methods), but sometimes I was annoyed that it would download the data and not just the metadata. Today I had a realization: just running the node as read-only! Haven't tried that, but it should work. (Other problem: shows blocks within files, may not want to do that and only show CIDs of files and not blocks within them.)
thumbnail of bafkreibp5kiccheviukiqfvqvgjxy4daya6wxkswlto2ultoivwbe7awn4
thumbnail of bafkreibp5kiccheviukiqfvqvgjxy4daya6wxkswlto2ultoivwbe7awn4
bafkreibp5kiccheviuki...
(42.14 KB, 550x400)
thumbnail of bafkreie2ffzgiblwb22m7xczkvypmdm464lrrvyfpepmpxhualkupszbn4
thumbnail of bafkreie2ffzgiblwb22m7xczkvypmdm464lrrvyfpepmpxhualkupszbn4
bafkreie2ffzgiblwb22m...
(134.37 KB, 756x560)
thumbnail of bafkreie3dqvo4gxsasbpkpziee2wzb2njr66wws5uhb24whbb26lqnxmra
thumbnail of bafkreie3dqvo4gxsasbpkpziee2wzb2njr66wws5uhb24whbb26lqnxmra
bafkreie3dqvo4gxsasbp...
(74.68 KB, 900x655)
thumbnail of bafkreigomj3v3rmhacxvfiudfru5bx7rnyum2a4uaacrsauiz23oki4agu
thumbnail of bafkreigomj3v3rmhacxvfiudfru5bx7rnyum2a4uaacrsauiz23oki4agu
bafkreigomj3v3rmhacxv...
(36.46 KB, 606x465)
Huh, I thought that an if statement like the following in sh wasn't POSIX-compliant. Guess I was thinking of something else - maybe double square brackets?
$ ipfs ls -s \
bafybeifdw3oaaxcdfv5w3zxd4k7btczdcqq75562b3foosfhntspchbbnq/torrents/by_infohash/0a28fe146ed6d80f2e5f2921f1cd39400aa794b2/Ponibooru-Select-Safe \
| head -n80 | grep "^bafk" | awk '{print $1" "$2}' | xargs -d "\n" sh -c \
'for args do cid=$(echo "$args" | sed "s/ .*//g"); \
size=$(echo "$args" | sed "s/.* //g"); if [ $size -lt 150000 ]; then echo $cid; ipfs get $cid; fi; done' _Pics related
"Secretly/somewhat the next /pag/ thread" now read-only:
https://desuarchive.org/mlp/thread/41078194/mlp-esrgan-upscale

When did 4chan remove the "posters in this thread" count?

----

Of one channel:

2019 video not in TPA - "Timber PMV":
wtf/watch?v=26ZBzGUglPs">https://vid.selbsthilfegruppewtf/watch?v=26ZBzGUglPs

2021 video not in TPA - "Hellfire - MoonLight PMV":
wtf/watch?v=bUJvPAeP3Tg">https://vid.selbsthilfegruppewtf/watch?v=bUJvPAeP3Tg

Saw that MLP-focused channel when searching for a PMV of "Moonlight Mile" by The Rolling Stones:
> wtf/watch?v=ugYzDqQtdHU">https://web.archive.org/web/20240616034343/https://vid.selbsthilfegruppewtf/watch?v=ugYzDqQtdHU
Top 3 comments on that = "Dead friend/family member liked this song."
"Connection failed"
https://vid.selbsthilfegruppe.wtf/watch?v=26ZBzGUglPs
https://vid.selbsthilfegruppe.wtf/watch?v=bUJvPAeP3Tg
https://web.archive.org/web/20240616034343/https://vid.selbsthilfegruppe.wtf/watch?v=ugYzDqQtdHU
thumbnail of bafkreie4stauzmifnmz2fx7xuqkeqvujoifkeluxvpvc2nus3s5e64goky.jpg
thumbnail of bafkreie4stauzmifnmz2fx7xuqkeqvujoifkeluxvpvc2nus3s5e64goky.jpg
bafkreie4stauzmifnmz2... jpg
(38.89 KB, 500x380)
thumbnail of bafkreidovqh5kvbaorl2svpisxu7gzepesrk5ltefoujxxaf373t4o5bnu.png
thumbnail of bafkreidovqh5kvbaorl2svpisxu7gzepesrk5ltefoujxxaf373t4o5bnu.png
bafkreidovqh5kvbaorl2... png
(28.39 KB, 600x600)
thumbnail of bafkreidkvw774zublzkumuuukocn43ri6zemhvn7y67c37xzuba4wudhv4.jpg
thumbnail of bafkreidkvw774zublzkumuuukocn43ri6zemhvn7y67c37xzuba4wudhv4.jpg
bafkreidkvw774zublzku... jpg
(35.09 KB, 450x430)
thumbnail of bafkreidh5bptl4ayjp3w3e4zd74ei7ayezmn7gind3cs5ps7gp7acfuqv4.gif
thumbnail of bafkreidh5bptl4ayjp3w3e4zd74ei7ayezmn7gind3cs5ps7gp7acfuqv4.gif
bafkreidh5bptl4ayjp3w... gif
(38.61 KB, 250x145)
thumbnail of bafkreibegle3e3sy7fgqkyfgfcz7ywwkl4vt5lifzf4g4c3czuhyijnc6q.png
thumbnail of bafkreibegle3e3sy7fgqkyfgfcz7ywwkl4vt5lifzf4g4c3czuhyijnc6q.png
bafkreibegle3e3sy7fgq... png
(34.47 KB, 529x252)
I've done some analysis, and it seems that Endchan rewrites every single image that I post. If true, this is bad and is worse than what 4chan does. Here's a test of 2 PNGs, 2 JPGs, and 1 GIF with links to original images below. (Endchan image files are named by MD5 hash + MIME type.)

1. JPG, MD5: 8d004ae26a49089a16829efcc6f5bf43
ipfs://bafkreie4stauzmifnmz2fx7xuqkeqvujoifkeluxvpvc2nus3s5e64goky
https://sabrig1480.xyz/ZeGIZM2yd_OBeKrO4ylKO6EgdQB_z-YTrUkYcd4BYvw

2. PNG, MD5: 55c556f146894d9df78e42a9586631d4
ipfs://bafkreidovqh5kvbaorl2svpisxu7gzepesrk5ltefoujxxaf373t4o5bnu
https://aralper.xyz/c4kAUtwRbucNVG33igsMpVn9Zmdb6EPM5gtTCRqD2VU

3. JPG, MD5: aa6ca96c19b66babee493164566b0115
ipfs://bafkreidkvw774zublzkumuuukocn43ri6zemhvn7y67c37xzuba4wudhv4
https://imtran.site/4HP_yX8wICqU7tg5nLUJaY4Hfe0rsr7uYfud3UyQ-8M

4. GIF, MD5: b131704afaf666ed659d3b886787e0e0
ipfs://bafkreidh5bptl4ayjp3w3e4zd74ei7ayezmn7gind3cs5ps7gp7acfuqv4
https://ahnetd.online/tHd2gq4Ig479tpZ49e3KkT2lr1WTlzePGOSSX74kbhs

5. PNG, MD5: e9e4608809fbc762b519f3e767c9aa00
ipfs://bafkreibegle3e3sy7fgqkyfgfcz7ywwkl4vt5lifzf4g4c3czuhyijnc6q
https://coinhunterstr.site/qVdGsTqvNdtIvp1PMm0UhP-rBndIkbzHAATFaP_2k5c
 >>/10462/
That's Vitória Fumo UCiuinS6t_wUf1f_nZ7A9Q9w and I'm downloading it via the "script":
ipfs://bafkreifajlc3junozqugo6tll6abrjxa7dnbidt556i3czspz3hmrnsd4i

 >>/10463/
Oh good, 5/5 images untouched (upstream=downstream so sanity check=passed). Seems I had bad info or a misunderstanding. If I wrote a password on that post, maybe (probably not) I'd delete it to not "look dumb".
thumbnail of BF861189-0AC3-4D47-9A04-FE4BB286A0E3.png
thumbnail of BF861189-0AC3-4D47-9A04-FE4BB286A0E3.png
BF861189-0AC3-4D47-9A... png
(113.81 KB, 396x397)
 >>/10461/
> thread
Didn't cross my mind until now: I could have went with a "nuclear option". If you post pony porn there, then there's a chance that jannies will delete all of your posts. More likely if you also post text along with the clop which enrages those Internet janitors. Would be curious to see what would happen in that case. Maybe a "thread rebirth". 499th post in a thread=last bump possible + 500th and after=no bump possible. If the bump limit is reached then most of the posts in the thread gets deleted, leaving like 100 non-deleted posts, can the thread be bumped again? Perhaps I'll find out in the future.

 >>/10464/
> UUiuinS6t_wUf1f_nZ7A9Q9w
I finished downloading that:
Step 1=done (find)
Step 2=done (download)
Step 3=TODO (redundancy+share)

Pfp of that channel with PMVs attached.

( BlackGryph0n commented on some video about making transparent wood: https://web.archive.org/web/20240612111022/https://invidious.incogniweb.net/watch?v=uUU3jW7Y9Ak )
At least one anon says that I don't explain things well enough. However, spending all my time explaining things feels like a waste of time to me. It is beneficial to those looking to easily understand though. More work explaining things below:

 >>/10429/
 >>/10461/
 >>/10465/
I know some users are interested in thread summaries and information being more easy for anyone to understand. So, I will summarize part/all of this thread "very roughly": https://desuarchive.org/mlp/thread/41078194/ with post numbers for more details. I'll explain it like a story/encyclopedia maybe. The OP has 3 goals in mind: visibility and revitalization/restoration of 2 torrents, image dumping with metadata, [and sharing insights or info]. The torrents are imageboard images+4K Esrgan upscale of MLP:
> Twilight Sparkle had a sign in front of her house with a book drawn on it - the logo of the Golden Oaks Library?
> \ Sizes:
> 417 GiB [Loyaldk] My Little Pony 4K Upscale
> 1058 GiB 4chan-mlp
The 4K one is about 24 FPS and maybe not color corrected (41078233). That post links to another 4K MLP thing. Interest expressed in 4K; mlp leaks mentioned; audio of MKV files=ac3 5.1(side) + aac (LC) stereo and subtitles=subrip. 3 images with metadata posted. Imagining DJ Pon3 DJing a specific set that was played on BBC Radio 1. 3 images+metadata. It was seen that one cannot upload MP4 files to Derpibooru.

----

And how long did it take me to write the above and below?
Like 10 minutes? Would have been faster typing on a better computational device. Something I want to know: is there a block explorer (or transaction/item explorer) for this -- https://arscan.io/address/5sqfubD1WdH2zrUcdf60uhXTofOjiJBBo3-wvV0z7P8?tab=items (example) -- which works in a CLI or as an API? How could I get the hash of those pages of items without web scraping it? (Guess I will webscrape this other MLP-related address in the meantime.)
 >>/10473/
*get the hashes of those pages of items [hash of each item]

Thread summary cont.: MP4 files can be uploaded to Twibooru, but it shows up as a 404'd video file for hours after.
> https://twibooru.org/3227358
> gotta_go_fast_rainbow_dash_ai_dub_v2.mp4
Twibooru (philomena) markup is stupid when dealing with underscores in the description field. Criticism of 4K which I don't think is really valid:
> Meh. Small details still look like a blurry mess.
5 images+metadata. Imagination: DJ Pon3 is now playing the Justice Essential Mix. "Deanonymized", remembering /pag/. 2 images+metadata. An anon claims that he'll "seed [4K] until [his] house burns down".
 >>/10474/
Subject field gets cleared each time I post. Thread summary cont. 1 image+metadata, More Derpibooru stupidity:
> "unicorn" implies "horn", but what is actually seen in this image is this: unicorn=true, horn=false.
BitTorrent peer with 100% didn't show up for everyone: blocked in some way maybe. Ugh, I don't really want to summarize this, so I will just lazily quote it with fix(es):
> I guess you have a better setup than me: larger storage and automatic backup. I have been uploading/downloading torrents for more than a year straight with a [somewhat] constant uptime, started in 2022-10. (Of course I messed with torrents years ago, but not with a significant seeding duration.) I can host about 4.5 terabytes of them at a time. I have more than 5 TB of torrents, but not a good system to be hosting that much all at once. Over said one and a half years I went through 2 or 3 HDDs, and I copied the data to another HDD before they died each time (mostly). I have ~90% of my torrents in two different HDDs (one cold and one hot). My best uptime with IPFS is [85] days straight; I reset this uptime to zero if it ends up offline for more than about 12 hours (has been offline for days now so it got reset recently).

----

IPFS uptime now = roughly 25 days straight.
"Pinkie's Brew" is a song from "Friendship is Witchcraft" which is related to or focused on present-to-past time travel:
https://inv.tux.pizza/watch?v=682pneYoP0c
https://inv.tux.pizza/watch?v=l4hv2ShiK9Q
https://inv.tux.pizza/watch?v=rDDyQ0_JnN8
https://inv.tux.pizza/watch?v=g0WAaQGVOIQ
https://inv.tux.pizza/watch?v=JOw6jc9tInc
https://inv.tux.pizza/watch?v=shFfnG6GRhA
https://inv.tux.pizza/watch?v=n0nc8VC94Ds
https://inv.tux.pizza/watch?v=TX68fPWx-PY
https://inv.tux.pizza/watch?v=-84akiSW7BA
https://inv.tux.pizza/watch?v=OBfmwa6GDUY

 >>/10475/
Cont.
1 image+metadata. HDD working constantly for like 4 years straight, as he later corrected himself:
> I doubt [my setup is] any better. Some would probably say it's too fragile, but whatever. An Odroid HC2 with a 10TB ironwolf drive, and a 1000/1000 connection in and out my house, that's it. Ghetto compared to what you seem to be doing with backups and whatnot, but I've been running with that for like 5-6 years now, constantly up, constantly seeding, never had any problems. Who knows when problems will appear, but I try not to think about that.
> \ While we're at it, the fat leaks I am seeding. Misspoke, it's not 400gb, but 212 gib. Still good stuff for whoever is interested.
> magnet:?xt=urn:btih:eeca18f72298294bfe52d85293aef1fba9264116&dn=unpacked
 >>/10476/
Summary, cont.:
Redundancy for torrents. Prepared for a HDD to die, ripoff HDD. Quote: "enterprise drives can handle a workload of 550 TB/year."  >>/10476/ "smartctl, gives me 33,540 hours of power-on-hours. So.. 3 years, 302 days" (41078983). More on lifespan:
> I have a small nas with 2 mirrored hitachi drives running 24/7. I had to replace one that failed after 3 years (exactly after the end of its warranty), the other one is still doing fine at 5 years.
The Google Drive "MLP in 4k" thing is way different compared to the torrent 4K MLP. About the latter: YayPonies apparently has the same files as episode-per-torrent/infohash, such as "YP-4KLEU-01x01.mkv". BitTorrent doesn't have a thing to seed same files in different torrents automatically. HDD working operations. Operations with a folder with >500,000 mostly-empty files and zero subfolders (41079393). ZFS does more rw than non-COW FSes, and it was seen auto-scrubbing the entire device (41079422). Drive lifespan stats:
> Your workload does not sound impressive at all
> drives are used until they die.
> Check out Backblaze's test data, they use all kinds of drives (even consumer ones) in enterprise workloads for years:
> https://www.backblaze.com/cloud-storage/resources/hard-drive-test-data
> \>Other thing I was doing: every hour check if hundreds of files exist in a folder which contains half a million files and zero folders.
> Absolutely not a factor, you could even cache this data in RAM making it a free operation.

----

I've been merging two IPFS repos and noticed the following. On the one I'm emptying (moving all .data to the other one), it said this at the start and ~middle point: "ipfs pin ls --type=recursive | wc -l [\n] 1205" (saw 1,205 pins). After moving many files, it now says:
> $ TZ=UTC ipfs pin ls --type=recursive | wc -l
> 2024-06-17T12:17:28.300Z ERROR core core/builder.go:158 constructing the node: could not build arguments for function "reflect".makeFuncStub (reflect/asm_amd64.s:28): failed to build *mfs.Root: received non-nil error from function "github.com/ipfs/kubo/core/node".Files (github.com/ipfs/[email protected]/core/node/core.go:136): error loading filesroot from DAG: block was not found locally (offline): ipld: could not find QmRLsKdkgAm7PvnwfjKpze7vhUqzuWpgPUMzfwhZBxHDj8
> Error: constructing the node (see log for full detail): error loading filesroot from DAG: block was not found locally (offline): ipld: could not find QmRLsKdkgAm7PvnwfjKpze7vhUqzuWpgPUMzfwhZBxHDj8
> 0
> $ # I saved the list of pins to a text file beforehoof.
Shouldn't be a problem because I duplicated the "datastore" folder when I saw that error, or I hope it doesn't end up being an issue.
 >>/10478/
Cont. Questions about "550 terabytes/year". 550 terabytes per year claimed in https://youtube.com/watch?v=IgJ6YolLxYE (video where a guy used Backblaze data to derive annualized failure rate, AFR, over years for some storage drives). Sharding in pony boorus, other info:
>  >part of a process which does other stuff
> Like writing hundreds of files every hour (now every 24 hours) to said folder with 500,000+ files [...]. Is such a folder layout a good idea? Maybe not. I know certain websites do some type of sharding like filename 09aefde0... gets put into folder ./09/ae/fd/ or by date ./2023/06/08/ (like with some MLP boorus). There's likely a reason that this is done, don't know specifically what that is, but it felt unnecessary complicated so I just put said files all in that one folder. I needed to do it this way because it is a system where duplicates matter and this created easy deduplication which anyone could benefit from (and not just me if I turned on ZFS dedup). I know there's a different "dedup for the masses" system, but I felt like it had some other downsides.
More fails:
> Like I said above ITT, I think what I had and have is a ripoff, unfortunately. Not doing research and lazily buying more crap which sucks = kicked my ass.
I do know how to do that, undersold myself (could put it in /tmp or tmpfs/ramdisk or something):
>  >you could even cache this data in RAM making it a free operation.
> I thought of doing something like that in the past. Don't know how to implement that.
More on shit and non-shit HDDs (41079687). Can you easily search Backblaze by HDD? Unfortunate events. Question:
> Is there any good external HDD which doesn't require outlet power? At the moment I feel like the answer is no, which is sad, or I don't know enough.

----

Trance music, it's uplifting; 00:14:40:
https://archive.org/details/Armin_Van_Buuren_-_A_State_Of_Trance_406
In the past I did thread summaries in a more terse way. Felt like doing it differently this time.

 >>/10479/
Cont. "Infinite hard drives hack" (41079713). Unlike BitTorrent, with IPFS you can upload or download a file, regardless of which online share it's in (folder/CID). Paragraphs-long post, read it!
> https://desuarchive.org/mlp/thread/41078194/#41079810
Next post (paragraph-long) = continuing the post on a possible/impossible way to improve BitTorrent's system or other thoughts. "Foreshadowing":
>  >In real life, drives are used until they die.
> I am doing that too, and I have/am doing that with various degrees of pain over my life. I have a HDD right now which I will work until it dies; I have set up backups and stuff so I don't care if it becomes inoperable.
> \ AFR likelihood increases the more months/years a storage device is used, so at least set a cut off point of a certain duration that the drive was used. Beyond or near that duration you "absolutely must" have a setup where you don't care if the drive fails (which it soon will).
More on shit/non-shit storage drives and "SSD companies guarantee 1 year data retention without power" (41080244). Informative post about data decay and failures:
> ExplainingComputers guy said that flash drives and SD cards that are unpowered for a year could degrade too just like SSDs could ( https://youtube.com/watch?v=xA9Xq7hb6Q0 [Embed] ). Scary. I have some older USB thumb drives. SSDs and SD cards and thumb drives are like a cloud storage website: don't use it for a year and all your files will disappear.
> \ Any drive could die at any time, but there are tendencies  >>/41079713/. If the warranty on a HDD is only one year then that says something: that even the manufacturer doesn't expect it to last that long. Try buying a HDD with a warranty of 2 to 5 years. How long does a HDD last? If it isn't shit... Like 2 to 5 years if using it under datacenter conditions and 3 to 7 years or long if used under normie conditions ( https://youtube.com/watch?v=_IQmn9qhuvs [Embed] ). Magnetic field decays, so refresh data every 5 years. Apparently some tape drives (write once read many/WORM) last about 30 years - well beyond the "I gotta do something every 1 or 2 or 5 years". And apparently tape drives are sometimes a third the cost of HDDs.
"AI":
> If you really want a good MLP 4k, train a model on MLP style flash assets rendered at 1080p and 4k.
Didn't really want to write this summary, more in response to requests and thoughts in the past (both from not me). Feel annoyed by this? Just say so and I guess I'll quit. Going forward: skipping detailing number of image+metadata posts since that's even slightly going into depth about specific media which is "less important".

 >>/10480/
Cont. Joke (41080667, 41080762):
> Carve data into stone and it can last for centuries if it doesn't get smashed to bits. The Romans knew this. Can't easily access store-carved data and its density isn't great though.[...]Sensible stone-carved data: plain text and not a binary image file or whatever. Rosetta Stone is a nice example which preserved language, and without it humans would know less about the Egyptian language and stuff.
Popular MLP FIM series torrent = magnet:?xt=urn:btih:53db492ecb33901b17f3f99dd41f2d7310fc5a64&dn=MLPFiM and some/all of https://archive.org/details/MyLittlePonyFull original files are base on this (41080728). WBM no longer saves redirect screenshots to websites which it dislikes. CF with Twibooru: caching/serving of HTTP 200 and HTTP 404 isn't globally consistent (41080796). Booru D'ru uses "blob:" URLs on gif, but not png and jpg; ext.derpicdn.net and don't like blob: (41080820, 41080862). Fail:
> Interesting to think: sometimes someone has 100% of a torrent and someone else has <100% but cannot get the rest of it due to something(s) being blocked.

----

Searching a word:
https://desuarchive.org/mlp/search/text/marecock/page/44/
(Thread summary posts: should usually be multiple post summarized in one post.)

 >>/10481/
Cont. 2012 track "Suzuko Mimori - Mirai Start (Euro-Senpai Mix)(Odyssey Eurobeat).mp3" is here https://files.catbox.moe/iifghp.mp3 and here magnet:?xt=urn:btih:4ce2cc82c906a383aa418b6a179dd26b25d8e26f&dn=Everfree_Radio_RIP ("wasn't uploaded by Bandpuffs"). 4chan /mlp/ full images torrent has "images that desuarchive doesn't have. It's [from] archive.moe + desuarchive.org + maybe also archive.heinessen.com". Seed it (41081004). Derpy Hooves daughter = Dinky Hooves (41081017). (No MLP thing of www.youtube.com/watch?v=Lm39YkGrHp8 .) Trackerless torrent = can't download all of a torrent for hours?:
> Think it's DHT being odd. There are no trackers on the torrents.
> Making a pone exclusive tracker could be an idea.
Advertisement in Derp'oo + torrent "[2010-2019] My Little Pony FIM S1-S9 + EQG + 2017 movie + specials [DVD ISOs] v1" (41081056). Older qBittorrent = torrent name can't be link-defined, newer = can (41081063). Some more IPFS block/chunk info + a Derpy Hooves clop image looked like Fascist propaganda from Italy (41081075). Pony-related torrent trackers = https://pony.tube/tracker/announce , http://www.ponibooru.org/waterfall/announce.php , udp://tracker.pony.pp.ua:80 , udp://tracker2.pony.pp.ua:80/announce , http://aboutbeautifulgallopinghorsesinthegreenpasture.online:80/announce + more on said propaganda/building (41081087). More fails:
> Another fun thing is some peers are exclusively IPv6, most are IPv4 only. Also clients can be choked or using IP ban lists.
Release of what I could call
> [2010-2019] My Little Pony FIM S1-S9 + EQG + 2017 movie + specials [DVD ISOs] v2
at
> https://desuarchive.org/mlp/thread/41078194/#41081504
> magnet:?xt=urn:btih:dd8fcc2c697e4797f46a17e8f654bbc739fe7b1a&dn=MLP%20DVDs%20v2
Details on that: 41081509, 41081511, ...
 >>/10482/
Cont. v2 torrent: repost, recreate (41081685) and v1 = magnet:?xt=urn:btih:88756d5f383e585c111d794b13e756686b2ce88e . More details:
> ...All of the DVDs have been re-ripped for V2 with all of the Content Scramble System and User operation prohibition have been removed to ensure compatibility. I have also double-checked to make sure that any coloring sheet PDFs and other bonus PDFs are included. This means they are not going to be byte-by-byte identical.
Paragraph-post:
> https://desuarchive.org/mlp/thread/41078194/#41082442
> Alright, that's admirable, polishing the files and releasing new versions - initially I thought you just pooled a bunch of isos ... curated index of ... ponies
Reply:
>  >If you really want a good MLP 4k, train a model on MLP style flash assets rendered at 1080p and 4k.
> I think that’s what loyaldk was doing. It was using the leaked flash assets for training.
Duplication, indexing (41082863). Index created with links for updates (41083039). Probable shutdown (41083223):
> ...Last chance to get loginwalled clop.booru.org parts and anything else. Booru.org and sites under its control has a terrible history of deletions. Here's the latest deletion: everything that isn't some popular-ish advertisement farm porn booru.
unable to quickly download it due to server-side limits (41083312). "the whole site isn't CF-blocked" - unlike what they did with one of their sites in the past. Grabbing it (41084636). HDDs, best practices - read it! https://desuarchive.org/mlp/thread/41078194/#41084997 + next post.

----

 >>/10463/
 >>/10464/
After more observations, looks like the opposite is closer to the truth, so:
> 4chan derives like every single image that I post. This is bad and is worse than what Endchan does.
Uploading a PNG: very likely that it will be modified. JPG: maybe less likely, but still quite likely. GIF: least likely.
Neat, "many" posts summarized in an inline way:

 >>/10483/
Cont. Accessing CAR files in 4chan-mlp: "$ ipfs dag import --stats filename_here" (then also run a maybe unnecessary "$ ipfs pin add cid_here" command). Derpib'u description markup is shit with literal percent signs (41085290). Pink pony (41085296, 41085340). MLP bitmap upscale vs. flash upscale (41085297). Video vectors, upscales (41085307). De'o deleted post, redundancy, ideal form (41085376, 41085383). Skipped (41085390). 4chan dodging adblockers, non-deterministic webpage (41085412). Can't reverse search a video file, unlike an image file; CF+4chan crap; link to https://derpibooru.org/images/3228316?q=anime+opening (41085491). Nazi Glimmy, thoughts (41085496, 41085518). Other method, more on that later in the thread (41085520). "v3 torrent", looking for DVDs (41086087). Permabanned off of MemoryHoleBooruPonyEdition (41086734) due to sharing a magnet link there. Data deleted and scrubbed off of derpibooru.org (41086771). More Derpibooru idiocy, idea (41086796). De'oru system/janny IP address tracked or recorded (41086996 + next 2 posts) = "colocation center in Amsterdam". Comparing uptimes for similar torrents (41087365). Ponybooru nonissue, music (41087393). Captcha on basically all pony boorus, so make an account with a crappy email address or don't bother trusting some site with your login creds (41087402). Workflow before and after getting banned (41087415). Simple software development (41087438 + next 5 posts). Thread meta (41087548, 41087567, 41087601). Software dev (41087567). Put it in ~/.bashrc (41087620). "Important posts" (41087632). Broken packages/whatever (41087640). Other method to deal with CAR files, how to install go-car: https://desuarchive.org/mlp/thread/41078194/#41087700 . go-car: extract files, cids/blocks (41087732, 41087740). Sharing, "Dunno why upload/download speeds become slow if you run qBittorrent for a 'long time'." (41087755). "That's one of the plans for V3 on both the box art and disc scans. I am able to make scans at 600 DPI. The file sizes are about 20MB for each." (41088372). 

 >>/10479/
Name of that track which plays around 00:14:40 and 00:18:18?
About one forth of that thread has been summarized (read the thread itself for details).

 >>/10484/
"I scanned hundreds/thousands of things and should have the files to prove it. \\  >>/41088372/ \ Cool. Unless I was in a rush, I scanned at 1200 DPI, and I never really thought if that was needlessly too big for CYMK prints." (41089006). Binary (41089037). arousedpony.booru.org was downloaded, among other subdomains; Brave adblock thing didn't work well (41089469). Meme (41089497). Deleted 4chan images, post (41089517). 4chan wordfilters "tbh" to "desu"; "old" site thebronybase.booru.org (41089542).
thumbnail of 5B9BB3D5-01FE-4B8A-850C-59AF27DCBCF1.jpeg
thumbnail of 5B9BB3D5-01FE-4B8A-850C-59AF27DCBCF1.jpeg
5B9BB3D5-01FE-4B8A-85... jpeg
(69.98 KB, 850x582)
thumbnail of DD4A21C3-E165-45A3-8112-AA256B6FCD6E.png
thumbnail of DD4A21C3-E165-45A3-8112-AA256B6FCD6E.png
DD4A21C3-E... png
(450.39 KB, 750x1334)
I clicked on this MLP AI-related ad:
search=mare -> https://rule34.xxx/index.php?page=post&s=view&id=10436093 -> "Fuck Your Pony" ( https://files.catbox.moe/o9i6m9.png ) -> https://www.nsfwlover.com/

 >>/10485/
Cont., this time seeing if https://chat-gpt.org/chat can summarize it -> it did OK, but made some mistakes. Not ai text:

With *.booru.org, If not linked on the homepage, custom counter images are not linked/embedded anywhere on the site, like this one: https://thebronybase.booru.org/counter/2.gif . The Brony Base uses the same counter images as pbooru.com did when it was still live. Thread meta. Grabbing thebronybase.booru.org in 2024-05-18: "an 800 ms delay resulted in HTTP errors, so back to a 900 millisecond delay." Posts about some images in thebronybase. Ai text (1 fix by me):
> The text describes 4,434 .info.json files containing comments on mostly MLP videos, with 99% not in TPA. [Bundled by go-car, download it by that link]. Two specific files are highlighted, each containing comments on different MLP videos. The text also mentions previous sharing of download links for tens of thousands of YouTube IDs that were commented on in the past.
No ai text: download links for those comments on MLP YT videos. Why that effort by me pretty much ended. Could not upload a small Gzipped CAR file to https://catbox.moe/ . ML summary for the next 4 "dense" posts was overly general:
> The text discusses archiving YouTube comments and videos, sharing links to download data files, and technical issues related to accessing and organizing the archived content. YouTube's API changes are mentioned, as well as plans to make pony-related content public once updated data is received.
thumbnail of C60331EB-B3DA-4237-BE0D-5E0B04312FEF.png
thumbnail of C60331EB-B3DA-4237-BE0D-5E0B04312FEF.png
C60331EB-B3DA-4237-BE... png
(302.91 KB, 1334x750)
 >>/10487/
> image
Meant to post picrel instead.

> summary to vague
Could ask it for a more detailed summary.

Cont. "I (hobune) also archived a lot of comments (1m+ videos), I'm hoping to make the pony ones public once the next tpa hobune index update happens (waiting for Zizzy to get me the tpa data for that)." Didn't easily have the root CID for said effort of mine, but do have some info on it.
 >>/10488/
*too vague

Cont. About a "broken" script and updates to websites and indices, just read it https://desuarchive.org/mlp/thread/41078194/#41092103 and the next post. Next:
> I can confirm the decline of it. In the past, grab-site could be used to download *.booru.org boorus with zero delay; now you have to download them with an 900 ms delay and a concurrency of 1 in order to avoid HTTP errors.
Next: can no longer download a chat log as .md, .png, or anything from chat-gpt.org/chat (button="Save"). Therefore here's that summary without that LLM website's stupid markup (copy+paste didn't capture it):
https://paste.ononoki.org/?4e503d9479a09880#DnyGf6E2bPhCJn8xtsobJwQP21n2xr6u3wCR7GXJt48n
> It's kinda eerie to read The Brony Base forums and comments: artifacts of a small web culture that disappeared years ago
thumbnail of 0e4e04e2ff6bf9718211aa1127ac63824949f1c5.png
thumbnail of 0e4e04e2ff6bf9718211aa1127ac63824949f1c5.png
0e4e04e2ff6bf9718211a... png
(2.9 MB, 2833x1687)
thumbnail of f1571b967b023452544c5a416c7c25ca383dbd5f.png
thumbnail of f1571b967b023452544c5a416c7c25ca383dbd5f.png
f1571b967b023452544c5... png
(398.42 KB, 640x480)
thumbnail of 70feffa921a060d467305608b5ae13c42a5287d2.jpg
thumbnail of 70feffa921a060d467305608b5ae13c42a5287d2.jpg
70feffa921a060d467... jpg
(40.8 KB, 400x450)
thumbnail of Sunshine_and_Celery_Stalks-Matt_R-20111013-youtube-1280x720-cP0f5rvVkAU.webm
thumbnail of Sunshine_and_Celery_Stalks-Matt_R-20111013-youtube-1280x720-cP0f5rvVkAU.webm
Sunshine_and_Celery_S... webm
(16.46 MB, 1280x720 vp9)
 >>/10429/
I'm continuing to download *.booru.org as WARCs - running this command:
https://gateway.pinata.cloud/ipfs/bafkreiacfh2tpknkgdljaxvexep7wmvlkoor45fobvuqzu6hd7axe3mcgi

Subdomains to be downloaded: randomness, memebooru, and maybe hundreds more. These images are from
> https://randomness.booru.org/index.php?page=post&s=view&id=4200 - MLP
> https://memebooru.booru.org/index.php?page=post&s=view&id=113 - non-MLP animated horse
> https://memebooru.booru.org/index.php?page=post&s=view&id=71 - non-MLP animated horse

 >>/10484/
> qBittorrent
That program kinda sucks sometimes; example:
> Using Konsole in i3 in Ubuntu
> $ cd; ./qbittorrent-4.6.0_x86_64.AppImage &disown
> I enter a command to run
> I press enter 0.08 seconds after a qBittorrent window comes up which says something like "Loading torrents [Quit]"
> Instead of running the command (what I wanted to do), I hit enter on the Exit/Quit button on the in-focus qBittorrent window
> qBittorrent is now stuck in limbo for like 30 minutes or hour(s): can't kill that PID, can't start up qBittorrent
So that was lame, and this is one of multiple times that I had that problem happen. What isn't lame: when running IPFS+daemon in "read-only" mode, I can still update my IPNS name and run it as FUSE-mounted. That would be: "ipfs daemon --mount &" and:
> $ ipfs name resolve
> /ipfs/QmUNLLsPACCz1vLxQVkXqqLX5R1X345qqfHbsf67hvA3Nn
> $ ipfs name publish $cid
> Published to k51qzi5uqu5dimsp1668a2p0txmglucmvn9jc5nhyxiw0jfcd4yxjw3s86dodn: /ipfs/bafybeifdw3oaaxcdfv5w3zxd4k7btczdcqq75562b3foosfhntspchbbnq
> $ # QmUN...A3Nn = empty folder
Popular video from
> file:///ipfs/bafybeifdw3oaaxcdfv5w3zxd4k7btczdcqq75562b3foosfhntspchbbnq/video/youtube/channelname_channelid/Matt_R_UCmkLCc8ovB3F1CZBgxqKN5w/Sunshine_and_Celery_Stalks-Matt_R-20111013-youtube-1280x720-cP0f5rvVkAU.webm
thumbnail of 717mhrXpbiL.jpg
thumbnail of 717mhrXpbiL.jpg
717mhrXpbiL jpg
(138.08 KB, 1000x1000)
thumbnail of twibooru-1159663.png
thumbnail of twibooru-1159663.png
twibooru-11... png
(1.47 MB, 5369x8065)
 >>/10490/
>  >qBittorrent is now stuck in limbo for like 30 minutes or hour(s): ...
After 30 minutes or an hour, the qBittorrent icon disappeared from the i3 system tray. Still not working... so probably hour(s) on getting it to work again. I can confirm that it's possible to do this: set the save path of a torrent to FUSE-mounted-IPFS path "/ipfs/[CID]". If you have a crappy computer, qBittorrent may get OOM'd before rechecking a ~480-GB torrent, but you can probably recheck a significantly smaller torrent.

> long link to *Sunshine_and_Celery_Stalks*
Resolved link:
file:///ipfs/bafybeibu4fabjz6q7x472ey5sdbyxlwxohl3vxrdhhfdscaahy74gitqdi

That's an Applejack-focused video with music. Maybe in the past someone said that Applejack is "white trash" or "pone trash". Maybe "redneck" is a racial slur. (Brave browser: "reqeck"=red underline, spelling suggestion="redneck"; "nigger" and "kike"=no red underline; "niggr"=underline, suggestion="niggler"; "gookk"=underline+suggestion="gook"; "kikee"=underline+suggestion="kike". So, Brave/Chrome gives spelling suggestions for some but not all racial slurs.) More on that video file: Pinata now emits CAR files, which is something that it didn't used to do one or more months ago. Nice update; proof:
> https://gateway.pinata.cloud/ipfs/bafybeibu4fabjz6q7x472ey5sdbyxlwxohl3vxrdhhfdscaahy74gitqdi?format=car
Quirk/bug - should show up as "17258731,16M,video/webm" here:
> https://gateway.pinata.cloud/ipfs/bafybeibu4fabjz6q7x472ey5sdbyxlwxohl3vxrdhhfdscaahy74gitqdi
but it instead also shows up as "unspecified,[17265372],application/vnd.ipld.car".

P.S. WBM hasn't been working well over the past hours. Images:
> https://www.amazon.com/Pinkie-Little-Pony-Pinata-String/dp/B00427H776 -> https://m.media-amazon.com/images/I/717mhrXpbiL.jpg
thumbnail of Call_Me_Maybe_-_Twixie_PMV-Vitoria_Fumo-20230811-youtube-1280x720-7UZUf-eZYu8.mkv
thumbnail of Call_Me_Maybe_-_Twixie_PMV-Vitoria_Fumo-20230811-youtube-1280x720-7UZUf-eZYu8.mkv
Call_Me_Ma... mkv
(23.4 MB, 0x0 h264)
thumbnail of Channel_Trailer_lol_+_Patreon-SinclairDuGore-20230921-youtube-1920x1076-mDriGv6bhyU.mkv
thumbnail of Channel_Trailer_lol_+_Patreon-SinclairDuGore-20230921-youtube-1920x1076-mDriGv6bhyU.mkv
Channel_Tr... mkv
(3.6 MB, 0x0 h264)
 >>/10465/
> Step 3=TODO (redundancy+share)
Share=Done. More redundancy=TODO. Vitoria_Fumo_UCiuinS6t_wUf1f_nZ7A9Q9w is in this folder:
https://gateway.pinata.cloud/ipfs/bafybeia7namsdqdb7wdvdj4kkafqlowmk6rrusem5dsz5attc6gmnrtysy

Sometime yesterday, I saw that I could upload IPFS data at a speed of 11MB/s:
> $ ipfs stats bw
> [RateOut: 11 MB/s]
However, I think that was mainly/only local xfr (over LAN), so it doesn't really count.

In the previous thread there was a post about using Apache's Common Gateway Interface (CGI). Better info, since that was missing important details:
1. Run "sudo a2enmod cgi" or "sudo a2enmod cgid"
2. Check that you have CGI:
> $ grep -R LoadModule /etc/apache2 | grep mod_cgi[...]
3. Find where to put the scripts for Apache:
> $ grep cgi-bin /etc/apache2/conf-available/serve-cgi-bin.conf[...]
4. Make sure that the script is executable: run "chmod +x a.sh".
5. Must have "Content-type: text/html" ( https://piped.smnz.de/watch?v=Jzcu4JheCtY ):
> $ sudo cat /usr/lib/cgi-bin/a.sh
> #!/bin/bash
> echo "Content-type: text/html"
> echo ""
> echo "Hello world"
6. Not needed I guess - in "/etc/apache2/apache2.conf":[...]
Full text at:
>  https://araoai.com/aTrAvPNv8qcOV&#95;u7sHqGSIRDmIarao9cq-0G0OTmPl4
>  ipfs://bafkreie3av5tzjrkopujgxanwb754ra4ykbmeotojag72ohuz4sz4agfwa
BTW, HPC is down - another thermal shutdown?! :O
thumbnail of 64464641-2A93-4CDC-835A-285AFA484C5D.jpeg
thumbnail of 64464641-2A93-4CDC-835A-285AFA484C5D.jpeg
64464641-2A93-4CDC-83... jpeg
(125.84 KB, 1280x720)
Here's a thumbnail on a video which is otherwise entirely npr (IIRC I watched/listened to all of it in the past):
. https://vid.puffyan.us/vi/dz9kNKw6uzc/maxres.jpg
. https://inv.us.projectsegfau.lt/watch?v=dz9kNKw6uzc
. title="Monero's Fluffy Pony Talks Tech, Human Rights, and Magical Crypto"

JewTube crap:
(1) Anti-reaction content guy
. https://archive.ph/2024.06.18-212928/https://piped.projectsegfau.lt/watch?v=6&#95;7Kpb72zIc
. 'Got error: "Sign in to confirm that you're not a bot"'
(2) song: "Video Games" by Lana Del Rey
. https://vid.puffyan.us/watch?v=cE6wxDqdOV0
. Error="This helps protect our community. Learn more"
(3) title='YouTube "Ad Injections" Are Breaking Ad Blockers'
. https://inv.us.projectsegfau.lt/watch?v=OzKA0UzSo6I
. a comment="I cannot believe they're willing to go this fucking far to show us ads. The hatred I feel for Google is immeasurable."

A nightmare I imagined years ago may soon become reality: advertisements baked into the video file directly. So if you download a YouTube video the resulting file will have 5 ads in it telling you to buy fucking Liberty Mutual Insurance.
thumbnail of 564ED127-02D3-414F-B5D5-006A4250061D.jpeg
thumbnail of 564ED127-02D3-414F-B5D5-006A4250061D.jpeg
564ED127-02D3-414F-B5... jpeg
(4.19 MB, 3016x2898)
2015 video not in TPA - "YTP: My Little Brony - Sexy Mare Pony Is Magic":
https://no-logs.com/watch?v=aCL0WBj6dX0

 >>/10494/
> another thermal shutdown?!
Could initialize it as lowpower. Or renice that PID https://invidious.protokolla.fi/watch?v=ojuTq6V-M6o . Kernel messages showed >600,000 and nearly 700,000 thermal events per message.
thumbnail of DCEB35BD-7699-4DAC-8E8E-7EAC5E093409.webp
thumbnail of DCEB35BD-7699-4DAC-8E8E-7EAC5E093409.webp
DCEB35BD-76... webp
(140 B, 167x250)
Thumbnail failed to generate on this image:
. https://twibooru.org/3150935?q=applejack%2Chumanized%2Cai+generated
. https://twibooru.org/search?q=oc,cum,applejack%2Chumanized%2Cai+generated&filter&#95;id=2

 >>/10496/
> image
Total count is cumulative per CPU.

> renice
Did that in the past, felt like it didn't do anything.
thumbnail of Gravity_Falls_Theme_Song_PMV-Vitoria_Fumo-20240605-youtube-1280x720-80WcK6wbMZg.mp4
thumbnail of Gravity_Falls_Theme_Song_PMV-Vitoria_Fumo-20240605-youtube-1280x720-80WcK6wbMZg.mp4
Gravity_Falls_Theme_S... mp4
(5.55 MB, 1280x720 h264)
 >>/10478/
> merging
Time taken to move 8,095,016 files from one repo to another in the same HDD:
> Sun Jun 16 07:28:35 AM UTC 2024 [to]
> Wed Jun 19 10:49:03 AM UTC 2024
so about 3 days to move those terabyte(s).

 >>/10494/
> CGI with apache2
I can run .sh and .py scripts at [...]/cgi-bin/[...]. However, this Python thing doesn't work:
> https://pypi.org/project/IPFS-Toolkit/ / ipns://k2k4r8nismm5mmgrox2fci816xvj4l4cudnuc55gkfoealjuiaexbsup/
> sudo pip install IPFS-Toolkit
I wanted to have a thing that I could use anywhere on my LAN (on any device) to archive webpages and whatever, especially because WBM has been sucking all of yesterday and today (see also  >>/10491/).

 >>/10496/
> $ ipfs init --profile=lowpower
Done:
> ipfs://bafkreidikf32qagr5ypcwgi52mam3imnzkmauoy7ad6akofyiuzzzbuy2e
> https://sooneraydin.xyz/BMmM2VuhHUXJ5G9X3XQTGViypy&#95;HTfuyUu4U8dLlWnI
Could do this: disable password-based auth after enabling key-based authentication.

 >>/10497/
> image
(140-byte image attached to that post = the thumbnail that failed to generate for said image.)
> felt like it didn't do anything
(on a different computer)

Video:
> /ipfs/bafybeia7namsdqdb7wdvdj4kkafqlowmk6rrusem5dsz5attc6gmnrtysy/Vitoria_Fumo_UCiuinS6t_wUf1f_nZ7A9Q9w/Gravity_Falls_Theme_Song_PMV-Vitoria_Fumo-20240605-youtube-1280x720-80WcK6wbMZg.mp4
I basically never watched "Gravity Falls".
thumbnail of 1378021634969.jpg
thumbnail of 1378021634969.jpg
1378021634969 jpg
(80.62 KB, 930x858)
 >>/10498/
> I wanted to have a thing that I could use anywhere on my LAN (on any device) to archive webpages and whatever...
That's needed to have an archive-focused thing which I control instead of it being so remote and centralized. Struggles with that below:

> However, this Python thing doesn't work:
>  >https://pypi.org/project/IPFS-Toolkit/
That, and/or my HTTP API at /ip4/127.0.0.1/tcp/5001 doesn't work well:
> $ curl http://127.0.0.1:5001/api/v0/swarm/peers
> 405 - Method Not Allowed
> $ # WebUI at http://127.0.0.1:5001/webui -> http://127.0.0.1:5001/ipfs/bafybeiamycmd52xvg6k3nzr6z3n33de6a2teyhquhj4kspdtnvetnkrfim/
More/important info:
>  https://ethereum.stackexchange.com/questions/4531/how-to-add-a-file-to-ipfs-using-the-api
>  https://github.com/ipfs-shipyard/py-ipfs-http-client/issues/303

Error with Python thing "ipfs_api":
>  $ python3
>  Python 3.10.4 (main, Apr  2 2022, 09:04:19) [GCC 11.2.0] on linux
>  Type "help", "copyright", "credits" or "license" for more information.
>  >>> import ipfs_api
>  >>> print(ipfs_api.my_id()) # print your IPFS peer ID
>  [bunch of errors, both with ipfs online and with it offline - such as "ConnectionRefusedError: [Errno 111] Connection refused"]

Other than those two, with just using CGI, www-data got permission denied even on a file with 777 (chmod, 0777/*rwxrwxrwx); that file is needed to run it. Maybe related: https://superuser.com/questions/835779/allowing-another-user-to-execute-program (Also, 777 is a bit dangerous because it give "total access to everyone"). This funny/weird image is
> file:///ipfs/bafybeifoniioydbdstmupn2jor3fzdc2vptkbzfboj7maeuikwpmnz4vgq/02/1378021634969.jpg
2024 video not in TPA - '"Club Rave" UNDERTALE - Bonetrousle (vinyl scratch/mlp mix)':
https://inv.us.projectsegfau.lt/watch?v=VK6xkfv3K5U

Seen in this ~750K list of music:
https://tilde.town/&#126;severak/allsotds.txt

 >>/10445/
When? No redirect:
. 19 May 2024 11:18 UTC https://cloudflare-ipfs.com/ipfs/Qmazvovg6Sic3m9igZMKoAPjkiVZsvbWWc8ZvgjjK1qMss/sketches/run&#95;a&#95;gateway.html
. 27 May 2024 04:33:37 UTC Portal Access https://cloudflare-ipfs.com/ipfs/bafybeih fatolfrcxokn6fbzjc3knwtj6x7k5ls43wvd2igs4pjkslun3lq/websecuremail.htm [probably a scam]

Redirect:
. 28 May 2024 05:15:55 UTC https://cloudflare-ipfs.com/ipfs/bafybeihskayspgje556cukubxkun5e7gcrl3vlataimdnbk5xchayik22u [from Chinese MLP music group/individual]
. 6 Jun 2024 08:45 Library Genesis IPFS https://cloudflare-ipfs.com/ipfs/bafybeifaxsen4np54stc43phpnn3rh2crxie34d74yki43dultrh4vglqy
. All cloudflare-ipfs.com after that (incl. today) redirects to ipfs.io

Why record this? One of the reasons: those sites are blocked (not excluded) from WBM.
thumbnail of GTA V - My Little Pony Lyra Heartstrings Jester _REVIEW-99zc2KZuaYg.mp4
thumbnail of GTA V - My Little Pony Lyra Heartstrings Jester _REVIEW-99zc2KZuaYg.mp4
GTA V - My Little... mp4
(46.88 MB, 1920x1080 h264)
thumbnail of 84D9DBBB-4122-4969-A0DE-EFDD2BF24993.jpeg
thumbnail of 84D9DBBB-4122-4969-A0DE-EFDD2BF24993.jpeg
84D9DBBB-4122-4969-A0... jpeg
(150.41 KB, 1280x720)
I was watching this 2015 video not in TPA - "GTA V - My Little Pony Lyra Heartstrings Jester _REVIEW" https://invidious.protokolla.fi/watch?v=99zc2KZuaYg - and saw that Invidious and Piped only gave me a crappy =<360p video. So I downloaded a 1080p video-only file and and an audio-only file. I then used someone's code to play them both at the same time in an HTML:
. Video: https://files.catbox.moe/506wg0.mp4
. Audio: https://files.catbox.moe/8abig0.mp4
. Code: slightly fixed version of https://anonoverflow.frontendfriendly.xyz/questions/10806338/html5-get-audio-and-video-started-together
. Html.txt at ipfs://bafkreid7og5dds3iuz3dotgbpydeohbpsf7zopch7kyyrkiebkxgpcq2ma and https://g8way.0rbit.co/Chp-A8RvhoZ-kE1dn9YCclwKjzW6ihfPtOtJVdTvV3g
. Render: https://realtimehtml.com/ (where's that other site?)
 >>/10503/
MP4 with only audio and no video: didn't upload with that post. Attempt #2. ( "Define AI[...]": https://desuarchive.org/g/thread/100591809/#100626872 )
 >>/10504/
 >>/10503/
Failed twice. Can't upload videoless MP4s to Endchan. ("Endchan"? More like "Endchad". Stupid. I'm not funny.)

 >>/10498/
> lowpower
Observations with that:
. Still got some "temperature above threshold" kernel messages
. Fan speed/computer noise seems less intense
. Network propagation seems to be worse
thumbnail of D835B797-25A9-4498-9722-917048FB90C7.gif
thumbnail of D835B797-25A9-4498-9722-917048FB90C7.gif
D835B797-25A9-4498-97... gif
(5.95 MB, 560x560)
thumbnail of 906E59A1-470F-434D-90C3-2B9DEE5EBA1C.gif
thumbnail of 906E59A1-470F-434D-90C3-2B9DEE5EBA1C.gif
906E59A1-470F-434D-90... gif
(5.32 MB, 560x560)
thumbnail of C71B397E-E37F-4DF5-8AC6-682490D268A6.gif
thumbnail of C71B397E-E37F-4DF5-8AC6-682490D268A6.gif
C71B397E-E37F-4DF5-8A... gif
(4.03 MB, 560x560)
I think I downloaded some/all of this channel in the past:
https://web.archive.org/web/20230818031612/https://vid.puffyan.us/channel/UCBMHl8HHFGdBlsRssaZjFoQ/community - GIFs related

Reaction to "Yul Channel" videos from fans who aren't young children: mainly negative (I guess).

 >>/10503/
Forgot to mention this which is relevant for some devices:
. Paste text then download it as a .txt file: https://put.icu/paste/

 >>/10494/
I watched that 1.9GB video, it somewhat reminded me of this movie:
> ipfs://QmWwDWrn1FjSM5dn69rNSePAtQUVCP4Yr7rifeaWtSJurX/American%20Psycho/
thumbnail of 36E8D61C-4115-4183-9B77-9420D0D56DC4.jpeg
thumbnail of 36E8D61C-4115-4183-9B77-9420D0D56DC4.jpeg
36E8D61C-4115-4183-9B... jpeg
(147.77 KB, 1280x720)
 >>/10502/
*6 June 2024 08:45 UTC

(For clarity: 2024-05-28 05:15:55 UTC and after = cloudflare-ipfs.com only redirects to ipfs.io which means that that CF site did less important work.)

 >>/10506/
*from MLP fans who

Users can criticize all they want, but they at least gotta admit that they are original animations.

 >>/10506/
 >>/10507/
Descriptions:
> A fly entered Twilight Sparkle's ear, which lay eggs and hatched Twilight Sparkle middle ear larvae. Watch how the doctor rescued Twilight Sparkle --> See more: https://vid.puffyan.us/watch?v=nXZO7r6rlMg
> Pinkie Pie participates in the challenge of eating a giant bowl of Udon noodles to receive a prize. Can Pinkie Pie complete this challenge? --> See more: https://vid.puffyan.us/watch?v=lDTAgbLWYOg
> Rainbow Dash was on a mission when a virus invaded and made Rainbow Dash sick. Our herbal remedy for Rainbow Dash's flu is not meant to teach you how to do it at home. Hope you enjoy the video --> See more: https://vid.puffyan.us/watch?v=LdoJQLExcA8
Dash in that gif:
:3
> OMG! Rarity's nose and leg hair grows very long. Rarity was so scared, she went to Pinkie Pie's Spa for help. Will Pinkie Pie help Rarity get rid of her nose and leg hair? Watch all of our videos! --> See more: https://vid.puffyan.us/watch?v=&#95;xCT-LJrO&#95;8
> How did Twilight Sparkle bravely fight and defeat Skibidi Toilet? Do you think Spike is not eating properly and what is the lesson for him? Please comment below in the comment section --> See more: https://vid.puffyan.us/watch?v=p5a-t2ViBVE
Post images such as this one and the following to Derpibooru in order to le epicly troll them:
https://vid.puffyan.us/ggpht/Xm5kvto-NXBq6wiojdVtv7RvDtG9d-lByWIY9rKQeu&#95;CZlgZQi2XdRjfWNpJl7kKrECwHGqPgiOPjA=s0

> Audio
It's this nice track - "Culture Code - Electricity (feat. Michael Zhonga) | House | NCS - Copyright Free Music":
https://invidious.private.coffee/watch?v=YDCDemLIUO0
thumbnail of 651090F3-9871-4D2A-A95C-7450F33289BF.png
thumbnail of 651090F3-9871-4D2A-A95C-7450F33289BF.png
651090F3-9871-4D2A-A9... png
(902.59 KB, 1900x1405)
thumbnail of A9B2EAC8-DE9D-4A05-A8B3-9F6E4BD551AB.gif
thumbnail of A9B2EAC8-DE9D-4A05-A8B3-9F6E4BD551AB.gif
A9B2EAC8-DE9D-4A05-A8... gif
(2.01 MB, 960x540)
thumbnail of A8E1BF6A-8A45-4D2E-9219-E30D20BE89BA.png
thumbnail of A8E1BF6A-8A45-4D2E-9219-E30D20BE89BA.png
A8E1BF6A-8A45-4D2E-92... png
(256.46 KB, 1118x666)
 >>/10502/
 >>/10445/
 >>/10367/
 >>/10360/
 >>/10357/
I found this to be relevant (to the posts I'm replying to) and interesting:
. I read 100% of https://annas-blog.org/how-to-run-a-shadow-library.html ( linked from https://hu.annas-archive.org/mirrors )
. I read 50% of https://annas-blog.org/blog-how-to-become-a-pirate-archivist.html
thumbnail of 2024-06-21T07-48-23.438858079Z.png
thumbnail of 2024-06-21T07-48-23.438858079Z.png
2024-06-21T07-48-23.4... png
(56.55 KB, 1366x768)
 >>/10509/
Some of the text:
[page1:]
> [...]Entire books can be written about the why of digital preservation in general, and pirate archivism in particular, but let us give a quick primer for those who are not too familiar. The world is producing more knowledge and culture than ever before, but also more of it is being lost than ever before. Humanity largely entrusts corporations like academic publishers, streaming services, and social media companies with this heritage, and they have often not proven to be great stewards. Check out the documentary Digital Amnesia, or really any talk by Jason Scott. \\ There are some institutions that do a good job archiving as much as they can, but they are bound by the law. As pirates, we are in a unique position to archive collections that they cannot touch, because of copyright enforcement or other restrictions. We can also mirror collections many times over, across the world, thereby increasing the chances of proper preservation.
> [...]The first challenge might be a surprising one. It is not a technical problem, or a legal problem. It is a psychological problem: doing this work in the shadows can be incredibly lonely. Depending on what you're planning to do, and your threat model, you might have to be very careful. On the one end of the spectrum we have people like Alexandra Elbakyan*, the founder of Sci-Hub, who is very open about her activities. But she is at high risk of being arrested if she would visit a western country at this point, and could face decades of prison time. Is that a risk you would be willing to take? We are at the other end of the spectrum; being very careful not to leave any trace, and having strong operational security.
> [...]Better still is to find some fellow pirates. If your close friends are interested in joining you, great! Otherwise, you might be able to find others online. Sadly this is still a niche community. So far we have found only a handful of others who are active in this space. Good starting places seem to be the Library Genesis forums, and r/DataHoarder. The Archive Team also has likeminded individuals, though they operate within the law (even if in some grey areas of the law). The traditional "warez" and pirating scenes also have folks who think in similar ways.
> [more text on "ideas on how to foster community..."]
[page2:]
> [...]System architecture \\ So let’s say that you found some companies that are willing to host your website without shutting you down — let’s call these “freedom-loving providers” 😄. You’ll quickly find that hosting everything with them is rather expensive, so you might want to find some “cheap providers” and do the actual hosting there, proxying through the freedom-loving providers. If you do it right, the cheap providers will never know what you are hosting, and never receive any complaints.
> [...]One somewhat freedom-loving company that has put itself in an interesting position is Cloudflare. They have argued that they are not a hosting provider, but a utility, like an ISP. They are therefore not subject to DMCA or other takedown requests, and forward any requests to your actual hosting provider. They have gone as far as going to court to protect this structure. We can therefore use them as another layer of caching and protection.
> [...]We can also hedge against Cloudflare turning against us, by removing it from one of the domains, such as this separate domain. Different permutations of these ideas are possible.

Can't post SVG here - JS alert()/"endchan.org says" regarding "diagram4.svg":
> A file had a format that is not allowed by the server.
 >>/10510/
> A shadow library
Here's a book from an mlpbooks torrent - first path in sort by ascending:
> ipfs://bafybeiaqw32yaqem3hrx2e2gay3rn3qu26lj272ydhr6dgnkjr3ebcxsoe/Equestria%20Girls%20Series%201-5%20%28ongoing%29/1.%20My%20Little%20Pony%20Equestria%20Girls%20Through%20the%20Mirror%2079p.pdf
Dedication:
> To all the humans who’ve ever
> wondered what it would be like
> to be a pony
Title:
> My Little Pony: Equestria Girls: Through the Mirror
MD5 / SHA1 / SHA256:
> 57210030f19e50652245d9b4efbeffda / c6c7c80d36e1a6f367f5161af906384f5dbef750 / a5b08f6d44ccffe9fd2f220fc98c0758b9e6d2e2d7d6c37de95957645acc9c4e

 >>/10490/
 >>/10491/
I haven't been able to run qbittorrent-4.6.0_x86_64.AppImage for days due to that stupid thing:
>  .f &disown
> [1] 1574956
> $ The legacy data directory '/home/ubuntu/.local/share/data/qBittorrent' is used. It is recommended to move its content to '/home/ubuntu/.local/share/qBittorrent'
> The legacy data directory '/home/ubuntu/.local/share/data/qBittorrent' is used. It is recommended to move its content to '/home/ubuntu/.local/share/qBittorrent'
> $ # It would show that "The legacy data..." message like 5 times total if it worked.
> $ kill 2038177
> $ kill -9 2038177
> $ sudo kill 2038177
> $ sudo kill -9 2038177 # how do I kill it?
> $ ps aux | grep qbit | grep -v grep
> ubuntu 2038177 0.0 0.0 1395400 368 ? Dl Jun17 0:06 /tmp/.mount_qbitto6bDH3r/AppRun.wrapped
> $ stat /tmp/.mount_qbitto6bDH3r/AppRun.wrapped
> stat: cannot statx '/tmp/.mount_qbitto6bDH3r/AppRun.wrapped': No such file or directory
> $ # ls -a /tmp | grep mount = nothing
thumbnail of 57210030f19e50652245d9b4efbeffda-g.jpg
thumbnail of 57210030f19e50652245d9b4efbeffda-g.jpg
57210030f19e... jpg
(33.89 KB, 353x500)
 >>/10511/
"> .f &disown" = originally >$ ./$f &disown
Searches:
. "title search": https://libgen.is/search.php?req=pony&lg&#95;topic=libgen&open=0&view=simple&res=25&phrase=1&column=def
.. https://libgen.is/book/index.php?md5=6A00A16F22BDEA1C533CA081534FD67D
. MD5 search: https://libgen.is/search.php?req=6a00a16f22bdea1c533ca081534fd67d&open=0&res=25&view=simple&phrase=1&column=md5
.. libgen.is/book/index.php?md5=6A00A16F22BDEA1C533CA081534FD67D
. https://libgen.is/search.php?req=57210030f19e50652245d9b4efbeffda&open=0&res=25&view=simple&phrase=1&column=md5
.. no results for that MLP: EQG: Through the Mirror book, so upload that fiction at https://libgen.is/foreignfiction/librarian/
... https://library.bz/fiction/upload/#user:genesis&#95;pass:upload

At https://library.bz/fiction/uploads/new/57210030F19E50652245D9B4EFBEFFDA :
> Title=My Little Pony: Equestria Girls: Through the Mirror
> Author(s) or editor(s)=G. M. Berrow
> Language=English
> ISBN (ISBN-10 / ISBN-13, comma-separated)=9780316247610
> Cover image URL=57210030f19e50652245d9b4efbeffda-g.jpg
> Year=2013
> Publisher=Little, Brown and Company
> Description="First ebook edition: October 2013". This book was " Distributed by http://yayponies.eu " and has this inserted text: "PDF & Mobipocket version may be slightly different than the EPUB edition as this is a conversion of an original EPUB file", "", "Here was some copyright warning, but I do what I want cause a pirate is free !"
> Commentary=Bootleg version I guess
> Source repository/collection=magnet:?xt=urn:btih:47a39a5a3817bc6f33f069c924a33509e85fb311&dn=My%20Little%20Pony%20book%20collection%20v2
> Format specific metadata={Title=My Little Pony \ Author=G. M. Berrow \ Creator=Writer \ Producer=LibreOffice 4.0 \ CreationDate=Mon Oct 14 14:47:17 2013 UTC \ JavaScript=no \ Pages=79 \ Encrypted=no \ Optimized=no \ PDF version=1.4} \ Extracted content identifiers (1)=ISBN 978-0-316-24761-0 → 9780316247610 \ Original filename=1. My Little Pony Equestria Girls Through the Mirror 79p.pdf \ Filesize=2104020 bytes / 2.01 Mb \ Format=PDF \ Checksums/hashes={MD5 57210030F19E50652245D9B4EFBEFFDA \ CRC32 853972E8 \ SHA-1 C6C7C80D36E1A6F367F5161AF906384F5DBEF750 \ SHA-256 A5B08F6D44CCFFE9FD2F220FC98C0758B9E6D2E2D7D6C37DE95957645ACC9C4E \ BTIH 3E13490A2E266092FAD36DD59E37C059E9320F3B \ TTH QLC4RZFGXPSYC5FLCH6WOOXNHUTCNYXH3ZHWTIQ \ eD2k 2790FC48B398BF346F43E93792053793 \ AICH DB5QUDDSFGGO7Z365BUAM6BCYARMSAA5}
Error="Source repository/collection → value length exceeds the maximum allowed (50)", so:
> Source repository/collection=torrent: 47a39a5a3817bc6f33f069c924a33509e85fb311
Next = https://library.bz/fiction/uploads/edit/57210030F19E50652245D9B4EFBEFFDA/done =
> [...]The record has been successfully saved.
> Go to the upload page [ https://library.bz/fiction/upload/ ]
> Edit the record again [ https://library.bz/fiction/uploads/edit/57210030F19E50652245D9B4EFBEFFDA ]
> An upload link to share: https://library.bz/fiction/uploads/57210030F19E50652245D9B4EFBEFFDA
"" didn't work well in its markup so I changed it to be " "[Removed" and "this>" -> "this]". More info at https://library.bz/fiction/uploads/edit/57210030F19E50652245D9B4EFBEFFDA =
> Record added=2024-06-21 08:33:52 UTC
> Record modified=2024-06-21 08:36:18 UTC
That page also says:
> MD5 hash of a better version __
> File is banned [ ]
So maybe you can get banned files in library.bz. I guess Library Genesis sometimes bans derived files in favor of the original files: such as PDFEPUB conversions.

This image is https://library.bz/uploads/fiction/57210030f19e50652245d9b4efbeffda-g.jpg - nearby =
> Download: [ from the upload queue ] [ https://library.bz/uploads/fiction/57210030f19e50652245d9b4efbeffda.pdf ]
 >>/10512/
> ~2nd time uploading to LibGen
First time = about year(s) ago
> x = originally y
(Due to markup)

There's various other MLP books that could be uploaded to LibGen. A non-bad thing about centralization or centralized indexes: can "find everything" in one place (that applies to booru websites too.) You can "find everything" in decentralized things too, so sometimes decentralized things "have everything" and centralized things don't (and sometimes it's the other way around). Both can pull from the other, and both have limitations.

That MLP book may show up here later on:
> https://libgen.is/book/index.php?md5=57210030F19E50652245D9B4EFBEFFDA
It's a "YP bootleg" version with specific text which the original .epub doesn't have. So it isn't a simple conversion and the original vs. that version = two different versions of that book.

> So maybe you can get banned files in library.bz. I guess Library Genesis sometimes bans derived files in favor of the original files: such as PDFEPUB conversions.
I have/had some books on chess where the ebook MD5s showed up in LibGen as available there. Other MD5s in that set showed up as banned files in LibGen. So I could learn more on this topic in the future maybe.
Fappable GIF not in D'p'u:
https://endchan.org/.media/f43852401a4cae0c07dffe67cdb91b5c-imagegif.gif

Video in TPA - "Rarity Plays: GTA V (MLP in real life)":
https://invidious.protokolla.fi/watch?v=6Y7j4j0HC38

Nice software - use on mobile with Desuarchive or something:
https://github.com/emn178/online-tools/zipball/master
https://github.com/hczhcz/2048/zipball/master

It was maybe too hot in Ponyville on this day:
https://web.archive.org/web/20230903082912/https://wttr.in/ponyville

Weather in PonyTown:
https://archive.ph/2024.06.21-052733/https://wttr.in/ponytown
> Sorry, we processed more than 1M requests today and we ran out of our datasource capacity.
> We hope to solve the problem as soon as possible, so you can enjoy
> your favourite weather service 24x365 even if it rains or snows.

New redirect on http://archive.fail/ ( not https://archive.fail/ ). Previous redirect=thoughts on archives.
thumbnail of 85CE391E-1DC0-468C-B43C-FCEE8DF50CDC.png
thumbnail of 85CE391E-1DC0-468C-B43C-FCEE8DF50CDC.png
85CE391E-1DC0-468C-B4... png
(46.86 KB, 1920x1833)
https://fusion.ponyar.net/ =
> This website fusion.ponyar.net/ is currently offline. Cloudflare's Always Online™ shows a snapshot of this web page from the Internet Archive's Wayback Machine. To check for the live version, click Refresh.
also
> Invalid SSL certificate Error code 526
and
> https://github.com/Tailszefox/Pony-Fusion/zipball/master

 >>/10514/
> archive.fail
Was:
> https://twitter.com/footage/status/562666114895728641 The "archive" is overtheorized; "archives" (where the labor of record keeping takes place) are undertheorized and underfunded. #archives RETWEETS 178 FAVORITES 204 | 9:37 AM - 3 Feb 2015
Now is:
> https://mediarep.org/server/api/core/bitstreams/08dea680-7e16-4059-9c69-9ad3a3a54a72/content Archives of Inconvenience by Rick Prelinger
About 2 months ago I pointed out that an 18-TB HDD of mine got stuck as read-only due to a nonexistent/bad UPS setup. This had horrible consequences later on, but I don't want to dwell on that right now. Instead, here's a positive thing. Couldn't access or was too dumb to access MFS root when it was RO, but after copying it all to another hundreds-of-dollars RW HDD I can access that root:
> $ ipfs files ls --long /
> a/ QmTUvjfyQDvkDnKKGHtXK5gtaNHbRD4TRrg3LAq4TtcJ8S 0
> tmp/ QmYJXAS9Myh2fKJRF269vHB6hiPmQnX8SkBi36ZFoyayLt 0
> $ echo $IPFS_PATH
> /zc/ipfs
> $ # like 9 terabytes in above CIDs

 >>/10461/
> When did 4chan remove the "posters in this thread" count?
Around this time - There:
https://archive.ph/2024.03.07-110725/https://boards.4chan.org/mlp/thread/40805318

Not there (relevant to Endpone /culture/ thread):
https://archive.ph/2024.03.14-200958/https://boards.4chan.org/mlp/thread/40894867

 >>/10503/
> catbox version on deterministic youtube-99zc2KZuaYg
Total Jenny Death version:
https://bafybeih4jcpq4eurrhavhjzeoccecmn6ujaqnsiji6kkgtbpv6dbjtmfmy.ipfs2.eth.limo/
Wayback Machine was not working very well for days. You could only see a new snapshot a day or two after it was created. That was the case 6 or 12 hours ago. That stopped being the case <6 hours ago. One thing to prove that is that I can see this idiotic Wikipedia page that wasn't capture ever before me requesting that within this hour ("first archive"):
https://web.archive.org/web/20240622120753/https://en.wikipedia.org/wiki/Good&#95;guy&#95;with&#95;a&#95;gun

over the years I have seen various cases of WBM not working well, and like all of them have one thing in common: happens when they are pushing an ad campaign (specifically, ads telling you to donate to them). Happened in this case too; I guess rewriting millions of pages temporarily took its toll on other parts of that website. 

I was programming and researching warc-based alternatives to WBM that could be used anywhere on a LAN, and the best I saw seemed to be Apache Guacamole:
https://inv.tux.pizza/watch?v=LWdxhZyHT&#95;8 ("Meet Guacamole, Your Remote Access Gateway") - should enable me to ssh over a webpage so I can do stuff

Use the openssl program to get a self-signed certificate - otherwise your LAN IP addresses communicating won't be happening in an encrypted way:
https://inv.tux.pizza/watch?v=7KHEmFJv4VE
https://inv.tux.pizza/watch?v=zwaYgSjA4JY
Will show an HTTPS error because the key/whatever is selfsigned, but that's fine. ( next level = https://inv.tux.pizza/watch?v=qlcVx-k-02E )
thumbnail of owl_babs.png
thumbnail of owl_babs.png
owl_babs png
(33.22 KB, 1920x1812)
 >>/10515/
> Pony Fusion site is down [ https://archive.ph/nlzfQ , no longer the case ]
If that "zipball" has no server-side code then that can easily be rehosted. (Other things to check with github: releases, branches, git history, issues, etc.) It does have server code: https://github.com/Tailszefox/Pony-Fusion says "PHP 60.0%, CSS 20.0%, JavaScript 20.0%". Images aren't in that git(?): https://github.com/Tailszefox/Pony-Fusion/blob/master/ponies.php - at https://fusion.ponyar.net/cache/owl&#95;babs.png
> The only OC allowed = ./faust.png

 >>/10501/
> py-ipfs-http-client
This has limited (not zero) functionality with newer versions. "Python IPFS HTTP Client’s documentation!":
ipns://12D3KooWEqnTdgqHnkkwarSrJjeMP2ZJiADWLYADaNvUb6SQNyPF/docs/

Site /ipns/12D3KooWEqnTdgqHnkkwarSrJjeMP2ZJiADWLYADaNvUb6SQNyPF resolves to /ipns/k51qzi5uqu5di1knhs90ve8esub5rpoouh7t8n0pcch7dhmkqrgzo8zqx0x2te/ which resolves to /ipfs/QmSfSEXrkYzsLz4adKJzVe9zj8dT8V6X9rkXdXCenV35pQ (63 blocks from 16,60,059 bytes) ~today. Add string or bytes method -- 'client.add_bytes(b"Mary had a little lamb")' ( https://gateway.ipfs.cybernode.ai/ipns/k51qzi5uqu5di1knhs90ve8esub5rpoouh7t8n0pcch7dhmkqrgzo8zqx0x2te/docs/genindex.html ) -- didn't work well, but this did work:
> $ python3 -c "import ipfshttpclient; client = ipfshttpclient.connect(); a = client.cat('QmWxS5aNTFEc9XbMX1ASvLET1zrqEaTssqt33rVZQCQb22'); print(str(a))"
> /home/ubuntu/.local/lib/python3.10/site-packages/ipfshttpclient/client/init.py:75: VersionMismatch: Unsupported daemon version '0.23.0' (not in range: 0.5.0 ≤ …   warnings.warn(exceptions.VersionMismatch(version, minimum, maximum))
> b'fdsafkljdskafjaksdjf\n'
> $ # I could also get " $ lynx -dump http://10.1.2.3/cgi-bin/test.py " = "b'fdsafkljdskafjaksdjf\n'"
thumbnail of golden_octavia.png
thumbnail of golden_octavia.png
golden_octavia png
(47.67 KB, 1920x2194)
thumbnail of octavia_golden.png
thumbnail of octavia_golden.png
octavia_golden png
(46.56 KB, 1920x1864)
 >>/10518/
> docs
IPNS 403 Forbidden in this gateway:
https://ipfs.desmos.network/ipns/k51qzi5uqu5di1knhs90ve8esub5rpoouh7t8n0pcch7dhmkqrgzo8zqx0x2te/ (and at ./../)

> underlined
ipfshttpclient/client/init
Images:
https://fusion.ponyar.net/cache/golden&#95;octavia.png
https://fusion.ponyar.net/cache/octavia&#95;golden.png
thumbnail of starlight_starlight2.png
thumbnail of starlight_starlight2.png
starlight_s... png
(66.83 KB, 1920x2862)
thumbnail of starlight2_starlight.png
thumbnail of starlight2_starlight.png
starlight2_... png
(67.77 KB, 1920x2862)
thumbnail of starlight_trixie.png
thumbnail of starlight_trixie.png
starlight_t... png
(60.28 KB, 1920x2862)
thumbnail of starlight2_trixie.png
thumbnail of starlight2_trixie.png
starlight2_... png
(61.21 KB, 1920x2862)
thumbnail of starlight_starlight.png
thumbnail of starlight_starlight.png
starlight_s... png
(66.83 KB, 1920x2862)
 >>/10498/
Forgot to do this before moving: check MFS. Can't do that now, but I think I didn't have any unrecorded CIDs in there:
> ...

 >>/10518/
Not sure why that has to be partly written in PHP. I think that could be written entirely with client-side code.

 >>/10519/
Permutations: two slots, each one is one of 52, so 2^52 or 52^2. So if you have a bike lock, 4 slots and each one is 10 combinations 0-9, then that's 10^4=10,000 from 0000 to 9999. That's {combinations per slot}^{slots}. So it would be 52^2 = 2,704 different pony fusion images based on that GitHub (not 2^52 obviously, because that's 4,503,599,627,370,496). 52 spaces in the below line:
>  twilight rarity applejack rainbow flutter pinkie spike sweetie scoot abloom babs celestia luna cadence twilight_p bigmac shining blueblood braeburn fancy zecora nmm chrys sombra lightning sunset trixie gilda discord Dolores Dolores2 diamond silver cheerilee granny spitfire fleur bonbon lyra derpy doctor golden octavia vinyl vinyl2 angel opal gummy owl tank winona faust
 >>/10520/
> Forgot to do this before moving: check MFS. Can't do that now, but I think I didn't have any unrecorded CIDs in there:
>  >...
Got this error due to many missing .data files / blocks:
> $ IPFS_PATH=/zc/tomerge
> $ ipfs files ls --long /
> 2024-06-21T15:17:03.040-0600 ERROR core core/builder.go:158 constructing the node: could not build arguments for function "reflect".makeFuncStub (reflect/asm_amd64.s:28): failed to build *mfs.Root: received non-nil error from function "github.com/ipfs/kubo/core/node".Files (github.com/ipfs/[email protected]/core/node/core.go:136): error loading filesroot from DAG: block was not found locally (offline): ipld: could not find QmRLsKdkgAm7PvnwfjKpze7vhUqzuWpgPUMzfwhZBxHDj8
> Error: constructing the node (see log for full detail): error loading filesroot from DAG: block was not found locally (offline): ipld: could not find QmRLsKdkgAm7PvnwfjKpze7vhUqzuWpgPUMzfwhZBxHDj8
> $ # Remember to record MFS before merging repos!

About those permutations:
> Dolores Dolores2
"Important string" wordfiltered, but you can get it from this command:
> $ echo "1f8b08000000000000033d90db71c43008455bb935a4a10c92b14d8c9006\ 
> 49eb28d587dd9de487e1758103c62d2ac739e0e43216a835e52fca5724c4\
> 52bdb1eb1c831d4dec12466f7285bd99c733cab50e50d25a0b12a58eccca\
> 7d0841a711326d6c99f1b7e6b321c95128a39f626207924e7eca3724274e\
> d30d3b595ef8e15c9d60a5209fbe3a7a2dd182d79c97b44feb3c305cbee3\
> 944374236c1227f9863ec8df60ffde4714a9548ba2e82388f2c9eca21c5a\
> 27b3f5641bbb3807334f47aaf10083aed8bab1b785ade6511d47d5c04204\
> f408d287d8d2b7fd00d9c18ada4871cc5216eaad1864176eb11a2fd969f6\
> f10b2bd2c29278010000" | xxd -p -r | gunzip; echo
> [...]
> $ # "gunzip" = "gzip -cd".
thumbnail of fancy_winona.png
thumbnail of fancy_winona.png
fancy_winona png
(61.18 KB, 1920x2463)
thumbnail of pinkie_diamond.png
thumbnail of pinkie_diamond.png
pinkie_diamond png
(43.52 KB, 1920x1728)
thumbnail of zecora_sombra.png
thumbnail of zecora_sombra.png
zecora_sombra png
(56.75 KB, 1920x1809)
thumbnail of gummy_vinyl.png
thumbnail of gummy_vinyl.png
gummy_vinyl png
(43.98 KB, 1920x2159)
thumbnail of nmm_blueblood.png
thumbnail of nmm_blueblood.png
nmm_blueblood png
(32.22 KB, 1920x1245)
 >>/10521/
 >>/10520/
I grabbed those 2704 online image files. I used this simple code and stuff (nested while loop):
> $ a=(twilight rarity applejack rainbow flutter pinkie spike sweetie scoot abloom babs celestia luna cadence twilight_p bigmac shining blueblood braeburn fancy zecora nmm chrys sombra lightning sunset trixie gilda discord Dolores Dolores2 diamond silver cheerilee granny spitfire fleur bonbon lyra derpy doctor golden octavia vinyl vinyl2 angel opal gummy owl tank winona faust); n=0; while [[ $n -lt 52 ]]; do i=0; while [[ $i -lt 52 ]]; do echo ${a[$n]}_${a[i]}; i=$(expr $i + 1); done; n=$(expr $n + 1); done > ponyfusn.txt

Durations:
> $ utc; grab-site --input-file=ponyfusn.txt 1>fusion.ponyar.net_1.txt 2>fusion.ponyar.net_2.txt; utc
> 2024-06-22T14:26:13.323099973Z
> 2024-06-22T14:40:12.179978527Z
> $ # HTTP 200 on all of them
and
> $ utc; python3 -m warcat extract /zc/warc/fusion.ponyar.net/zc-put-in-1-bbb-aaa-ccc-ponyfusn.txt-2024-06-22-f07d427d/zc-put-in-1-bbb-aaa-ccc-ponyfusn.txt-2024-06-22-f07d427d-00000.warc.gz; utc
> 2024-06-22T15:22:39.464040382Z
> 2024-06-22T15:23:42.469965633Z
> $ # 5 random images from "find /zc/warc/fusion.ponyar.net/raws/fusion.ponyar.net/cache | sort -R | head -n5"
This software: https://github.com/chfoo/warcat - linked from https://wiki.archiveteam.org/index.php?title=The&#95;WARC&#95;Ecosystem#Tools

I did a "1K drop" with those 2704 NFT-like files onto NFT-related things. Those image file raws are online in this way (among others): in two online IPFS nodes, one remote and one local. (Maybe it isn't a "2.7K drop" if NFTbros just call it "1K drop", "10K drop", etc. like I head in a video IIRC.) Raws=130.9 MiB. Here's the WARC+raws (.warc.gz isn't redundantly online - yet?):
https://gateway.pinata.cloud/ipfs/bafybeif2liasz7sihsuxqrmcvrjgwb5bzddeo53kfo2rgjpvjun2q5e3cu

(*twilight.png images are bit-identical to the corresponding *twilight_p.png images.)
thumbnail of applejack_zecora.png
thumbnail of applejack_zecora.png
applejack_zecora png
(48.21 KB, 1920x1822)
thumbnail of zecora_applejack.png
thumbnail of zecora_applejack.png
zecora_applejack png
(56.75 KB, 1920x1809)
 >>/10515/
 >>/10518/
I got two babs+x in a row.

 >>/10522/
Blind zebra: "Ah hate ziggers." Element of Ignorance.

 >>/10498/
 >>/10501/
 >>/10518/
Closest I got with CGI+.py+subprocess.run() is this code:
> ipfs://bafkreih4igdbyar2l5cpn7dqnqg2lcaublvakh3ym3cvxqckh7ypienjwu
> ar://OEGpM9kRvL4ipdGxDTzqhDmtZryJMeaWgh7a7QxyqL8 ( https://api.arns.app/v1/contract/bLAgYxAdX2Ry-nt6aH2ixgvJXbpsEYm28NgJgyqfs-U/read/gateways )
Which returned this error:
> CompletedProcess(args=['ipfs', 'resolve', '/ipns/k2k4r8nismm5mmgrox2fci816xvj4l4cudnuc55gkfoealjuiaexbsup'], returncode=1, stdout=b, stderr=b'Error: error loading plugins: open /home/ubuntu/.config/BraveSoftware/Brave-Browser/brave_ipfs/config: permission denied\n')
> CompletedProcess(args=['whoami'], returncode=0, stdout=b'www-data\n', stderr=b) dsdsds

An interesting part of that bafkreih...njwu simple code is the following, which sets a Bash environment variable before running a shell command:
> a = subprocess.run(["ipfs", "resolve", "/ipns/k2k4r8nismm5mmgrox2fci816xvj4l4cudnuc55gkfoealjuiaexbsup"], capture_output=True, env=dict(os.environ) | {"IPFS_PATH": "/home/ubuntu/.config/BraveSoftware/Brave-Browser/brave_ipfs"})
thumbnail of abloom_cheerilee.png
thumbnail of abloom_cheerilee.png
abloom_cheeri... png
(20.88 KB, 900x1242)
thumbnail of cheerilee_abloom.png
thumbnail of cheerilee_abloom.png
cheerilee_abloom png
(40.07 KB, 1920x1837)
thumbnail of lyra_bonbon.png
thumbnail of lyra_bonbon.png
lyra_bonbon png
(69.97 KB, 1920x3381)
thumbnail of bonbon_lyra.png
thumbnail of bonbon_lyra.png
bonbon_lyra png
(44.71 KB, 1920x1939)
 >>/10522/
Look at me. I'm the teacher now.

 >>/10521/
> merging repos
As planned, I have been repinning hundreds of things from a saved list + datastore/*.ldb files. I had problems pinning large folders in the past, but not in the past week. I could repinned this, which has >250,000 nodes:
> $ ipfs files stat /ipfs/bafybeifjvpxzl5njrvmqumt3g4vmzdrtcz5pzdt7jkovwlrhm4q4sh5bpy
> [...]CumulativeSize: 447979958926
> [...]Type: directory
> $ # which is "[Loyaldk] My Little Pony 4K Upscale" and like 448 GB
Only "bad thing that happened" was my ipfs daemon got oomd'd when securing that ~500 GB folder again; also when doing that, free memory dropped to ~200 and ~150 MiB out of like 4 GB of RAM total. Repinned as part of this specific command:
$ grep -n "$" /zc/zctomerge1205.txt | sed "s/ .*//g" | \
sort -r | xargs -d "\n" sh -c 'for args do echo == $args; \
ipfs pin add --progress $(echo $args | sed "s/.*://g"); done' _
thumbnail of sweetie_cheerilee.png
thumbnail of sweetie_cheerilee.png
sweetie_cheerilee png
(29.59 KB, 1500x1775)
thumbnail of cheerilee_sweetie.png
thumbnail of cheerilee_sweetie.png
cheerilee_sweetie png
(40.07 KB, 1920x1837)
thumbnail of scoot_cheerilee.png
thumbnail of scoot_cheerilee.png
scoot_cheerilee png
(40.6 KB, 1920x1926)
thumbnail of cheerilee_scoot.png
thumbnail of cheerilee_scoot.png
cheerilee_scoot png
(40.07 KB, 1920x1837)
 >>/10520/
4.5 quadrillion pony images. Trillions of files = fits in a terabyte-scale storage thing. (12.) Quadrillions of files = fits in a petabyte-scale storage thing. (15.) (Billions... = ...gigabyte-scale. Millions = megabyte-scale. Thousands = kilobyte-scale.) Quintillions = exabyte. (18.) Sextillions = zettabyte. (21.) Septillions = yottabyte. (24.) Next = "ronnabyte" or "brontobyte"; they refer to the same thing (27 zeros), but I think today is my first time learning the word "ronnabyte". I know I heard "brontobyte" byte before (etymology is dinosaur-related.)

 >>/10524/
*I did repinned this [a ~500-GB folder]
*~200 MiB and ~150 MiB
thumbnail of derpy_doctor.png
thumbnail of derpy_doctor.png
derpy_doctor png
(36.07 KB, 1920x1469)
thumbnail of doctor_derpy.png
thumbnail of doctor_derpy.png
doctor_der... png
(47.62 KB, 1920x3047)
thumbnail of Rarity_Plays_-_GTA_V_MLP_in_real_life-PoniesInMyLife-20130926-youtube-1280x720-6Y7j4j0HC38.jpg
thumbnail of Rarity_Plays_-_GTA_V_MLP_in_real_life-PoniesInMyLife-20130926-youtube-1280x720-6Y7j4j0HC38.jpg
Rarity_Plays_-_GTA_V_... jpg
(109.04 KB, 1280x720)
thumbnail of Rarity_Plays_-_GTA_V_MLP_in_real_life-PoniesInMyLife-20130926-youtube-1280x720-6Y7j4j0HC38.mp4
thumbnail of Rarity_Plays_-_GTA_V_MLP_in_real_life-PoniesInMyLife-20130926-youtube-1280x720-6Y7j4j0HC38.mp4
Rarity_Plays_-_GTA_V_... mp4
(11.55 MB, 1280x720 h264)
 >>/10525/
*heard "brontobyte" before

Pony duos from
> https://gateway.pinata.cloud/ipfs/bafybeiewc2hpo2i5mrnzu3l4dvv7vhzy4trnsncbhq4hdemgjvok4g6erq/fusion.ponyar.net/cache/derpy&#95;doctor.png
> https://gateway.pinata.cloud/ipfs/bafybeiewc2hpo2i5mrnzu3l4dvv7vhzy4trnsncbhq4hdemgjvok4g6erq/fusion.ponyar.net/cache/doctor&#95;derpy.png
I like the pegasus one: classic horse colors. Other media from TPA.
Reading older threads:
> https://desuarchive.org/mlp/thread/30986179/#30987345
>  >This is the top rated marecock on Derpibooru.
>  >https://derpibooru.org/591340
>  >Discuss.
> i am pretty sure i have masturbated to this at least 3 times.
> 
> i wouldnt call it the best though
For me, probably 2 times (not 3 IIRC).

 >>/10515/
 >>/10514/
I have these files:
> github+Tailszefox+Pony-Fusion.zip
> github+emn178+online-tools.zip
> github+hczhcz+2048.zip
with extracted versions here:
https://gateway.pinata.cloud/ipfs/bafybeiguanpakleeymgqblsutodesvtcmjqjxufy5ntz3oqjsmq3yipvxi

 >>/10526/
> couldn't hit the broadside of a landwhale
That's what happens when you play video games with hooves.
thumbnail of 6912092.png
thumbnail of 6912092.png
6912092 png
(2.33 MB, 1920x1080)
PoLS

I am alive. Had some medical stuff going on. I will try to get back into this thread depending on what goes on later this week.

Archivist, I wish you well, /)

https://twibooru.org/profiles/BridgesAndLadders
(In the event this place ever goes down, you can contact me here).
thumbnail of 4FBB4C3B-D5C5-4752-B66B-9C464DFC75CF.png
thumbnail of 4FBB4C3B-D5C5-4752-B66B-9C464DFC75CF.png
4FBB4C3B-D5C5-4752-B6... png
(925.36 KB, 1841x1033)
2018 video not in TPA - "AMV / PMV - deadmau5 & Kaskade - I Remember":
https://compilations.broquemonsieur.net/redirect?referer=/watch?v=98Z2PCYgZIg
. Medium- or large-size channel
. "Low effort": like only one frame/image
. Nearby data: better track at https://invidious.reallyaweso.me/watch?v=iCKyg5F4ExA "4 AM (Adam K & Soha Radio Edit)"
. Check: https://tpa.mares.workers.dev/?output=html&id=

This image is from a nearly-full iPone; possible fix for that (->Ubuntu):
https://invidious.private.coffee/watch?v=O1kxOV5RLrI
thumbnail of IMG_4112.PNG
thumbnail of IMG_4112.PNG
IMG_4112 PNG
(565.65 KB, 1334x750)
thumbnail of IMG_5082.JPG
thumbnail of IMG_5082.JPG
IMG_5082 JPG
(307.79 KB, 1024x1024)
thumbnail of IMG_5312.PNG
thumbnail of IMG_5312.PNG
IMG_5312 PNG
(111.98 KB, 1334x750)
thumbnail of IMG_5076.JPG
thumbnail of IMG_5076.JPG
IMG_5076 JPG
(4.62 MB, 3968x5376)
What I use to download a single video from a YouTube channel:
. https://gateway.pinata.cloud/ipfs/bafkreibfhegllf2352rzvi7eskb4jgn6445pptpjialfa44gscm5m35gqi
. https://thecoldblooded.online/ynY&#95;qacTbyKG1CDa1e&#95;mXMoDuRTZthC&#95;sILMTHkasPs

What I use to download an entire YouTube channel:
. ipfs://bafkreifajlc3junozqugo6tll6abrjxa7dnbidt556i3czspz3hmrnsd4i

Seems I gotta update these downloaders because y.com.sb = fail.

These images are from small folder "publicdata2" (2.39 GiB):
https://gateway.pinata.cloud/ipfs/bafybeifbchqglddhv4qdywnmd4ybckpbc5liwkllszmcvdsf4el634z5v4
. related to fusion.ponyar.net  >>/10515/;
. not in two different HDDs/computers (yet?); has video about the Sandy Hook hoax
. forgot to include metadata: https://gateway.pinata.cloud/ipfs/bafybeigfvkfhgy5bsncgivxpwhrwvgpg6be2se2usk22elaqtoxzgkdtje

Folder created thanks to ifuse, which allows one to mount an iShit device ( >>/10534/):
> $ sudo ifuse /mnt/e
> $ sudo find /mnt/e/DCIM/105APPLE -type f | sudo xargs -d "\n" sh -c 'for args do echo "$args"; mv -n "$args" "/zc/b/iphone/105APPLE/"; done' _
> $ sudo chown -R ubuntu "/zc/put/vvv/zc-b-iphone-105APPLE-pub"
Oddly, and unlike in the past, I could actually access that iPone's images+videos like it was a regular FS, which is a good thing. Couldn't access the stuff in the Downloads folder though. (Apps = Photos, Files - couldn't get files in Files but could get files in Photos.)
thumbnail of twilight_doctor.png
thumbnail of twilight_doctor.png
twilight_doctor png
(49.56 KB, 1920x2232)
thumbnail of applejack_doctor.png
thumbnail of applejack_doctor.png
applejack_doctor png
(48.21 KB, 1920x1822)
thumbnail of pinkie_doctor.png
thumbnail of pinkie_doctor.png
pinkie_doctor png
(43.52 KB, 1920x1728)
thumbnail of rainbow_doctor.png
thumbnail of rainbow_doctor.png
rainbow_doctor png
(50.6 KB, 1920x1856)
thumbnail of rarity_doctor.png
thumbnail of rarity_doctor.png
rarity_doctor png
(44.69 KB, 1920x1455)
 >>/10526/
> classic horse colors
mane 5/6

 >>/10536/
> ifuse...sudo...mv...
Doesn't actually move the files. Not much of a problem, but something to be aware of.

More CLI information... I have been copying CIDs from one computer to another (in both directions). HPC is the computer with a program uptime of 31 days straight now. I improved the command I'm using to do some of that:
$ ssh [email protected] "export IPFS_PATH=/path; ipfs pin ls --type=recursive" | sed "s/ .*//g" | \
sort | uniq | xargs -d "\n" sh -c 'for args do a() { ipfs --offline pin add --progress $args  \
ssh [email protected] "export IPFS_PATH=/path; ipfs dag export $args" | ipfs dag import --stats; }; \
echo == $args; ipfs pin ls --type=recursive $args  a; done' _. Can declare and use a function in sh/xargs.
. "ipfs --offline..." tries pinning it in offline mode: this saves on the need to grab it from another computer if it succeeds
. if offline pinning fails, do get it from the other computer

How the "" operator works in Bash: do the command only if the previous one failed, only applies to one statement. Details... "echo snowpity | grep mare  echo Mare not found"->"Mare not found"; "echo mare | grep mare  echo Mare not found"->"mare". This is basic stuff, but what about running multiple commands only if the previous one failed? (See "echo $?" for exit code of previous command.) Use a function:
> $ a() { echo Rainbow Dash ran so far...; echo ...that the extreme running made her taste blood in her mouth.; }; echo snowpity | grep mare  a
> Rainbow Dash ran so far...
> ...that the extreme running made her taste blood in her mouth.
> $ a() { echo Rainbow Dash ran so far...; echo ...that the extreme running made her taste blood in her mouth.; }; echo mare | grep mare  a
> mare
> $ # Also basic stuff, but good to explicitly know.
In Bash, "&&" is the opposite of "", so it runs the command only if the previous one succeeded. (In other words: "boolean previous; ...; || = if(!previous) echo 'if false do'; && = if(previous) echo 'if true do';".) The above applies.
 >>/10527/
Another use of that - do you have many tabs open on a crappy or good mobile device and want to have less open? Paste the links in here:
https://quicknode.quicknode-ipfs.com/ipfs/bafybeiguanpakleeymgqblsutodesvtcmjqjxufy5ntz3oqjsmq3yipvxi/emn178-online-tools-cadfeea/sha1.html

Cool thing about that: it autoupdates the SHA1 hash. After pasting in a bunch of URL where each one has an optional note (what it means to you or something), you can then paste it to https://put.icu/paste then copy that text file to a computer or something. Then you can verify it by seeing if the hashes match.

 >>/10534/
That channel reminds me of that YT channel where that guy is a fan of MLP and Thomas the Tank Engine. Watching this pony-related video from the former channel out of context may be confusing - "What I feel like when nobody sees my crossover music videos anymore (YouTube update in description)":
https://invidious.reallyaweso.me/watch?v=7Ff-&#95;L4tIJA
thumbnail of 0F089880-1886-4F3B-909F-FD35F4D74AF9.png
thumbnail of 0F089880-1886-4F3B-909F-FD35F4D74AF9.png
0F089880-1886-4F... png
(29.59 KB, 1500x1775)
thumbnail of 6800EA89-4B80-4AAF-8F90-917C575DA27F.png
thumbnail of 6800EA89-4B80-4AAF-8F90-917C575DA27F.png
6800EA89-4B80... png
(20.88 KB, 900x1242)
thumbnail of 9B38DE54-353C-4535-8AB4-C175B0376CFB.png
thumbnail of 9B38DE54-353C-4535-8AB4-C175B0376CFB.png
9B38DE54-353C-4535-8A... png
(40.6 KB, 1920x1926)
 >>/10543/
*bunch of URLs
 >>/10540/
> Doesn't actually move the files
It copies the files, doesn't move them.
> code
Lines are too long for some devices - messes up how the rest of the post is displayed.

 >>/10543/
And you can look at the code which hashes it and controls the textarea/whatever because it's all client-side and (F)OSS.

 >>/10541/
CMC
thumbnail of De_Value_UCRmCLx2IxTWY78kJ-9kPQdQ.jpg
thumbnail of De_Value_UCRmCLx2IxTWY78kJ-9kPQdQ.jpg
De_Value_UCRmCLx2IxTW... jpg
(83.67 KB, 647x647)
thumbnail of e3vhgc.png
thumbnail of e3vhgc.png
e3vhgc png
(142.16 KB, 1334x750)
thumbnail of 7cwlot.jpeg
thumbnail of 7cwlot.jpeg
7cwlot jpeg
(21.62 KB, 143x176)
Websites which have become worse:
. The Wayback Machine (web.archive.org, WBM): can only do 200 captures max per day when not logged in. In the past the limit was like 1000 max, 2000 max, 10,000 max, etc. I saw this when remotely saving low-risk pony images.
. TinEye (tineye.com): now Cuckflare-walled; https://web.archive.org/web/20240624213810/https://tineye.com/search/6d3d71e356c22d8273fa7286950ae7373ffffea2?sort=score&order=desc&page=1 is a blank/white page. Past WBM snapshots of tineye.com showed actual information (rendered images and text).

Memory-holed data which is "trivial" and probably totally gone now: see the following. If the data is gone, outside of an archived copy of a webpage, the next best thing is a recounting of the information from one's memories. So here goes... 1 to 3 days ago when WBM had a big delay on seeing new snapshots (so I didn't capture it), I looked at the comments of this npr video:
https://redirect.invidious.io/watch?v=hUrrHPVHeLM
> Ex-OpenAI genius launches new “Super Intelligence” company
and saw two comments from different "porn bots". Those likely "highly-liked" comments have now likely both been deleted as I loaded them all in a browser today. A reply to one of them was from this channel:
> URL: https://inv.tux.pizza/channel/UCRmCLx2IxTWY78kJ-9kPQdQ
> Cool username: De Value
> MLP-related pfp: attached
That channel has no videos and zero playlists. \\ Updates: (1) everything in HPC is redundantly pinned, so in two diff. HDDs, (2) I finished merging and repinning "/zc/tomerge/" into "/zc/ipfs/", and tomerge contained terabytes IIRC. Todo: remote redundancy on some bafk... CIDs/files (do a 10K drop or something).

 >>/10544/
> LoC too long
97- or 100-character-long lines of code = too long, so use 80 or 70 characters per line so Endchan doesn't mess up when displaying the post. \\ Pics related are:
> Devalue: https://thecoldblooded.online/xHbwcUBzB&#95;EveBpcSMXuUNBfbAmch6qWcMnQN0mLSGo / ipfs://bafkreiarg3nvwvrb4mhgjkdsy6rziqq6hfazuokjlsxgkhvwvgrgocvvpq
> New WBM limit: https://permagate.io/&#95;pE2SicBhvciGe7d5IERezEmMlKV8IAMwZG1p3aU2vQ / ipfs://bafkreigbgkl2i67t5zsvrgqfrwcn6wna2z6qylwotptbxf2k6umfupe5re
> TinEye reverse image search on this Unicorn design/art on a shirt: https://bootstrap.lol/z6ZSFdUXrGOo5aJhOaprml7E66rAv9DjoVJNrfkr4uM / ipfs://bafkreiccpc4fs6yey4zdog7vbxkh7yylpgpyuvxdxgmm5xiazuacr4pllq
thumbnail of twibooru-12355.png
thumbnail of twibooru-12355.png
twibooru-12355 png
(33.74 KB, 945x945)
thumbnail of babs_doctor.png
thumbnail of babs_doctor.png
babs_doctor png
(45.22 KB, 1920x2313)
 >>/10522/
> No Mayor Mare

 >>/10545/
> TinEye is now worse
Unfortunate. I saw some nice info and data there in the past. BreachForums ( https://breachforums.st/ ) is now a fedsite/honeypot. In the past, databreaches were posted to that forums website. If a complete siterip of TinEye was posted there, I wonder how much someone would pay for it. Most of TinEye is not findable other than via backend access, and now since it's walled "the only hope for it" is that it gets hacked and ripped (then hopefully shared online for free). In the past I said that TinEye is an archive-friendly reverse image search website; that's no longer the case, closest thing to that now is Google reverse image search I guess. Yandex reverse image search pages are walled. (BTW, in the past I saw something about IA/WBM being exempt from being blocked by Google due to crawling google.com.)

 >>/10544/
> CMC
 >>/10545/
I recall some anons here in the past  had trouble getting wayback to work at all if I remember that right. Don't remember what that was part of though.

 >>/10543/
Channels like that can be interesting. The "austism" and "cringe" maybe worn on their wrist but sometimes I've found hidden gems on those from that unsurpassed creative drive.
I see you're still at it. I don't know where everyone else has gone to, but anyway I've been notified recently that someone wants to start archiving pony stuff on Twitter. The motivation is obvious given the many recent changes to that site. There's also many artists there that do not post their pony art anywhere else, and fishing for ancient accounts associated with conventions, websites, DHX staff and so on will be very informative for fandom history.

Both of us are not too familiar with the fandom on Twitter, so I was hoping that someone here already has such a list they'd be willing to share.

Similarly, there's a list for deviantart too, although I think that one is in much better shape for now.
thumbnail of bafkreif2zjyagjh3ttw2il2a7ir5ilv2xpg67fojgwbihrbelqhlnsxz6a.png
thumbnail of bafkreif2zjyagjh3ttw2il2a7ir5ilv2xpg67fojgwbihrbelqhlnsxz6a.png
bafkreif2zjyagjh3tt... png
(46.7 KB, 644x695)
thumbnail of bafkreiffh2qtdjf6ljnptikeljybcvnqtzj7byyafnhuin72cvn3vwzz6e.jpg
thumbnail of bafkreiffh2qtdjf6ljnptikeljybcvnqtzj7byyafnhuin72cvn3vwzz6e.jpg
bafkreiffh2qtdjf6ljnp... jpg
(38.94 KB, 500x181)
thumbnail of bafkreidshmhqlag63twvp6y4riie2llir67immbnqgbg2aihee35f5ej6i.png
thumbnail of bafkreidshmhqlag63twvp6y4riie2llir67immbnqgbg2aihee35f5ej6i.png
bafkreidshmhqlag63twv... png
(50.57 KB, 844x674)
thumbnail of bafkreifafpkvznvdevnm53rkcj6awssyo3aq55oiesi2ak35mehpwmiz6e.png
thumbnail of bafkreifafpkvznvdevnm53rkcj6awssyo3aq55oiesi2ak35mehpwmiz6e.png
bafkreifafpkvznvdevnm... png
(56.45 KB, 1879x327)
thumbnail of bafkreidxkg7pucqrxtqkyqnts72jpst6jxnfqm2eyqsfwzdgsabzwmxz6a.jpg
thumbnail of bafkreidxkg7pucqrxtqkyqnts72jpst6jxnfqm2eyqsfwzdgsabzwmxz6a.jpg
bafkreidxkg7pucqrxtqk... jpg
(31.4 KB, 531x506)
I emitted thousands of random extensionless files (incl. these 5). For certain reasons, I now want to add extensions to them. They are .gif, .png, .swf, etc.; use this:
find . -type f -not -name "*.*" -exec bash -c \
'if [ $(file --mime-type -b {})  "image/jpeg" ]; then mv {} {}.jpg; fi;' \;; \
find . -type f -not -name "*.*" -exec bash -c \
'if [ $(file --mime-type -b {})  "image/png" ]; then mv {} {}.png; fi;' \;; [...]Full command:
. ipfs://bafkreiap6ghxpyd7hx5cvy3xvebbf5zzn57zotq53wzjwnktgcebti72ee
. https://yukovskibot.com/wV6Ne-DGnCERDnCeFVm7XPhnRFhMB&#95;g9nvcYwThutzY
. based on https://www.baeldung.com/linux/bash-add-file-extension

Problem with that (if you don't put the them in 1000-files folders or something):
> bash: line 1: [: too many arguments
So I can go back to my "crappy" solution which I wrote before I saw that baeldung.com page:
cat cids.txt | xargs -d "\n" bash -c 'for args do file /ipfs/$args | \
sed "s/,.*//g" | grep -v ": data$"; done' _ | xargs -d "\n" sh -c \
'for args do in=$(echo $args | sed "s/:.*//g"); ext=$(echo $args | \
sed "s/ image data//g" | sed "s/.* //g" | sed "s/GIF/gif/g" | \
sed "s/JPEG/jpg/g" | sed "s/PNG/png/g"); echo -n "$in "; \
echo $(echo $in | sed "s/.*\///g").$ext; done' _It doesn't have that too-many-args problem because it's streamed and not all at once. Or do this for jpg+gif+png:
find . -type f | xargs -d "\n" bash -c 'for args do tb=$(head \
-c 3 "$args" | xxd -p); if [ "$tb"  "ffd8ff" ]; then mv -n "$args" \
"$args.jpg"; fi; if [ "$tb"  "474946" ]; then mv -n "$args" "$args.gif"; \
fi; if [ "$tb" == "89504e" ]; then mv -n "$args" "$args.png"; fi; done' _That's based on the first bytes of files and not MIME type as determined by this program: file version 5.41. With file-5.41, I can add .txt; can't easily do that with top bytes.

 >>/10547/
> I've found hidden gems on those from that unsurpassed creative drive.
Made me check something - this YouTube video which has 4 likes in Twibooru
https://twibooru.org/3229570?q=derpibooru&#95;id:3365361

I was thinking it was from
> ./True_Blue_UCnjNrJw4IIhORvMJVqYuM0Q.partial/
but it's actually from
> ./AndyFish_UCTCfI5U98rsJ8VdNF3K_uUQ/Dolores_Umbridge_-_Sieg_Heil-AndyFish-20151211-youtube-1920x1080-HL9LkTgHAaA.webm
in here (BTW, ipfs daemon got oom'd when there was around 80 MiB of free RAM):
> https://gateway.pinata.cloud/ipfs/QmXNifFze1xzMUbCpekpP9V5KxncGnAi4v8wU8655uD7iY/?filename=AndyFish&#95;UCTCfI5U98rsJ8VdNF3K&#95;uUQ
thumbnail of bafkreied7l7k2hdq2745aripebpcgkh6h7laahe7zpxwaagqqf73a4gj6e.jpg
thumbnail of bafkreied7l7k2hdq2745aripebpcgkh6h7laahe7zpxwaagqqf73a4gj6e.jpg
bafkreied7l7k2hdq2745... jpg
(136.57 KB, 1280x720)
thumbnail of bafkreie7knwl2fh7b2tsqw6qtye2bgx4jshobjlpb5evyf5n5chl5jzz6m.png
thumbnail of bafkreie7knwl2fh7b2tsqw6qtye2bgx4jshobjlpb5evyf5n5chl5jzz6m.png
bafkreie7knwl2fh7b2ts... png
(35.29 KB, 1037x300)
thumbnail of bafkreicibf2ntlqrryuac5fxrsc3jv4qjv2aq4tnb4rnvhp4fwgjt7sj6i.jpg
thumbnail of bafkreicibf2ntlqrryuac5fxrsc3jv4qjv2aq4tnb4rnvhp4fwgjt7sj6i.jpg
bafkreicibf2ntlqrryua... jpg
(53.7 KB, 500x382)
thumbnail of bafkreia4nba3nbum6rvttldnsgjf7hgy2oo4y2e3zxttpzt5unpcrsmz6e.jpg
thumbnail of bafkreia4nba3nbum6rvttldnsgjf7hgy2oo4y2e3zxttpzt5unpcrsmz6e.jpg
bafkreia4nba3nbum6rvt... jpg
(104.96 KB, 800x539)
thumbnail of bafkreiatiarn2fmnzxf5hydzuhaixbpuqsjsbiwy572qahwlkm7roejj6m.jpg
thumbnail of bafkreiatiarn2fmnzxf5hydzuhaixbpuqsjsbiwy572qahwlkm7roejj6m.jpg
bafkreiatiarn2fmnzxf5... jpg
(33.72 KB, 320x320)
 >>/10548/
> don't know where everyone else has gone to
Perhaps the mindset is clout or visibility-related, or related to unification or 4chan /mlp/ having an "insta-archive" (desuarchive.org). "Endchan matters less because fewer users will see my posts compared to 4chan." Counter-quote:
> I'm glad there's no stupid 4chan users here.
Posted by Hiromoot, the current owner of 4chan. (As with any community, there's dumb users and there's great/OK users.)

> Xitter
Roughly a week ago I was thinking of figuring out what the deal was with Nitter and stuff. Didn't do that. I can share more info and put in work on this later maybe/probably. Nitter instance https://xcancel.com/nist seems to be CF-walled (but with custom CSS). Is there a free-tier Twitter API? If I did web scraping, what would that entail (I can figure this out)?

 >>/10549/
> ipfs repo ls [streamed output]
More pics.

> Dolores_Umbridge_-_Sieg_Heil-AndyFish-20151211-youtube-1920x1080-HL9LkTgHAaA.webm
> https://gateway.pinata.cloud/ipfs/QmXNifFze1xzMUbCpekpP9V5KxncGnAi4v8wU8655uD7iY
(Wordfilter, see that link for the original filename.)
 >>/10550/
No I mean there used to be other users frequenting the /go/ thread. Last time I was here they were still on the first thread.

> Roughly a week ago I was thinking of figuring out what the deal was with Nitter and stuff.
Unfortunately a few months back almost all the free nitter instances stopped working. I briefly read over the discussion back then and it seems that a lot of people were using the instances for mass tweet scraping. The recommended approach was to set up your own instance to do that and to leave the public ones for everyone else's convenience. I believe you can still set up your own private instance though. Don't take my word for it though as I haven't checked since that happened.

> Is there a free-tier Twitter API?
The only one that I'm aware of is write-only permission. This is to discourage scraping, yet allow those twitter bots from posting hourly updates for whatever they're doing.

> If I did web scraping, what would that entail (I can figure this out)?
Right now, Twitter can be scraped using a spare account and gallery-dl: https://github.com/mikf/gallery-dl
thumbnail of F636D943-4C1D-4548-83F9-B24AA60DBD67.jpeg
thumbnail of F636D943-4C1D-4548-83F9-B24AA60DBD67.jpeg
F636D943-4C1D-4548-83... jpeg
(47.34 KB, 596x452)
 >>/10548/
> The motivation is obvious given the many recent changes to that site.
What I've been doing for like one month now: automatically grabbing booru.org subdomains because it's shutting down and the greedy pig site owner cares very little about archiving and boorus that don't make him money.

 >>/10551/
> Unfortunately a few months back almost all the free nitter instances stopped working
I think I remember that. Maybe .onion or .i2p ones work better now compared to clearweb ones.
> seems that a lot of people were using the instances for mass tweet scraping
I'm curious about a breakdown on this: "ai" training, social ops/drama, personal archiving, public archiving, ad-related/data brokers maybe.
> recommended approach was to set up your own instance to do that and to leave the public ones for everyone else's convenience
I was thinking of that when I was writing  >>/10550/ - perhaps I will see it that private instance method still works.

> gallery-dl
I didn't know it worked for that.

 >>/10545/
> search results page is now worse
Other thing I noticed:
> https://archive.4plebs.org/pol/search/text/trans%20contradiction
> 245 results found.
But that page only shows 25 results and not more 245! That's another website which became worse: only shows a small amount of search results. /mlpol/ search then and now:
Thousands">https://web.archive.org/web/20231210064132/https://archive.4plebs.org/pol/search/text/%22my%20little%20pony%22[/code]Thousands of posts across >15 pages. (Code markup because Endchan will mess up the link otherwise.)
SERP">https://web.archive.org/web/20240625151322/https://archive.4plebs.org/pol/search/text/%22my%20little%20pony%22[/code]SERP shows only one page with 25 posts.
 >>/10552/
> did this to prevent the links getting messed up
Still got messed up. Fix:
[...
Can only see a small amount of results from a search, example given is related to a /pol/ post about trannies (saying that feminism is contradictory/double think with transgenderism because fems say that gender doesn't define you and isn't inherent while trans say the opposite).
...]
/mlpol/ search then and now:
https://web.archive.org/web/20231210064132/https://archive.4plebs.org/pol/search/text/%22my%20little%20pony%22  Thousands of posts across >15 pages. (Code markup because Endchan will mess up the link otherwise.)
https://web.archive.org/web/20240625151322/https://archive.4plebs.org/pol/search/text/%22my%20little%20pony%22  SERP shows only one page with 25 posts.
thumbnail of Giddy_Up_MLP_Anniversary-AndyFish-20141020-youtube-1278x720-K2O5Eej77xQ.webm
thumbnail of Giddy_Up_MLP_Anniversary-AndyFish-20141020-youtube-1278x720-K2O5Eej77xQ.webm
Giddy_Up_MLP_Annivers... webm
(10.14 MB, 1278x720 vp9)
thumbnail of 26E0A9A1-1A42-4DC2-BA62-2FC41296F903.jpeg
thumbnail of 26E0A9A1-1A42-4DC2-BA62-2FC41296F903.jpeg
26E0A9A1-1A42-4DC2-BA... jpeg
(19.57 KB, 121x121)
 >>/10549/
IWTCIRD

 >>/10552/
Is there one that works with WBM?
. HTTP 200: https://archive.ph/2024.06.25-162329/https://xcancel.com/twilightsparkle
. Fails: https://web.archive.org/web/20240625162557/https://xcancel.com/twilightsparkle
. ( https://web.archive.org/web/20231008094653/https://twitter.com/twilightsparkle )
. ?: using wget/grab-site

 >>/10553/
 >>/10552/
*shows 25 results and not 245

Not as bad as I thought, can view next page, but only a link to page one is clearly seen; example:
. https://archive.4plebs.org/pol/search/filename/capitalist%2Bpig/page/6/
. https://archive.4plebs.org/pol/search/filename/capitalist%2Bpig/page/14/
.. had multiple page number buttons at the bottom in 2024-06-09 - no longer the case

Live Giddy Up reaction:
> https://gateway.pinata.cloud/ipfs/QmXNifFze1xzMUbCpekpP9V5KxncGnAi4v8wU8655uD7iY/Giddy&#95;Up&#95;MLP&#95;Anniversary-AndyFish-20141020-youtube-1278x720-K2O5Eej77xQ.webm
Pfp from npr leftoid video:
> https://web.archive.org/web/20240625161921/https://inv.tux.pizza/watch?v=P8-S4kLQGiE
> title=This Ben Garrison Stunlock Took A WEIRD Turn...
thumbnail of e621_4580245.jpg
thumbnail of e621_4580245.jpg
e621_4580245 jpg
(984.64 KB, 1000x1279)
 >>/10554/
>  A WEIRD Turn...
Not familiar with the YT'r but yes, I think we all long for a universe/time when we no longer fear the repercussions of physical damage.

But vore is still pretty weird
thumbnail of twibooru-1874722.png
thumbnail of twibooru-1874722.png
twibooru-1... png
(2.82 MB, 2000x4300)
thumbnail of twibooru-2058804.png
thumbnail of twibooru-2058804.png
twibooru-2... png
(3.34 MB, 2000x4300)
How long does it take to organize many files and folders? It takes hours over days. Some of what I did recently - Here's some MLP FIM episodes that were broadcast in 4:3 (video files that I dl'd years ago):
https://mega.nz/folder/WBhW0CwR#2c5FBzwlDPjyv&#95;Nbxgmumw

I added that to MFS root:
> file:///ipfs/QmYqN6s2KMvMMxEpvpoWfVgtQBpnMxzMrfcq7CwPHbnGr3/root/web/raws/mega.nz/folder-WBhW0CwR-2c5FBzwlDPjyv_Nbxgmumw/
> resolved: https://gateway.pinata.cloud/ipfs/QmWMM3obMp3kSUAsg1iudmb3kv9ipgMxVJ8X2feZeCUrn2

Can't mount IPFS when offline:
> $ fusermount -u /ipfs; fusermount -u /ipns; ipfs --offline daemon --mount &
> [1] 3295893
> $ Initializing daemon...
> Kubo version: 0.23.0[...]Golang version: go1.21.1[...]Swarm not listening, running in offline mode.
> RPC API server listening on /ip4/127.0.0.1/tcp/5001[...]WebUI: http://127.0.0.1:5001/webui
> [...]Error: mount is not currently supported in offline mode[...]
> [1]+ Exit 1 ipfs --offline daemon --mount
> $ # Offline mode would be faster in some cases.

It also takes some time to find and download stuff. Something I didn't get to - someone else's post:
> That loona archive really needs to be archived: https://mega.nz/folder/aAUQlIJJ#Q24arPlyUKzV8hqsVELR5g
> An old pastebin for the loona ARG (https://pastebin.com/tjp3nZW7) linked to a previous archive that's now dead: https://mega.nz/file/WY8AUJJD#tRW1njDtEX8BxEqio0Bq4OxCu74kq-dSoERlDfAAH2s
> Don't know if the new link has the same contents, but treat it as a warning either way.

 >>/10554/
Also failed:
. https://web.archive.org/web/20240625233159/https://nitter.poast.org/nist
. https://web.archive.org/save/https://nitter.privacydev.net/nist - "Please try again in ~10 min. Crawling this host is paused because they notified us that they are overloaded right now."

 >>/10555/
I thought this image was kinda sexy, would be better if it wasn't vore+inflation. (I guess this was obvious, but my focus in pointing that out was in discovery of another MLP-related channel and info in. Not criticizing anyone for for posting about something I wasn't focusing on, anons can post about whatever.)
thumbnail of bafkreic4a6hh2wbhkn42b3azllnzegdurvriwbxfd2avckpdvpoyf47j6i
thumbnail of bafkreic4a6hh2wbhkn42b3azllnzegdurvriwbxfd2avckpdvpoyf47j6i
bafkreic4a6hh2wbhkn42...
(71.02 KB, 653x496)
thumbnail of bafkreihc56u5rkcjyfues5vr2fvrxjpn7bhca24sxlr54de5mjd77zaz6i
thumbnail of bafkreihc56u5rkcjyfues5vr2fvrxjpn7bhca24sxlr54de5mjd77zaz6i
bafkreihc56...
(127.69 KB, 640x960)
thumbnail of bafkreiaj5ktccr3qd4rzd2awxywbnnnq4pd23tqwiuvoqtwynsa6mkmj6i
thumbnail of bafkreiaj5ktccr3qd4rzd2awxywbnnnq4pd23tqwiuvoqtwynsa6mkmj6i
bafkreiaj5ktccr3qd4rz...
(39.21 KB, 916x177)
thumbnail of bafkreia5yvtgyzevanck7l2hsfwwj7fyzmr5mwt5sjziudrs3auatwtz6e
thumbnail of bafkreia5yvtgyzevanck7l2hsfwwj7fyzmr5mwt5sjziudrs3auatwtz6e
bafkreia5yvtgyzevanck...
(131.29 KB, 1000x1000)
thumbnail of bafkreih2mucdrzcod4t2gfpmwzsofhhzqbgkd3lbmsfctegtjshx5llj6a
thumbnail of bafkreih2mucdrzcod4t2gfpmwzsofhhzqbgkd3lbmsfctegtjshx5llj6a
bafkreih2mucdrz...
(114.68 KB, 720x900)
 >>/10549/
some more from that set

 >>/10555/
> we all long for a universe/time when we no longer fear the repercussions of physical damage.
Wouldn't have to be worried about being injured while not having health insurance.

 >>/10556/
>Not criticizing anyone for for posting about something I wasn't focusing on
I realize that sounds kinda self-centered - didn't mean for it to come off that way or for me to be that way.
thumbnail of 1032290.gif
thumbnail of 1032290.gif
1032290 gif
(4.7 MB, 1280x720)
 >>/10548/ 
> Both of us are not too familiar with the fandom on Twitter, so I was hoping that someone here already has such a list they'd be willing to share.

I, Bridgefag, am still here (even if medical stuff going on ATM) As for a twitter list, actually have searched for that some in the past. Have yet to find anything useful unfortunately. 

 >>/10551/
> No I mean there used to be other users frequenting the /go/ thread. Last time I was here they were still on the first thread.

Wait, are you YT Comments anon or the other lurker that sometimes popped up?

By my own estimation, there has been two to three contributors this year. Some anons just come up once or twice with something (an anon who has connections to the archive team has been present sporadically this year last thread, for example). Usually though, it has been one or two anons driving the thread. 

 >>/10547/
> wayback

There was an attempt to archive stuff that was related to derpi that was spun off that some anons here were involved in. That is where I recall problems with wayback machine. Someone archived 100 pages or so and nothing went  through if I recall correctly. 

Yeah, wayback hasn't been the most reliable.
thumbnail of 691504.png
thumbnail of 691504.png
691504 png
(1.03 MB, 5989x6000)
 >>/10552/
> I think I remember that. Maybe .onion or .i2p ones work better now compared to clearweb ones.

It's because of the changes to twitter's API itself I reckon. Even if you had an account, there is pretty strict limits on viewing posts and a whole host of stupid anti-bot measures that (purposefully) broke alternative front ends like that. 

 >>/10556/
> How long does it take to organize many files and folders? It takes hours over days. Some of what I did recently - Here's some MLP FIM episodes that were broadcast in 4:3 (video files that I dl'd years ago):

Not quite the same, but similar feeling. I am currently compressioning and storing hard drive images with little space right now and it is taken a pretty long time. Sometimes you have to play musical chairs when space is at a premium  or staying another place to avoid stairs and only having a few portable drives and a laptop.

 >>/10557/
> Wouldn't have to be worried about being injured while not having health insurance.

Or having crappy insurance, as I have found it.

> I realize that sounds kinda self-centered - didn't mean for it to come off that way or for me to be that way.

 My reading comprehension isn't the best ATM, but you don't come off as that bad to me there.

Post(s) action:


Moderation Help
Scope:
Duration: Days

Ban Type:


117 replies | 145 file
New Reply on thread #10357
Max 20 files0 B total