bafkreicm2rjnl...
(17.61 KB, 114x150)
I have a 109.8-GB tarball from 2023-01 which is maybe/probably somewhat MLP-related. Oddly, when import+exporting that CAR containing it over SSH I saw this error:
> Error: pin: block was not found locally (offline): ipld: could not find [cid1]
> 2s 2.12 MiB / ? [---] 867.20 KiB/s Error: import failed at block "[cid2]": produced block is over 1MiB: big blocks can't be exchanged with other peers. consider using UnixFS for automatic chunking of bigger files, or pass --allow-big-block to override
> 11s 3.15 MiB / ? [---] 292.84 KiB/s Error: pin: block was not found locally (offline): ipld: could not find [cid1]
> 13s 3.15 MiB / ? [---] 247.78 KiB/s
cid1=root block; cid2=first 1-MiB block. The "produced block is over 1MiB" error was unexpected because the settings used to create that dag were as follows:
> $ ipfs add --chunker=size-1048576 -w $f
So non-raw blocks + 1048576-byte chunks = too-big blocks, at least for some versions. (Raw blocks + 1048576-byte chunks = NOT too-big blocks.) Non-rawblocks with 1048576-byte chunks is rare anyways, so this isn't much of an issue. Also, this somewhat makes sense due to >>/10663/ - raw blocks are seemingly this on disk: the entire file from byte 0 to the last byte with no additions or changes OR a contiguous part of the file with zero additions or changes. Nonraw blocks basically look like this on disk: the whole file or a contiguous part of it but there's like 4 to 16 bytes of header and/or footer data added. (Maybe there's no bytes added to the end, but there's definitely bytes added to the start of nonraw blocks from what I saw in the past.) Therefore, the on-disk size of the block is >1.0MiB which also looks that way in the "virtual filesystem" (I guess IPFS can be called that if not called an "overlay filesystem").
What does this matter? It matters so that you don't waste time making an output that is sometimes or always crappy, so the takeaway is as follows. Don't make backups or redundancy for items where the first copy was created like this:
> ipfs add --chunker=size-1048576 -w [folder/file name here]
>>/10668/
Here's another video from that channel that I watched.
>>/10665/
> Don't Hug me I'm Scared
That's the most popular video in that YT channel named "Don't Hug Me .I'm Scared"