cross-posted to: https://lemmy.world/post/2499861

As I said, I made a lossy reformat of the database and a lossless one for 6.0 Gib (6,477,905,920). compared to ~26GIB from Reddit, where fields are almost intentionally anti-compressed to take up more room.

If there is somewhere I can host it, let me know.

also, I couldn’t figure this out, do sqlite databses store any information on the creator or editor of a document?

why it's lossy

It’s missing a large table of base64 urandom technically required to recreate the document fully

  • fiat_lux@kbin.social
    link
    fedilink
    arrow-up
    2
    ·
    1 year ago

    Is this derived directly from the data reddit stored/created or is it a reconstruction of some kind from observing the r/place output? I’m tempted to look at the table structures but not tempted enough to download 4 gigs of it just yet.

    • Hello Hotel@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      edit-2
      1 year ago

      rebuilt from reddit’s offitial sources, still messing with optomizations, is adding a color definitions table worth it?

      edit, YES, only 32 unique colors ever