>When I come back I'm going to ERP with you and talk about killer clowns and dinosaurs. I want it up the butt soon...
  • Welcome. Registering and having your account be approved may take a while since there's only one guy checking and approving accounts and guestposts
  • Boards are being moved around and added. Leave feedback in this thread and let jannies move your threads

Shroomchiver - Shroom Thread Archiver

https://u.pone.rs/nrpojhye.zip
What it says on the tin. "Shroomchiver" is a simple python tool that should hopefully aid you in archiving this site. It works by scraping information from the site through a Chromium/Chrome window and repackaging the contents into a new, clean and easy to navigate interface. If you encounter issues, please ping me and I'll attempt to see to it if I can. It runs like a dream on my Core 2 Duo and can scrape an entire page in six seconds flat so there's that. A lot of QOL junk in here too alongside a search function.
1789252638787.png 1789253492876.png 1789253708253.png
>Do I need to pre-install Chrome?
Yes. Versions as old as v109 work.
>Does it work with Ungoogled Chromium?
No.
>Linux? BSD? Mac?
Yes. Maybe. Yes. Once again untested, but the code is there.
 
Last edited:
@cargo You said something about some attachments not being downloaded before, have you found the fix for this?
Yes, most of it was down to certain attachments being on pages lacking certain protocols or certs. Some nonsense like that, it's been hours at this point. Fixed it by simply fiddling with how attachment links are grabbed and adding urllib3 to the script and asking it to allow said links while hand-waving warnings. There are still some very slight hiccups that are impossible to fix without significantly crippling download speeds but they should be extremely far and few due to taken measures with cooldowns and such to please CFs rate-limiting.
 
Last edited:
@cargo Claus broke into my house and shat on my bed after i clicked on download.
 
Back
Top Bottom