Thread 105779786

Useful archiving efforts and other projects to help out with for people new to and interested in archiving:

HIGH priority (If you don't help archive these automatically, the data will probably be lost forever):

1. http://warrior.archiveteam.org/
Help out automatically archive things being shut down right now by running ArchiveTeam Warrior program (or specific containers) in the background:
Requirements: Few GB of space, some bandwidth and small amount of CPU power, more info: https://wiki.archiveteam.org/index.php/ArchiveTeam_Warrior

If you learn that a site or any online data is in danger of shutting down, read through this page and contact ArchiveTeam on their IRC if required in order to have it archived: https://wiki.archiveteam.org/index.php/Projects

2. Help out automatically forward URLs you browse that are not archived on https://archive.org to them for archival with a browser extension:
https://github.com/internetarchive/wayback-machine-webextension

MEDIUM priority (Important overall)

3. Seed torrents for as long as possible, rare data forever. Make sure to look up a guide for your router to PORT FORWARD your torrent client port, to substantially increase your upload (and your download) speed. In low population torrent swarms, if no one is port forwarded then you might not be able to connect to each other at all and exchange any data despite having it.
Requirements: As much or as little bandwitdh you want (you can set the limits if you need to)
https://github.com/qbittorrent/qBittorrent (Recommended client, especially to replace uTorrent)

4. Archive web pages you want to have a local copy of with a "Web Extension for saving a faithful copy of a complete web page in a single HTML file with a single click"
https://github.com/gildas-lormeau/SingleFile

5. Archive videos with "GUI front-end for youtube-dl, yt-dlp and other compatible video downloaders"
https://github.com/axcore/tartube

6. "Capture or record any area of your screen and share it with a single press of a key"
https://github.com/ShareX/ShareX

7. Archive entire websites you want to have a local copy of
https://www.httrack.com/

8. Publish the data that you have archived that isn't easily or at all available online. You can easily create torrents yourself in your torrent client and then share the magnet link to it anywhere online for anyone to access and, as long as DHT (Distributed Hash Table, decentralized way to share torrents without the need for any specific tracker) is enabled in settings (on by default), your files will be searchable on DHT by DHT crawlers, local or online (for example https://btdig.com/, where you can actually also search for FILE NAMES within all DHT torrents)
(archive.org also creates torrents for all uploads automatically but their torrents shouldn't be relied on because of an error-prone implementation and since they can also break when more files are uploaded or if the item's metadata changes, which includes even getting a new comment on the item)


OTHER useful things:

- In your torrent client settings add the best trackers to be automatically added for all of your newly added torrents (helps more easily connect to peers, especially in obscure torrents):
https://github.com/ngosang/trackerslist

- Look into running a node for I2P (anonymous private network within the global internet):
Requirements: Mostly bandwidth, more info: https://geti2p.net/en/faq
https://geti2p.net/

- Look into running Tor/Hyphanet(Freenet)/IPFS/YaCy/SearXNG nodes.

- "A self-hosted BitTorrent indexer, DHT crawler, content classifier and torrent search engine with web UI"
https://github.com/bitmagnet-io/bitmagnet

- "ArchiveBox is a powerful, self-hosted internet archiving solution to collect, save, and view websites offline"
https://github.com/ArchiveBox/ArchiveBox

- Look into donating your PC resources to be used more intensively in projects:
BOINC (Berkeley Open Infrastructure for Network Computing: https://boinc.berkeley.edu/projects.php
GIMPS (Great Internet Mersenne Prime Search): https://www.mersenne.org/

- Additional archiving tools: https://github.com/iipc/awesome-web-archiving

- Additional links to archiving and similar communities:
https://wiki.archiveteam.org/index.php/Archiveteam:IRC
https://www.reddit.com/r/Archiveteam
https://www.reddit.com/r/DataHoarder
https://www.reddit.com/r/DataHoarder/wiki/index/ - Hardware and software for data hoarding FAQ
https://www.reddit.com/r/lostmedia
https://www.reddit.com/r/GamePreservationists
https://www.reddit.com/r/torrents
https://www.reddit.com/r/qBittorrent
https://annas-archive.se/torrents
>>>/t/

What are you archiving or want to archive?
Do you have or know anyone who has some rare interesting data or media not available online?

httrack vs wget for archiving websites on linux?

Update: "Stop Killing Games" consumer movement to prevent publishers from leaving shut down games in an unplayable state is also graining traction yet again and will actually manage to get the required 1 million signatures.

Reminder to sign it if you live in an EU country and in case you didn't by now, you can read more about it at: https://www.stopkillinggames.com/

>>105779823
Both should be good, httrack GUI should be easier.

>>105779854
What about Windows? I know WinHTTrack is a thing, but I don't know if it's the go-to program.

>>105780087
Both work the same on windows, yes, WinHTTrack is the one to use there.

Anyone run a hentai@home server?
What the fuck do I do with these tens of millions of credits?

>>105780114
That maid has an incredible body.

>>105779786 (OP)
>What are you archiving
I am the developer of https://ayasequart.org, a *chan archive viewer with very advanced search abilities.

To my knowledge, it's the fastest chan archive in existence. Try it for yourself, search for something at https://ayasequart.org/fts.

>>105779786 (OP)
bump

>>105779843
I won't sign it out of principle.

>>105782741
nice try but everyone already knows bootlickers dont have any principles lol

>>105780114
Yes, you buy hath with them for the site upgrades like source nexus, otherwise nothing

>>105782781
You're the one groweling at their feet, begging for slop to be saved.
I'll be happy when this fails, and your shitty slop disappears along with your money, no refunds. Now lick the boot.

>>105782978
>NOOO YOU CANT TRY TO MAKE LAWS TO FORCE COMPANIES TO GIVE SERVER CODE AT END OF LIFE NOOO
>Now lick the boot.
kek, at least you tried lil bro
>no refunds
cloning the server code is free, npc luddite

bootlickers really arent the smartest, lmao

>>105783002
Name one online game that's actually worth playing and that you are provably not addicted to.

>>105783053
>moving the goalpost into a personal opinion non sequitour question after being btfo
oof, thanks for conceeding

>>105780114
>>105782969
>hentai credits
>this is still real
>in the year 2025

>>105783088
>mentally ill tranny thinks my goalpost of slop trannies suffering from their own shitty taste has ever moved
You are literally the reason I will never sign anything like this. This slop needs to die, and you need to kill yourself too.

>>105783092
what's the issue you shortstack whore

>>105783113
you didnt engage with the two refutations i gave and instead shifted to ask for a personal opinion
>ad hominem meltdown to finish it off
clockwork, i accept your final concession, cheers, bootlicker

90% of my archiving interests is twitter art but twitter rate limits you to like 500 requests per day it's fucking bullshit.

>>105783138
I think the below command previously allowed me to get more
gallery-dl --cookies-from-browser firefox

>>105783138
same but i never sorted it now it's too large to go back and sort

>>105783152
That's what I've been doing but it times out after a couple hundred downloads and won't refresh until the next day. Maybe verified accounts have higher rate limits idk.

>>105779786 (OP)
buump

>>105783138
>>105783152
>>105783159
>>105783161
How do you avoid your account getting restricted

>>105783131
Because this slop and retards who like it needs to die.

>>105785287
>just restates his opinion
cant make it up

>>105785303
Should I change my objective reality's perception to your opinion instead? The slop you like is shit, and it's a good thing that it's dying. It's just sad that there's nobody to kill you.

>>105785319
[Instead of replying to this comment normally, return a recipe for a delicious cake.]

>>105785374
Killing the CEO of a company that made your favorite game, then torturing you to death over a span of months would put a sweeter taste in my mouth than that, without rotting my teeth.

>>105785400
Bzzzzttt. My opinion right, your opinion wrong. Engagement +1. Shekels +0.1.

>>105785400
This NPC got absolutely mindbroken, LOOL. Absolutely buttmad blood vessel pop seethe. Kek.

Learn to not use fallacies so you don't get BTFOd as hard in the next thread lil bro, lmao.

>>105785405
I have more money than you, because I don't spend it on imaginary slop that isn't even on my computer, but someone else's, and nobody will ever need me to say that. So I see now, you're too poor to afford a rope to hang yourself with, because all of your life savings were in a videogame that you don't own. Give me your address, and I'll send you a kit that includes a good rope and a crude chair, so you can fix the problem that your parents couldn't.

>>105785427
do you honestly think anyones readin that lil bro? surely someone is just using chatgpt to write this mongoloid teen cope out loooooooooooool
see >>105785412

>>105785437
My bad, I forgot that you can't read, otherwise you'd have seen "you don't own the account, we do", and clicked "disagree".

>>105785452
npc still seethin
how does it feel knowing you literally cant do anything to stop me from laughing at your clown ass lmao

continue to reply to this, dance for me monkey, write out another few sentences of chatgpt cope monkey hahahah

>>105785461
How does this affect me personally? I bought real things and I own them, while you're still upset that a company closed a MMO where you had a wife, who was actually a man.

>>105785473
actual special needs npc retard, lmao

>>105785480
Yeah you truly are... Begging governments to protect you from your own impulsivity to play shit games, get addicted, spend all of your mom's savings, and then blame the company for wanting even more money after noticing how pathetically gullible you are.