now that the internet is getting locked up, what's the best way to grab a pristine offline copy of a whole website?

>>106115204 (OP)
Wget is in my experience easier to use than httrack and does the job much better without any unnecessary fuss.
wget -r –page-requisites –html-extension –convert-links example.com

and voila you've got a copy

>>106115204 (OP)
You just answered your own question, but you'll need to alter the defaults for a more encompassing approach.

>>106115204 (OP)
there is a download button for the entire internet. But I forgot where it is.

wget -r https://*

>>106115227
>>106115363
That doesn't work with a lot of "modern" websites. I use pywb, and it's pretty good, although there are bugs that never get fixed even though people submitted PRs.

>>106115580
ntas but i've been looking an alternative for httrack as it also does not work for javascript heavy sites, looks like what i've been looking for this whole time

>>106115204 (OP)
A lot of good websites implement anti-scrapping measures. Including anti-wget.
Just read a book.
Fuck the governments.

>>106115204 (OP)
most modern websites use javascript and talk to the server db all the time you can't run them offline

>>106115698
>>106115580
had issues with some simple cosmetic js too with httrack

>>106115204 (OP)
man, the ancient tools for offline website. rare to see it here. lmao

>>106115204 (OP)
Cyotek WebCopy is what you want

>>106115227
lol retardo you're supposed to use mirror, also the command can be shortened to "wget -mkEp"
have to say httrack gui is better, it grabs stuff that wget can't

im kinda interested in Squid Cache proxy + SSL bumping. anyone ever tried it? how does the cache works? are they stored in a 'opaque' database or can you just open the cache and browse it like normal files?

>>106115978
>ancient
considering how old it is it still does the job fine for some sites