← Home ← Back to /g/

Thread 106236741

10 posts 10 images /g/
Anonymous No.106236741 >>106236919 >>106237317 >>106237646 >>106237664 >>106239412
whats the best and most complete 4chan archiving method for linux? can't seem to find one that has the features i want (automated rechecking + downloading entire boards + targeting theads with regex & optionally support for other chans/archives such as lainchan or archived.moe)
Anonymous No.106236919
>>106236741 (OP)
Friendly bump because I need something to do and I'm bored as fuck at work. Also would be something nice to run on my homelab.
Anonymous No.106237317 >>106237352 >>106237452
>>106236741 (OP)
please bros
Anonymous No.106237352
>>106237317
one you write yourself?
how hard can scraping 4 keks be?
also we even have an api , no?
Anonymous No.106237452 >>106238524
>>106237317
and heres lainchan
if a simple curl works, then python's beautifulsoup should
its gonna be ages i didnt use it but it has comfy functionalities and automations
python + BS could be a good starting point
Anonymous No.106237646 >>106238524 >>106239412
>>106236741 (OP)
https://github.com/reasv/mitsuba
https://github.com/bibanon/neofuuka-scraper
Anonymous No.106237664
>>106236741 (OP)
>whats the best and most complete 4chan archiving method
Inhales
>for linux?
>
Anonymous No.106238524
>>106237452
>>106237646
Thank you
Anonymous No.106239076 >>106239412
roll your own software in golang. The standard library has everything you need.
Anonymous No.106239412
>>106236741 (OP)
These might cut it for you >>106237646

or
https://github.com/sky-cake/Ritual
https://github.com/sky-cake/ayase-quart
>>106239076
SIMPLE BUT REFINED
GUARANTEED TO BLOW YOUR MIND