Thread 106305006

If it works it works edition

previous:>>106267003

READ THE (temp)WIKI! & help by contributing:
https://igwiki.lyci.de/wiki/Home_server

/hsg/ is about learning and expanding your horizons. Know all about NAS? Learn virtualization. Spun up some VMs? Learn about networking by standing up a OPNsense/PFsense box and configuring some VLANs. There's always more to learn and chances to grow. Think you’re god-tier already? Setup OpenStack and report back.

>What software should I run?
Install Gentoo. Or whatever flavor of *nix is best for the job or most comfy for you. Jellyfin/Emby/Plex to replace Netflix, Nextcloud to replace Googlel, Ampache/Navidrome to replace Spotify, the list goes on. Look at the awesome self-hosted list and ask.

>Why should I have a home server?
De-botnet your life. Learn something new. Serving applications to yourself, your family, and your frens feels good. Put your tech skills to good use for yourself and those close to you. Store their data with proper availability redundancy and backups and serve it back to them with a /comfy/ easy to use interface.

>Links & resources
Cool stuff to host: https://github.com/awesome-selfhosted/awesome-selfhosted
https://reddit.com/r/datahoarder
https://www.reddit.com/r/homelab/wiki/index
https://wiki.debian.org/FreedomBox/Features
ARM-based SBCs: https://docs.google.com/spreadsheets/d/1PGaVu0sPBEy5GgLM8N-CvHB2FESdlfBOdQKqLziJLhQ
Low-power x86 systems: https://docs.google.com/spreadsheets/d/1LHvT2fRp7I6Hf18LcSzsNnjp10VI-odvwZpQZKv_NCI
SFF cases https://docs.google.com/spreadsheets/d/1AddRvGWJ_f4B6UC7_IftDiVudVc8CJ8sxLUqlxVsCz4/
Cheap disks: https://shucks.top/ https://diskprices.com/
PCIE info: https://files.catbox.moe/id6o0n.pdf
>i226-V NICs are bad for servers
>For more SATA ports, use PCIe SAS HBAs in IT mode
WiFi fixing: pastebin.com/raw/vXJ2PZxn (embed)
Cockpit is nice for remote administration

Remember:
RAID protects you from DOWNTIME
BACKUPS protect you from DATA LOSS

AAAAAAAAAAAAAAAAAAAAAAAAH I WISH HARD DRIVES WEREN'T SO EXPENSIVE

>>106305044
Hoard less then.

>>106305523
and just fucking die?

>>106305529
¯\_(ツ)_/¯

I finally got the Ubuntu server set up
tbf it's probably only because I went out this morning and bought an SSD to usb so I can manually install it on the SSD
And then plug it into the machine

If I kept trying to make something that can auto install from the USB onto the SSD while it was in the headless machine, i would ahve probably continued to have gotten nowhere
More money down the drain for this adapter... I was a couple dollars off for the minimum to use my credit card too so I bought a can of compressed air that I don't need in my panic. More money gone...
Well I tried my best to avoid it the past 3 days but installing a server truly headless without direct access to the SSD may just be impossible

Hopefully this will help a complete n00b
I'm new to this and I'm going to just document what I did, if it helps other people it would be nice
https://rentry.org/q8v4oxze

What's the best way to synchronize files on a windows 10 server from a smbd share? Like how you would use rsync to sync two linux devices over nfs.

>>106305878
Syncthing

>>106302214
Requesting info on question from last bread

>many devices will boot once power is restored with bios settings
>many ups stop power draw once the device shuts down while on battery
>will only restore itself once power is restored
I now understand why NUT doesn't need to handle boot or that I don't need to bother with wake on lan

what's a good IT skill to learn if i have the week free?
kubernetes?

>>106306462
an indian accent.

if already completed, mid-west accent.

>upgrading from proxmox 8 to 9 via ssh
>near the end asks me what I want to do with my manual grub changes
>choose merge
>conflicts
>choose open new shell to manually fix grub
>arrow navigation in nano is fucked somehow, moving around corrupts characters in its path
>can't ctrl-x or ctrl-c out
>ctrl-z out out of despair
>dun goofed cause now there's a running apt process partway through a dist-upgrade locking a bunch of stuff I don't know how to get back into
>nuke it and do a clean install of pve 9
Fortunately it was a mostly empty pve 8 installation anyway with nothing important on it.

>>106306633
i can shit in the street.
i can shit anywhere
is that good enough?

>>106306728
I wouldn't trust any os to handle a major version upgrade. I would always probably just end up installing fresh every time. I know debian is supposed to handle this but I probably changed something a long the way to not even bother trying. gave up on proxmox when I had to upgrade and read through the process and said fuck it.
now I just use rocky 9 and libvirt and podman.... Except that rocky 10 just released so hopefully the fresh install goes well enough, they don't have an upgrade path they just tell you to reinstall.

Tell me I don't need this

Any bros know of a server chassis that can support a lot (8+) 3.5 hot swappable drives and an optical drive so I can support ripping and storing raw blurays

>major version upgrades are unstable on "stable" distros
this is why i only run rolling release

>>106307079
btw I am trans, not sure if that matters

>>106307207
Nigger, I have been enjoying Konata longer than you have existed

How do i go about fixing this for my sites? I could have sworn when i did this last for my jellyfin.domain.com it did at least okay (like a B) but now its an F. Everything is going through Nginx Proxy manager, are all of these things that i can force implemented there or would it be a per application thing, or settings from the admin site of the web app?

>>106307266
I seem to have mostly figured it out by adding the following under advanced in all of the hosts, although Content-Security-Policy is still failing. But im not sure how to secure the demain.com itself. Right now i somehow wiped out my wordpress site that use to run on the 80 port and havent set anything else up to get pointed to that, but the proxy manager itself on domain.com:81 is still visible

location /
{

# Force SSL
include conf.d/include/force-ssl.conf;

# HSTS (ngx_http_headers_module is required) (63072000 seconds = 2 years)
add_header Strict-Transport-Security "max-age=63072000;includeSubDomains; preload" always;

add_header X-XSS-Protection "1; mode=block";
add_header X-Content-Type-Options nosniff;
add_header X-Frame-Options SAMEORIGIN;
add_header X-Robots-Tag none;
add_header Permissions-Policy "geolocation=(),midi=(),sync-xhr=(),microphone=(),camera=(),magnetometer=(),gyroscope=(),fullscreen=(self)";


add_header 'Referrer-Policy' 'same-origin';
proxy_headers_hash_max_size 512;
proxy_headers_hash_bucket_size 128;


proxy_set_header Upgrade $http_upgrade;
proxy_set_header Connection $http_connection;
proxy_http_version 1.1;


# Proxy!
include conf.d/include/proxy.conf;
}

>>106307266
>>106307421
stopped caring about this when I went wireguard for everything.
still use ssl/tls but haven't bothered beyond the defaults.

>>106307228
>Boy, I've been dilating since you were shitting in diapers!

>>106307472
Im not familiar with wireguard, i have openvpn running on my server, usually for accessing my fileshares and my transmission container. But things like nextcloud and jellyfin i dont want to have to always connect to that. And jellyfin gets used by other people, im also trying to get jellyseerr setup for others.

How do you get sonarr to move tv shows and anime do different directories after they finish downloading? It doesnt seem like i can add 'anime' as a tag as nyaa doesnt ever say anime in the downloads. I'm also not sure how to get the files from the download directory to be deleted automatically. When i start a movie request from jellyseerr they are being fed fine from radarr into my transmission docker container web app and moved to movies directory (although original is not being deleted) but for sonarr I'm not sure how i can get it to differentiate. On sonarr and radarr if i set anything in this dialogue i get the error in system status "You are using docker; download client Transmission places downloads in /data/radarr but this directory does not appear to exist inside the container. Review your remote path mappings and container volume settings." And starting a new request just downloads to the normal transmission downloads directory. Even manually making folder with the given category name. Feels like I'm missing something

I've been archiving manga for a long while and now looking for a reader server to use so I can read my files anywhere I want to.
I've looked into Komga and Kavita, but they seemed to require you to use a certain folder structure which would not be plausible in my case as I have more than 1000 directories/entries in my collection.
Is there a tool/program I can use that will not require me to change my folder and filename structure?
I only need a reader for all archive types + pdf and progress indicator.
My collection is on truenas community/scale.

>>106307504
You should use wireguard it's a simple way to protect your stuff from the outside world, why even take the risk unless you're hosting something to the outside world. Also it's good practice to use wireguard and have them actually authenticate to avoid abuse

>>106308353
>why even take the risk unless you're hosting something to the outside world
because the people that use my jellyfin server arent going to setup wireguard client, i also cant necessarily set it up on every device can I? For example one of the TVs in my network doesnt have a jellyfin app so i have to just use the browser. Now this is in my network so that doesnt matter but it could for someone else

>>106308372
>because the people that use my jellyfin server arent going to setup wireguard client
it's true, probably why there's a fair bit of tailscale being used despite the obvious drawbacks of a 3rd party involved.
>also cant necessarily set it up on every device can I?
you don't need to if it's local, but I still do (>>106307472) but I wouldn't worry about the ssl/tls headers being less than perfect.
>my network so that doesnt matter but it could for someone else
yeah you could would have to have each device with a wireguard setup, or set them up a gateway device to route your services through the wireguard tunnel while the rest go out to the internet

I've given up on the casual end user being able to do any of this. I did give my buddy a amazon fire stick with wireguard set up on it for jellyfin. worked ok, couldn't handle 4k despite it being amazon 4k stick. my shits just way higher bitrate than amazon streamed garbage.

>>106308372
They want free shit yes?
Why the fuck are you letting people abuse your hard work without any respect.
They better get used to following suit and accepting the price. I'm not a charity if you want to use my shit you need to sign up in a way where I can keep tabs on you if some funny shit happens.
I guess openvpn is fine but everything else on your network should be wireguard you can't account for what the people that use your service might have going on either which might lead to you having a compromised system on your network.
Personally I would host my jellyfin on a vlan and have it unable to communicate with your main network but not the other way around.

Can I rewrite a domain to another domain at the network level? I know I can do it in my browser. I would like to be able to do it in adguard home if possible. The normal DNS rewrite goes from domain to IP.

I found that searxng can exclude or rewrite certain domains. So I just started hosting a redlib instances and can now have searxng replace the reddit responses with redlib. It would be nice if I could do this at the network level instead though

>>106308425
>everything else on your network should be wireguard
I thought this was a VPN, are you saying that even devices like a wired desktop on your local network are using wireguard pointing to the server you run? I had thought you meant only outside devices
>Why the fuck are you letting people abuse your hard work without any respect.
I dont really consider it abuse, i set up stuff for my use but once it has been setup no harm giving them a read only jellyfin login (or a request only jellyseerr). If anything it seems like VPNing them into my network is higher risk. I will look into it, i only just finally got openvpn setup but guess it wouldnt hurt to move to wireguard, although the basic searching ive seen dont indicate that its more secure. I rarely use my vpn though, mostly just to start downloads or access my fileshare when away, but most of that is not needed with jellyseerr/radarr/sonarr

>>106308491
Can they not setup wireguard on their phones and use the wireless hotspot function to spread it to their other devices using their own local wifi?

How is running a jellyfin server on windows? I keep having fun linux problems™ with mine running on truenas with permissions problems and plugins constantly disappearing and other such fuckery and bullshit. I was considering just running it on my windows 10 vm (that I already have running for downloads/torrents) so it would hopefully just fucking work, be easier to fix when it breaks, and likely be easier to get *arr apps running and all in kumbaya .

>>106308533
Would you disconnect your smart tv or roku or similar from your home network to connect it to your hotspot? I wouldnt even do that unless i was desperate. Most modems/routers dont allow you to setup a vpn from there either. I see what youre getting at but i still dont understand this huge risk from jellyfin. I usually did run a photography website from my domain as well so that would always need to be exposed. Same with stuff like game servers, im not forcing people to vpn in for minecraft or some random game. I get the wireguard/other vpn for many things on a home server but not stuff like this.

>>106308583
Truenas uses docker containers and they seem overly opinionated with their configurations, I had to do manually tuning myself.
It makes the most sense to use truenas desu but I've had some issues with several applications.
>>106308591
A mobile hotspot can be configured to a brain dead password on the same screen and you these devices remember connections.

Asking again for a doujin library software THAT SUPPORTS LOOSE IMAGE FILES. Not archives only.
It turns out lanraragi really just doesn't support this because the author actively refuses to.

>>106308601
Yeah I've had my fun playing amateur it all my life, I just want this shit to fucking work already

>>106308601
>It makes the most sense to use truenas desu
Do you run many things from your nas? I set mine up so that truenas is only storage, i have another server which mounts the shared directories and runs any other software as needed

>>106308697
What kind of features would you want in a doujin library? I'm thinking about adding pools/collections in my project. I imagine they could be used for doujinshi if there's a decent way to visualize the stuff to read/goon?

>>106308806
I only intend to run Paperless NGX, synthing and jopplin server from it

>>106308852
Per-book tagging, which later can be leveraged to scrape tags from its original source.
A nice reader interface.

But desu I probably wouldn't use a boruu for this, I already have a folder structure in place for my collection and boorus usually require their own.

>>106308939
Yup, mine imports stuff to its own directory. Thanks for the ideas though. I never really got into doujinshi, but maybe I should start archiving some. The future is looking grim.

I bought an old place, solid structure but no internet hardware. Should I pay the extra and go straight for cat8?

>>106309043
Do you foresee yourself ever using multiple 40g connective devices? 25g? Yes? Then go for it.

>>106309043
>>106309162
Nta but how much extra is cat8? Neither of my modems and none of my desktops (including server and nas machine) even have mobos that support more than 1gbps but unless its a huge increase why not go for it?

>>106309162
>>106309505
It's roughly a 2.5x increase in cable costs where I live, which is probably worth it IMO just for the security that I won't have to fuck with it for a long ass time - I can't say I NEED it now, but even only a few years from now I could see a few use cases

Thanks anons

>>106309043
If your runs are less than 30m, then yeah.

>>106309536
2.5x compared to cat6 or cat7? If its the latter I probably would advise against it, unless the total cost isnt very high in the first place. Like the other anon said youre very unlikely to get close to that. Do you even have any devices using 10gbps right now? My house built in 2016 is cat6 wired, no device in the network can even use that much.

>>106309577
Setting up the main point in an office/bedroom towards the middle of the place, should be under 20m for all the room access points

>>106309668
Compared to cat6 - who would bother with cat7?

>>106307421
How do I into nginx? I tried the manager thing but it didn't handle simple reverse proxy.

alright bros, ive finally bought parts to fix up my old broken ryzen 5 1600 pc. they should get here tomorrow and i intend to turn it into a server to host game servers and jellyfin for myself and friends. what distro should i put on it, debian? it doesn't really matter right? all the stuff will probably be running in docker containers anyways

>>106310228
Don't get redhat anything unless you're willing to actually learn selinux.

>>106310180
I had trouble at first too, i tried the GUI proxy manager first and it didnt work right, then i tried the normal version and had all kinds of issues. I just removed everything and started with the proxy manager again and worked fine. The only thing i cant get working is a local access level. I think it's because most of the stuff is in docker containers so even from within my network the docker instance(s) arent seeing them as in network.

>>106310322
I have different issue, I want to set up reverse proxy.
When I set it in NPM it doesn't work, while from the config of the native nginx it works.

>>106308083
I use overseerr to request and automatically tag it as anime, and in sonarr I have another download client that's lower priority and only used for tag:anime that moves it elsewhere. It looks a bit goofy since it's the same client, but it just works.

>>106310341
I also needed it as a reverse proxy and it works fine. If you have it working from native why not just keep using that? Most of my problem was hadnt registered the subdomains anywhere, but since i had restarted i have *.mydomain.com pointing to my network so i can add them as needed

>>106310356
How are you having it tag anime? When i use jellyseerr i dont see any way to add a tag or that tags like that exist on something i would want to request. I also never really decided where anime movies should live. I have ghibli ones in movies but pretty much all others are in anime. Ill probably end up still just manually downloading anime, except maybe setting rss for airing things but so far i have kept those in downloads rather than moving them to a more permanent location in case i drop them or dont like them much. Or to download bluray rips if those become available

>>106310409
Because I want to add more and I don't want to vibe code it.
I'm not understanding the config syntax.

>>106310409
>>106310356
Im also having trouble figuring out how (even if the tag came through) how to get sonarr to send something to /anime or /show root folder. I see there is an auto tag condition which has Anime and i can select as required, but then do i add the /anime folder as a condition Like this would work?

>>106309721
If you think you're likely to jump to 25 or 40, and don't want to pay to get the old stuff pulled out when you do, I say go for it.

>>106310468
>>106310409
You're right, it's not Overseerr tagging it, I'm using an auto tag like in your screenshot.

>>106310481
Then how is that being fed into putting it in the right directory? I tried with a show and so far it did put it in the /shows directory (whats done) but the /anime was added second. So far im not really seeing any real documentation on it. Ive seen people say they got it working with no problem but no explanation as to how. Running 2 instances of sonarr seems like it would be easier almost but i would rather not do that as it seems wrong. I'm also not sure where I would add RSS functionality. Currently i just check anilist for when shows have come out each day and do it manually.

>>106310468
I'm not using any conditions, I'm just having the download client move it to an /Anime folder. Overseerr determines the root folder for me, I guess your condition might work too

>>106310506
Ooh, i see. I had not seen these setting under sonarr. That makes more sense then why nothing was really coming up from searching specifically about sonarr. I guess that kind of settles the anime films being in /anime or /movies since i dont see the same option for radarr. Unless those are already being counted as a movie

>>106309043
>>106309536
it's literally only now that we're finally getting usable 10GbE NICs. trying to futureproof copper beyond Cat6A seems silly to me.

>>106308425
They're probably his friends and family, Anon

my server runs windows 10 and will never need anything else

bro i have a computer back in home that i put it to sleep all the time and wake it for remote access

i'm currently contemplating getting an UPS to protecc from power outage
i know UPS can send shutdown or hibernate command to active pc

but what do UPS do to a sleeping PC
will UPS wake the PC and hibernate it to prevent data loss?

>>106305044
>>106305523
It's fine if you do the math. How many streaming services are you replacing? Spotify is $12/month. Netflix is $20/month. That makes $384 per year.
Google cloud standard is $20/month/TB of storage. That's $240 for 1TB(!) of storage per year. Hard drives are infinitely cheaper than that, and the more storage you have, the more your savings scale.

Even if you replace hard drives when warranty ends you probably still save money. Also considering upfront cost of the server and electricity, it just makes sense.

>>106311437
>Google cloud standard is $20/month/TB of storage. That's $240 for 1TB(!) of storage per year.
???

>>106305006 (OP)
Could be the wrong place to ask so sorry in advance. I want to scrape boorus to a local installed shimmie2 or szurubooru. How can I scrape other boorus with tags and put it in my own instance?

>>106305006 (OP)
Is there a way to host a netbird server without docker? All I can find on the internet is people saying that it is possible but those are just the clients and not the server components, same goes for AIs.
Reddit morons aren't really helpful either and are basically just saying "just use docker bro" without even considering that I cannot use docker because the networking clashes with Incus.

I assume there isn't but I'd enjoy it if someone proved me false here.

Pic not related.

>>106311167
Depending on your software it will read the event wake it and send the signal.
I don't trust the vendor software so I use NUT for my server. Once you NUT you won't go back because you will keep NUTTing non stop

Looking to build a new NAS to replace my existing one. Any CPU recommendations for me buying new?
Beside being used as a NAS, I'll also use it for a few docker containers. Nothing more expensive than Jellyfin (which will only serve me on my LAN).

>>106313033
How many drives are you going to use?

>>106313042
I currently use two, main reason to upgrade is for more drive space. I imagine I'll initially set up 4, but I can't see me ever using more than 6 (I'll just consolidate to larger HDDs in the future).

>>106313050
I don't think this will fit in your plans but I use a odroid h4 ultra in a itx case with 3 16tb drives.
it sips on power and can do whatever I want on only 3 cores. Now that I have more gear I'm moving many of my services to other devices and I think I'm going to make it a full time truenas scale install

>>106307079
most companies view optical as dead, so you'll have an extremely hard time finding a reasonable case that includes space for it.
Buy a nice case that you like and leave an external drive plugged into the system.

tfw final parts of the build are rolling is as the internet slowly kills itself. Knowing I'll soon be able to host/hoard all of my degenerate content is max comfy.
I should have done this long ago. How could I have been so stupid to fall for the stream meme!?

>>106307036
who buy this?

>>106313708
what all are you setting up, how much storage space?

>>106313068
Cheers. I've also been considering building something cheaper and just setting it up as a pure NAS, so I appreciate the recommendation.

>>106313982
Jellyfin
Home Assistance
Immich
16tb x4 (Will add a second pool of the same size next year.)
Going with TrueNas. I know people love to glaze unraid and proxmox, but I don't intend to fuck around with virtual machines.

Still looking for something to host my manga, light novel and audio-book collection.

>>106314177
Kavita works great for both books and comics (including manga)

>>106314177
>Home Assistance
I hadnt heard of this before. Might have to look into it.
>immich
is this better than librephotos? I have setup nextcloud to auto backup my phone photos instead of google photos and for notes instead of keep but its definitely not ideal for a google photos replacement. I tried librephotos but the searching/auto tagging was pretty bad compared to gphotos so it barely seemed worth using

>>106314302
I had to remove nextcloud, it tries to do so many things at the same time it becomes shit

>>106314315
i somewhat like that i can have photos from different areas of my phone backed up to different places, so i can save twitter photos and they will be in a different folder than my camera roll, or screenshots for example. It does backing up pretty well but i dont really have anything to compare it to. I wanted to download everything from my gphotos but their backup request process gives you such a bullshit output of multiple zips and folders and shit.

>>106308583
>How is running a jellyfin server on windows?
just werks for me

>>106314289
>Kavita
looking into it, every part of the project seems to fit my needs. My only concern is the mention of a subscription (Kavita+) to access premium features (external metadata).

>>106314302
>Assistance
Home Assistant.
allows you to manage and monitor all your IoT devices from one centralized location.
>is this better than librephotos?
I honestly don't know. Sorry, fren.

Why does glances in web mode use so much cpu? All it does is read and serve some data so why is it using such a disproportionately large amount? 8% of one of my cores is dedicated to glances. Its small but again its such a simple task i think.
Im optimizing for power savings and this is sorta weird i think.

>>106308697
szurubooru is fine as long as you keep your files under 100g (size at regular coom images). It has no db cashing and so if it gets too big expect big slowdowns.

>>106315386
100gb total? That seems a bit small.

>>106315407
I misread. Thought anon wanted a booru not doujin library.
Anyways yes, since it has no caching and the db just being bad maybe having too many individual files makes it unusable.
I have a local danbooru instance and while it does have a bigger base ressource requirement its fast no matter the amount of files. This is because of its cache i think

>>106315427
that is the main reason why i switched to danbooru from szubooru. Everything but speed is better on szubooru in my opinion however.

>>106315427
Hmm. Is there a scraper extension like with szuru for a local danbooru instance, and is it easier or harder to do api calls?

>>106305878
rclone

>>106308697
>It turns out lanraragi really just doesn't support this because the author actively refuses to.
Wasn't there an anon a few threads ago that had loose files working with lanraragi?

>>106315462
>Is there a scraper extension like with szuru for a local danbooru instance
You gotta write that stuff on your own. I know that danbooru has a scraping account by default which is also what gelbooru uses but there are no docs about it.
>and is it easier or harder to do api calls?
Depends. There is pybooru which if it works makes things very easy but it doesn't for me so i make my own API calls. There are some confusing things but its doable. Mainly you first upload some media, get its media ID in the reply, and then make it a post by supplying it with this media ID and the tags and other stuff you want. In general its not as intuitive as szuru.
Also YOU NEED to castrate its auto-tagger. It will hog a lot of resources when you upload media. Remove its address like in this image.
Also modify the docker-compose file to store tumbnails on an SSD and the actual files on an HDD if you want. You should already use ZFS so the HDD is not actually used when its avoidable.

Again, no docs and not very intuitive. Learned these things by trial and error.

>>106312789
Most of them have some kind of API, using that would be the easiest

>>106315548
>You gotta write that stuff on your own.
This is not hard btw. I have very very minimal programming experience from a couple of years back and managed to do it. Just don't do it as a shell script. You will regret it later.
If you have a spare weekend you will manage do to it.

>>106315491
Yes that's why I even bothered to try, but it didn't work

>>106315699
wtf I could have also sworn lanraragi supported loose files. Or at least used to?

>>106315746
Author claims it was never designed to.
I feel like there may have been some confusion on what "loose files" are?
This is what I meant by loose files

>>106315684
Not that guy but I kinda wish I could integrate a scraper/downloader into the booru itself.
Would be nice to not have to go through some intermediate.

>>106315831
No matter which solution you pick, sooner or later you will get issues or face its limitation and then you will see that only something of danboorus caliber is usable long term. I tried a couple of boorus. There is no need for things to be 'integrated'. Its running on a server after all. And if you want a nice gui to control the downlaoder then you can just make your own. Its unironically not that hard. I never wrote things beyond small one time scripts but a project like its is very fun. shimmie2 sucks too btw from my experience.

Is it wrong to use a service to scrape a booru for Lora creation?
What tool would be the best at that?

why is everybody scraping boorus now? Scared of online ID? Also they were already exposed to a lot of stress before this mess and started fighting it. Its a little late to start now.

>>106315967
I want a braindead method of scraping data to make loras for my ai models

>>106315995
In your case yes, it is wrong to use a service to scrape a booru for Lora creation.
Because if you cannot even use google then everything you are ever going to do in that direction is waste others time and bandwidth.

>>106316056
Don't be insecure, there's always a ton of options easy to find but I rather hear from anons that used it in real time. The typical person will be directed to nextcloud for cloud storage if they followed google even though it's absolute garbage in it's current state.

>>106316171
>The typical person will be directed to nextcloud for cloud storage if they followed google even though it's absolute garbage in it's current state.
you.. are just retarded anon. What is there to say? Every AIshitter OP has links to guides that explain everything, including the program everybody uses, but instead of spending 5 minutes doing that, you spend an order of magnitude more waiting for somebody to spoon feed you. Just pay 5 bucks a month to use somebody else's retard friendly AI gens. You clearly need to.
This isn't even really a /hsg/ specific topic desu...

>>106316241
Yeah you're fucking mad, just stop seething this is on topic, would you have felt better if I was less honest about why I'm using it?
Also every AI image I post I make myself, why would I let my 5090 rig idle doing any of these jobs vs using a low power server?

>>106316285
Im mad? You are still posting despite me telling you where you can find help.
You are quite literately coping. Im only replying because seeing such a mentally handicapped person is rare on the internet. Is your handler on summer break maybe?

>>106315967
>now
lol
lmao, even

>>106316339
>still seething
Have your last cope reply and pat yourself on the back

>>106316345
Its just sorta rare to see so much talk about scraping and boorus on this site after the pedo general got banned. Although now i see why some things are better when they are small and niche.

>>106307079
https://www.silverstonetek.com/en/product/info/server-nas/RM21-308/
https://rackchoice.net/miniSAS6GbsBackplane/114.html

>>106316439
This thread moves at a glacial pace and we need more people talking about anything

I wish more anons would share documentation desu

>>106316439
>>106316477
I'd like a scraping tut as well. Not for porn, but for something else.
Fuck "swap" sites.

>>106316477
>This thread moves at a glacial pace and we need more people talking
not about time wasting shit however. Why even talk about something that has its docs and guides literately everywhere on the internet. Or else you will see people ask how to plug in a monitor on here just you wait.

>>106316515
Many of the guides make assumptions, we're in a age where people that know fuck all are moving to the self hosted and self sufficient pill.
Great opportunity if you ask me, other generals have been able to do it with great success. Even redirecting anons to good sources for information is a good thing

Is DS723+ the cheapest ECC nas you can find?
Kinda don't want to spend 600$

What's your sweet spot for QuickSync CPUs? I've been looking at the chart on https://en.m.wikipedia.org/wiki/Intel_Quick_Sync_Video and it seems like the Tiger Lake generation has the widest amount of support.

>>106316564
dude you don't even need guides on how to run a one-liner. Its yt-dlp level of simple and popular. How desperate can you be dude. And if you are getting into self hosting JUST NOW despite it being a no-brainer for years then tough luck i guess.
And again, using said program is not even a hsg specific topic. Many do use their servers for scraping but not you. You are looking for something else that you could find in under 5 minutes and will only ever do two times before you are bored from training your models.

>>106316646
>Discussion bad
>implying I'm talking about a scraper and not general knowledge
You can leave

>>106315427
From my experience working on mine, what caused slowdowns for me was storing all images in a single directory. After I implemented directory sharding it was smooth sailing.

>>106315831
Idk how well the Danbooru API is documented, but writing a browser extension to scrape their posts pages is pretty simple. All the data you need is right there. But that's assuming you want to pick by hand what to scrap. For something automated going through pages I bet it gets annoying really fast.

>>106315967
I like to coom to images and they don't take a lot of space. Even less so if you're curating your collection and reencoding images into webp or avif.

>>106316682
Bro, everything there is to know about servers in in the OP.
Explaining how to add mods to your minecraft sever or whatever else you are else retarded shit you are going to run on it is not part of this thread.
gtfo newfag. you have other generals to bother.

>>106316757
You're beyond help fuck off, we don't need gatekeeping troons leaking puss on the floor crying

>>106315945
>scrape
If they have an API setup, I'd say it's at least unethical to scrape instead of going through it. If you're going through their API, they have the power to cut you off or rate limit you as they see fit, so it should be ok.

If you want to use a tool like imgbrd-grabber to scrape Danbooru, add your username or an email to the http-agent header so they can message you when needed. For other boorus, idk, just don't try to hit their servers hard. imgbrd has decent documentation, go read it.

https://github.com/Bionus/imgbrd-grabber/issues/2912

>>106309043
Twisted-pair Ethernet above 10 gigabit is vaporware; the spec (802.3bq) was approved 9 years ago and nobody has ever made hardware for it.

If you can run your drops in conduit, do that, and you'll be able to pull whatever you want if you ever need to upgrade. But in either case, I'd go with Cat 6a, and fiber for anything where you might need more than 10 gigabit speeds.

>>106316720
>what caused slowdowns for me was storing all images in a single directory
That is also definitely one of the main reasons. The database in general was also very slow for me. Simply reading post metadata took multiple seconds for a single post and this has nothing to do with all the media being in one directory. The CPU thread was just at 100% printing a couple of strings. Danbooru on the same uses not even half of what szuru did and is infinity faster at it too. Danbooru has slightly higher idle usage but once its actually in action its not comparable to szuru.
If it weren't for these performance issues i would still use it. Very user and dev friendly. They have some of the best and retard friendliest docs out there.
>For something automated going through pages I bet it gets annoying really fast.
Running the scraper and importing can be done in 100-150 lines of shell code. Don't do this however. Use a proper language and it will be even simpler.

>>106316614
Bump?

Anyone here ever written userscripts? How hard/easy is it to call APIs from different domains from the script?
I'm think a simple script that puts a "Import" button on posts and thumbnails on boorus, that just call their API then call the local booru's with the retrieved info.
The sole reason for this would be convenience.

Immich definitely seems nice since i couldnt get nexcloud recognize to work with memories and immich search works well. Although i do like some of nextclouds features. It's also strange that immich library seems to keep every uploaded picture in it's own folder. I was hoping for a flatter structure so i could have library in my /pictures share and access them via filebrowser or whatever else easily. Pic related, very odd

>>106317330
For every feature nextcloud has you can find another project that does the same but BETTER while using less resources. I took this journey much like you have and now I have nothing but contempt for nextcloud

>>106317330
Storage templates fix the folder structure, but Immich really doesn't like the upload library being accessed by other applications.
I have my immich as
Album > Year > Month-day > files
With how unwilling the devs seem to be to add visibility controls for albums (other than archiving) and nested albums, I'm going to switch Immich to ONLY be my camera roll and some specific folders, and everything else will just get Syncthing'd to my NAS based on the folder it's in on my phone.

>>106317399
I realized quickly after posting this thats what they meant by storage template, i just went with year/month/files. Right now i just backed up everything pretty much to there, but what you say is probably better. I havent looked into syncthing yet, i am aware of file browser but not sure that's the right route

>>106317360
It does seem that way, im still using google calendar for now, I would like to move my quick notes away from them so need to look into a good notes alternative to nextcloud.

>>106317455
Yeah the folder view on Immich also sucks ass. I really hate Immich now, so I think having better file sorting is all I really need to get away from the crutch of ML image searching

Also, I set up a Baikal CalDav server and am currently integrating everything into that, it works pretty well since basically everything supports CalDav. I also find that I quite enjoy sitting down and adding things to my calendar manually.

>>106317497
I dont really plan to look at these images via a file browser but the option with this storage template setup is good enough i think. The only thing ive every used albums for in google photos is a shared album with another account i use to put my photography in for display on the google home with the screen. The ML image search has been pretty helpful for me when i cant remember when picture was taken but i knew it had text or was of a car or is a screenshot or something. I dont expect immichs to be anywhere near as good as googles and i still havent gotten my google photos data imported anywhere because of how gay they are with the export processes. I wish i could just select all from the website and download them but of course you cant.

>>106317455
>Notes
https://joplinapp.org/
Look for the docker image to host the server then you can install the program on your other devices and it will work like a charm. I'm really pleased with the performance and functionality of it.

>>106316447
Thank you anon this was very helpful

>>106315967
I'm just interested in saving pictures of my wife and having them automatically tagged instead of dumped into a huge wife folder like I've done for the past thirty years.

>>106307079
>>106316447
>>106317820
Is it worth starting to move to an actual server chassis? I just got a cheap ($100) case that can fit 10+ drives that fits the ATX board. I couldnt use the mobo from the dell desktop because its nonstandard so i ordered a cheap one of those and heatsink to keep using the same CPU but started to feel like it wasnt worth buying that stuff to use a xenon chip for a NAS

>>106317613
I'm wondering if i should have this data live on the NAS or if the space i have on the main server is sufficient.

>>106317909
I don't think notes take that much space but I'm hosting jopplin through my truenas instance.

>>106317952
I dont have anywhere for that stuff to live yet although i should make one. Migh just install joplin via truenas instead of docker compose on the main server like everything else

>>106317849
Im just doing it for aesthetics really, want to have everything rackmounted. It's all personal choice really and what works for you

>>106318034
That's the reason i want it too, seeing a proper server always feels nice and seeing it in my house would be very satisfying. It just seems a bit silly for me to spend extra money making / moving existing things to that when it really shouldnt even be looked at basically ever. Maybe someday, took me 10 years to even build a nas though

>>106317613
Wait, does this not have a webui? I don't want to install desktop software for a notes app.

>>106312123
Minor detail. Doesn't invalidate my point. OneDrive storage is even cheaper than what you posted. Running 5TB hard drives, plus redundancy and backup, yourself is cheaper still.

>>106312123
You could get one refurbished 20TB drive for that price almost and that would last for at least a few years without issue

>>106318152
It has a server but everything is handled through the desktop and mobile app

>>106318419
Im looking for something with a webui instead of an installed application on any computer i want to use. It does look nice but im not sure i want to change that workflow. Standard notes looks alright but i have to host the web ui separately from the server itself which seems a bit odd, and then 2 things need to be exposed

I only use it remotely through wireguard, I'm not familiar with other apps but I'm sure the self hosted will have some. I just really like the UX my only complaint is themes but I can probably fix it myself

I found duplicated movies and series in my qbittorrent download folder and then in the arr stack movie/series folders, at first I thought it was a symlink and did readlink on it but apparently it's literally duplicated... How can I fix this shit

>>106311437
drives are a fraction of cloud storage and I would pay more anyways not to have to deal with streaming services bad selection.

>>106318730
They should be hardlinks if you set everything up right, so no wasted space.

https://trash-guides.info/File-and-Folder-Structure/Hardlinks-and-Instant-Moves/#what-are-hardlinks
https://en.wikipedia.org/wiki/Hard_link

You can use ls -i or stat on both instances of a file; if they're hardlinks it'll report the same inode number.

>>106318942
Fucking hell I thought readlink would show it to me
gotta fix the H&R now and re-link them manually

I suddenly stopped being able to login to jellyseerr with my jellyfin user and i dont see why. It tells me the password is wrong but i can l login just fine with those same credentials. I see the user in jellyseerr and says it imported

what do if I'm scared of single bitflips getting magnified over compressed files?

why is docker so much slower than native, I don't understand
I got a docker-compose file with all the shitty arr stack in it, CPU usage at 10%, there's 20GB of free RAM that that pile of shit won't use for some reason, yet it loves to swap to disk, oh yeah

>>106319351
docker shouldnt be slower, but you might need to tell containers how much memory they can use.

>>106319409
it's inside a unprivileged LXC with GPU passthrough and specifying max ram requires more privileges, as far as I know there's no built-in limit on memory

What can organize and consolidate all my anime episodes for me? I mean this can't be that hard, all the titles of every anime that's ever been released is cataloged on various sites

>>106319484
the default swappiness setting is not very efficient, you could try changing it from the 60 default

I got this setup on my Pi 4
It doesn't seem to tax anything while searching but there's a slight delay before I see results. Is this expected because it's hitting multiple engines?

>>106305006 (OP)
okay, so I've got Openmediavault and Mergerfs setup, now I have a question:
I know downloading my Jap H-games onto a regular English install of windows fucks everything up in regards to the files being in a language the host system doesn't support.

Do I have to do anything special to make my shared folders on my server not obliterate the H-Games I feel are actually worth preserving?

>>106319631
I've created /etc/sysctl.d/100-stop-swap.conf with
vm.swappiness=1

on the proxmox host but didn't do much

>>106319861
you know that 100 means it will use swap more, right? You want to lower that value, or set it to 0

>>106319882
how is that 100?

Seagate, Toshiba, or WD?

>>106320722
Seagate

>>106319115
zfs and redundancy

>>106317360
So if I just want a dropbox alternative but without the bloat of nextcloud what should I self host?

>>106320722
>Toshiba
If you have the money for new drives.
>Seagate
If you are okay with officially recertified drives.
>WD
If you need an external backup drive.

>>106320722
>>106317027
oh look another unlikeable tranny here to ruin yet another space
>"can someone please google this stupidly simple question for me? teehee"
>mentallillness.jpg

terminate yourself with extreme prejudice

>>106323161
computers are now not only for people with an IQ over 80.
Get over it, chud.

>>106320722
Doesn't make that much of a difference.

>Toshiba
Noisy and hot, based on older designs. Mixed bag on quality, in my limited experience prone to infant mortality, survivors usually between Seagate and WD quality.
>Seagate
Generally low noise, if you can hear them from a distance it's a defect/quality indicator. Platter quality is a mixed bag, some drives are fantastic, others exhibit reproducible increases in read error rate or high flying writes in specific LBA ranges. When problems occur it's usually whole chunks rather than a few sectors. Potentially the least shitty SMART implementation, you will usually see problems coming a long time in advance IF you're paying attention.
>WD
Worst firmware; insane features like PWL, pioneered the heavy load/unload cycle behavior for "power saving", limited SMART reporting capabilities in non-HGST designs, appears to deliberately delay reallocation and further stresses drives attempting to recover pending sections forever, ... And never forget they put SMR in NAS drives without telling anyone, then when they got caught they started selling the normal drives alongside the SMR ones AT A PREMIUM.

>>106323229
GTFO.

>>106323293
>"doesn't matter"
>botoutput.txt

>When selecting a hard drive manufacturer, Seagate and Western Digital (WD) are generally considered top contenders, with both offering a wide range of reliable options for different needs and budgets. Toshiba is also a reputable brand, particularly for enterprise-grade drives. Ultimately, the "best" manufacturer depends on your specific requirements, such as storage capacity, performance, and budget.
>Here's a more detailed breakdown:
>Reputable Manufacturers:

> Seagate:
> Known for a variety of hard drives, including high-capacity options for both desktop and NAS systems. They are also known for their use of heat-assisted magnetic recording (HAMR) technology to increase storage capacity.

>Western Digital (WD):
>Offers a broad range of hard drives, from budget-friendly options like the WD Blue series to high-performance drives like the WD Black series. WD also acquired HGST, which is known for its reliability.
>Toshiba:
>A strong contender, especially for enterprise-grade hard drives, and known for innovations like their helium-sealed design.

personally, I only drive Fords. My father used a Seagate, and his father before him.

Now let's ask an AI about a really important topic; Intel or AMD? This is what we all came to HSG for, amirite?

>>106323434
>>botoutput.txt
Fuck you, I wrote everything from my experience.

>>106323449
GTFO CHAT GPT!
THIS BOARD IS HUMAN ONLY

>>106323453
kys

>>106323465
Usecase for suicide?

>>106323087
Seafile is faster than nextcloud with less bloat

>>106316620
I showed you my links please respond

>Pi4
>runs portainer
>runs NUT server
>runs searXNG
What else should I stuff in this fucking thing, I was thinking of moving my vault warden but I don't trust it due to the SD card aspect for something so mission critical

>>106323087
https://www.fnnas.com/

>>106323697
>I don't trust it due to the SD card aspect for something so mission critical
First, you need backups anyways. If you are worried that something bad will happen if the PI dies then you are doing something wrong.
Secondly, while PIs are pretty stupid you can still use reliable storage on that thing. Plenty of people connect actual drives to it but if you want some meme shit that doesn't have a singular point of failure then get some reliable USB sticks and make a ZFS mirror or something of that sort. Even if one dies you still have the other one running and can just replace the dead one. Its not a backup so you still have to take care of that but it will protect you from downtime which for your usecase is something important.

>>106323697
>SD card aspect
get high endurance sd card I have good luck with those, there are also industrial grade sd cards but price starts to be a problem with those.

>>106323841
>>106323868
Noted I will do both

>>106323931
In general just use the OS drive as little as possible and delegate everything you can (within reason) to other sacrificial media.
And if you choose ZFS for your mirrored partition do not go too crazy on its features. Dedub is extremely situational and compression needs spare CPU. Don't be scared of it using a lot of RAM. Its just cache that will make way for actual programs but some monitors misread it as your RAM being overused.
Have fun.

>>106323971
Thanks for the info

uhh monitor your temps

>>106324929
Are there any services that send alerts about that similar to how uptime kuma works

>>106324980
smartmontools

>>106325001
thank you sir

Should stay on *this* time. Anyways since for its first year it had 0 trims done on it and because its sorta bent im making a much needed copy of this drive.
It is very weird however that it was so hot for so long. I did a I/O test like an hour before and either to controller or the actual flash were still boiling. Dunno how that's possible.
Years old but only had 30 tb written to it, still safe to use or should i sacrifice it as a cache drive?

I dove in this hobby as a means to cope with my severe depression, I have no blood relatives and my best friend died.
I feel like I learned so much but the dread of it ending and no longer having anything to look forward to is giving me anxiety, what should I study and improve in this sector that is dense and can keep me busy?
Would advanced opnsense be something worth pursing and if so which subjects should I look into

>>106325976
sorry for your situation, I would suggest to have a look at tryhackme? opnsense is also worth playing around with although I just went with a free sophos home setup which gets you a bit into the enterprise firewall world.

Question to anyone using TrueNAS Scale, when setting up iSCSI extents, can you still only select ZFS volumes, or can you select raw drives as well? TrueNAS Core used to allow for it, but last time I used Scale, it did not.

Asking because I'm still stuck on Scale for that reason, but want to build an odroid h4+ server and TrueNAS Core may not work on that.

>>106326998
I only got as far as vlans I heard there's a way to have more active monitoring but it might require I make an transparent bridge?
I'm not sure if it's worth doing on my home setup but the better monitoring would be cool. I might spend a weekend to work on the bridge just seems disruptive during a week day.

>>106327098
I was able to use my main drive for those volumes and I have to specifically map the directory to the ZFS volume if I want to use it. Odroid h4 ultra NAS user btw and I'm using it through proxmox

>>106327128
Yeah I can use my drives by creating ZFS volumes on them too, but I want to create extents with them as unformatted disks. The documentation states it can be done, and on TrueNAS Core it can be done, but last time I checked on Scale, it did not work.

big LSI 9305 i16 installed and man does this solve problems or what. goodbye to the old pcie to 10x sata jbod controller I had, served me good from 2017 but I realised it's creating a lot of problems with stability. scrub took 9 days, now we're talking of hours. VM boots up almost instantly, before the boot was hanging on the super slow controller timing out basically

big thanks to the big anon who told me to buy this model

I'm trying to upgrade my server to proxmox, just plain desktop ubuntu with a couple of drives with media on them, an smb server to access them in my main windows pc and jellyfin and other stuff but I'm having trouble understanding what would I need to do with the drives. Would it be better to set up samba on proxmox itself and then access the data that way from the vm/containers, or passthrough the drives to an openmediavault vm and then acces the drives through that?

>>106327401
The LSI controllers are super reliable and the go-to items for home servers, their only downside is that they guzzle power.

iirc the ASMedia sata controllers are sort of stable under truenas, and they use fuck all power. Just don't get the ones that add more than 4 ports on a pcie 2.0 x1 connector, the connector physically doesn't have the bandwidth for more.

>>106324968
As long as the errors were on different regions of the disks with no overlaps (or rather, no overlaps where data was being stored), then this isn't that unusual. Put another way, redundancy is per block. As long as a given block has redundancy, it can handle a failure. Different blocks can have different regions fail.

I've seen that kind of failure mode occur multiple times with mechanicals since they usually fail in stages. SSDs are more of an all or nothing deal, but I've seen it happen there too.

I had both sides of a 2 way SSD mirror get nuked by lightning. After popping the drives out and putting them into a new system I was able to boot it, resilver to a spare mechanical, and purchase replacement SSDs, then resilver to the new SSDs and remove the 2 dead ones and the temporary drive. Both the original SSDs were fucked, but I only lost some log files that I didn't care about.

>>106327534

yea not too worried about power consumption. I have two 14700K/128GB servers with one using a 3060 12GB for Plex. It does get very hot, I might have to hook some fan for it even though the server case I have offers some ventilation for the HBA. Right now I'm sitting at 350W for both servers so that's nothing.

>>106327948
I'm looking for inspiration can you tell me what services you're running on that server and why the 3060 for plex. I'm trying to find a way to repurpose older hardware and might use my old 5700xt in a build.

>>106327948
You'll definitely want to add a fan to the HBA if the case doesn't have very good airflow.
Also to anyone considering U.3 drives LSI/Supermicro PCIe to U.3 cards get EXTREMELY hot. The SSDs themselves are basically a cold spot in comparison. I have three 4 port cards and every single one consistently outputs more heat than the 64 core EPYC they're hooked up to. These controllers are fucking ridiculous.

>>106328031

Server is VM under proxmox, just a Ubuntu VM that takes care of torrents, plex and disk. I have a lot of LXC containers from here https://community-scripts.github.io/ProxmoxVE/

Plex transcoding requires an nvidia GPU and out of all the cheap ones, the 3060 can handle multiple streams at once.

Sorry to leave it this shot, the quetiapine is kicking in and I gotta go to bed.

>>106328366
>the 3060 can handle multiple streams at once
A 1060 can handle multiple streams at once, I definitely get being out of the lower stuff though.

How do i troubleshoot this? Jellyfin just started acting up today (didnt change anything) and i cant figure out why. Some files it will still play but a lot it wont. Nothing in the log file except "Playback stopped reported by app "Jellyfin Web" playing Stopped at "0" ms"

>>106328519
try a different external player

>>106319784
bumpin' my question

>>106328519
Is it a 10bit video file? HDR to SDR conversion (retardedly) doesn't consistently work in the browser for some reason. Works fine in the apps though.

>>106328966
linux uses utf-8 and can handle the file names just fine.
windows probably uses utf-8 now too but idk why would I know
if you share files between systems (NFS, smb) then you should have some kind of normalization in the filesystem, though I only know about normalization on zfs.

What hardware do I need to run opnsense on so that it doesn't take a full damn minute to load the main page and each time to navigate through the UI? I bought a netgate 1100 many moons ago and with minimal packages the CPU is constantly at 100% and can't make any alterations. Routing works fine though.

>Internet's been out for 5 days because battery acid took out my ONT
>Guy that supposedly came over to replace and fix it has failed 3 times now
>next attempt tomorrow morning
>living off mobile hotspots not being able to torrent anything
Bros save me

>>106327685
I was replacing 1 SSD that died, but while the resilvering was happening, two other SSDs started shitting themselves and eventually FAULTED. The remaining 3 SSDs somehow finished the resilver. ZFS reported 13 permanently lost files while resilvering, but when it finished they recovered. All my files are still there and accessible.

I ordered some replacements, but I'm going to keep my server down in the meantime.

Wtf I'm a ZFS believer now.

>>106328366
Thank you for the explanation

ALL LINK FAGS THIS IS URGENT!!!
HERES THIS IMX AIRDROP NOW AND TOP 5000 LINKIES ARE INCLUDED!

>>106329384
I use a odroid h4+ with the network card and a sata ssd in a case and it barely gets taxed running opnsense and hasn't broken 30% cpu usage either

>>106329656
>>106329384
OP image is mine I apologize for the orientation flipping but that's the device

>>106329642
Alright fuck it. Let's do this!

>>106323697
a half life server

>>106328808
>>106329150
It seems like chrome needed to be closed, even an incognito window worked. I dont see why that would happen though.

>>106329656
>>106329705
>odroid h4+ with the network card
Ok that's pretty neat. I'm checking out their other products and they're definitely better and cheaper than my netshit. Cheers.

>>106329810
Hope you find something you like!

>>106329823
Silly question. Why did you get the net card but still run a switch? PoE perhaps?

>>106329896
It's for Vlan purposes I have a guest/IoT network and it's configured to completely lock out any communication with my main network

>>106329896
Actually looking at the specs I'm going to go with faster speeds.

>>106329909
Oh way off, ok interesting. Neat idea.

>>106329924
There's a lot of videos on it just be patient opnsense has had a complete change in default programs that deal with DNS and dchp so be aware of that when looking at the guides.

>>106329942
I painfully know all about DCHP and DNS through reasons I'll never admit.

>>106329995
This will be the best place to learn, just wait until you install a virus scanner on the thing you will also need a sata cable and the case 3 to have storage because the network card uses the nvme slot

>>106329163
Thank you!

To the people who have self hosted private boorus, what do you use? I looked into szuru, but I'm still new at this - I got it running easily enough, but couldn't figure out how to access the actual local webpage.
I'm thinking of just using a client side thing like Tag Studio to tag and track things already stored on my server, while accessing via the program from my desktop, but idk what the better option is.

>>106330930
hydrus and danbooru seem like the endgame for the people serious about hoarding images booru-style. I never tried szuru myself, but it looks decent for small and medium-sized collections (less than 50k images I think). personally I'm working on my own thing, but still stress-testing and adding features

Is there a good front end for music listening/streaming/requesting? Maybe something that would let me stream torrents, to make browsing and listening to new music as painless as possible?

Using shoutarr as a pipe to send my ntfy messages to outside sources without exposing my network
Good idea or bad idea?

>>106310228 (Me)
Update on this, the parts got here and everything's working now. I went to the debian website to download the iso and couldn't decide which release I wanted (old, semi-old, or untested). Thought about SUSE but I don't wanna be rotten flesh, SO I'm installing gentoo now. using distcc to compile everything on my good pc instead of the ryzen 5 and also doing everything from my pc through SSH so it's been comfy so far

>>106327533
I have a lcx with NFS via bond mounts. The VMS and my PC access the files via nfs.

I have 3 boxes. Box A and Box B are compute servers. Box C is a storage. Over ethernet, reading from Box C on either Box A or B is slow. Is it possible to use something like data cache over ethernet to cache data stored on Box C, so that I get speed up on both A and B? What kind of tool can do this caching?

How comfortable do you feel running privileged docker containers with a couple of hundred github stars?

>>106333171
Examples?

>>106333252
just in general i mean but the one in the pic is this one https://github.com/mkuf/prind

>>106333138
there are network filesytems like seaweedfs which do exactly this kind of distributed storage, though it wont help much on a slow network unless your data access is actually read-heavy.

Anyone manged to get ARM to work?
https://github.com/automatic-ripping-machine/automatic-ripping-machine

Is there anyeasy to selfhosted image board?

>>106329801
Browsers are way too complex nowadays. Only god knows what fucked up in the renderer (my guess) to cause the playback to fail.

What are your sins /hsg/?

>>106334470
i got a haswell xeon without a gpu because i didn't know the system needed a gpu just to post. so now i have some shitty nvidia taking up a full slot, sucking power, doing nothing.

>>106329801
Google's mission is to stop you from enjoying your computer experience, so when it sensed you doing something cool it had to stop it

>>106334470
>cisco network gear
>unholy mixes of GPUs for different servers (1050Ti+1080Ti, 2x2080Ti+2x1080Ti, a single 970 still floating around somewhere I genuinely can't remember which server its in or what it does)
>absolute dogshit tier APs
That's the worst of it.

>>106334470
I don't have ECC memory and have been running like this for years.

[spoiler]Not planning on getting any either[/spoiler]

>>106334879
Oh yeah I forgot
>overclocking ECC RAM
>running UDIMM ECC in one system (also overclocked)

>>106334470
I'm running one of these bad boys

>>106334470
Forgive me padre.

>>106334470
Bought an used 10TB WD. Turns out to be a dud, thousands of errors after a few months.
I still use it.

>>106335273
does that at least use pcie 3.0? If it's PCIE 2.0 it's locked at 500mb/s for all 10 devices, so only really useful for CD drives.

>want to fuck with some Broadwell ewaste
>coolers that aren't passive or screamers for the narrow 2011 ILM are $60+
>would need two of them
>STLs exist to adapt sub $20 thermalright coolers
>3d printer go burr
I'm excited now

>>106335336
>that ssd

>>106335636
I wish I could justify the upfront cost for a good 3d printer but considering I'd realistically use it maybe once a year...

>>106335666
Did you miss the wifi adapter?

>>106335697
Who cares plug it back in, that SSD is going to straight up tear off the SATA port if you push on it from the wrong angle. Yes I have seen that before those SATA ports aren't as sturdy as you might think.

>>106335713
Are you approving of running a server over wifi?

>>106335683
You can always use print on demand services then.
But honestly, even entry level $300 3d printers do a good job nowadays (maybe slow, but hey, it's cheap).
However cheap they are tho, no need to buy one if you use it once a year.

>>106335683
>3d printer
Mambu mini is like 200€

>>106335683
Like the other anon said, there are some good entry level options that will serve 95% of uses.

What really matters for a 3d printer tho is if you can model something. Most of my prints now are something I modeled or atleast modified.
I had CAD lessons in my high school years that really left an impression so even after years and years of not touching it, it was easy to make my own things. It's opened up some things I would never think about doing.
I still look for things other people have made but they don't always exist.

>>106334470
Bought a DL380 G7 with the intention of migrating stuff from the cloud to my basement. Never realized how much power it consumed (140W@idle). Sold it after only a month and moved on to other hardware.

>>106335809
What made you choose getting one of these older rack servers than making a diy one out of desktop parts? I just see so many go through what you did and i want to know where this comes from.

>>106335683
decent used ones with good mods and equipment can be bought for 90 bucks. If you can handle a server that needs some parts printed you should have no issues doing a little refurbishing for a machine that will last you forever.

>>106335839
/hsg/ told him too

>>106335724
I'm gonna be honest looking at the absolute state of that thing using wifi isn't my top concern no.

>>106334470
I have one sin
The old giant Aruba s2500 switch stowed in my closet
I never hated it, but it was too much.

I think I've actually been pretty good about not blowing on hardware.
Almost everything I have bought specifically for hsg shit is in use. Even the lot of ancient 3TB SAS HDDs bought during the chia panic are still rotating away.
I do end up changing hardware alot but it's always reused hardware from my desktop.

>>106335859
are /g/ trolls descendants of snake oil merchants?

>>106335927
Many anons in this thread advocate for not getting old junk that burns power. Low power x86 is the way to go unless you have to take care of 10+ people that are tech savvy/rely on the service like an office.

>>106335923
>Aruba s2500
>$7000
Why?

>>106335984
Many anons will bully you for not getting enterprise hardware

>>106335683
they're not that expensive, my issue is finding a place to put it where i won't be gassing myself all day with the fumes

>>106335986
I paid $120 for it
It was already ancient history when I bought it

>>106336005
>100 mbps

>>106335984
>Low power x86 is the way to go unless you have to take care of 10+ people that are tech savvy/rely on the service like an office.
Doesn't seem to me common knowledge. There are so many people in general still use e-waste as their server. Some madmen also insist on shitty ARM boads being a valid alternative to thin client style computers...

>>106336009
It's 48x gigabit ports and 4x 10 gigabit SFP+ ports
Where are you getting your info from?

>>106335994
drones
>>106336012
They get misdirected by retards on YouTube using crazy systems to justify their workflows that actually don't require it. To get engagement they have to keep raising the stakes to flex on their peers.
Also some youtubers stopped the old server part larp perhaps a year or 2 ago even though these lower power boards were out.
Also the constant reviews of nucs over actual motherboards and sbc is confusing. I still don't understand how the odroid h4 flew under the radar with these reviewers yet they can go over every variation of a n100 box which is way more restrictive than alternatives.

>>106336012
The "ARM = low power" brainworm is strong.

People's idea of efficiency is fucked up really.
Less powerful systems are seen as more efficient regardless of actual computation per watt of power.

>>106336054
They are getting those N100 boxes for free.
N100 motherboards are rare and arguably not worth it.
They charge exceedingly too much, for less what an N100 mini itx board costs, you can get an entire working N100 mini PC

>>106336078
ARM is just garbage, you have so many options for sub-10W x86 now, ARM has no right to live unless you are emulating phones.

I just wish we had more chipset-less Ryzen boards, so we can go sub-10W on those as well.

how powerful do you expect a server with 20w idle to be?

>>106336520
Enough to do what 99% of poster need

How many concurrent Jellyfin streams can my 2.5gb NC, 7200rpm HDD storage, SSD transcoding drive, 12900k cpu, and 900mb upload server handle? How do I figure this out myself?

>>106336585
>How do I figure this out myself?
Open streams until performance drops? Browsers have tabs, i think that they are very useful.

>>106329431
Honestly that sounds more like you have bad cabling or a bad RAID/HBA card than failed drives.

I should have mentioned that in my original reply to you, but that's a VERY common situation with ZFS. It's not that ZFS is causing the errors, it's that it's catching them. Error pileups under high load (and resilvering is high load) are common systems that occur when a controller is overheating or you have sata cables that are getting flaky. Double check your cables, controllers, the ports their plugged into, etc. If you have no errors after a zpool clear and a secondary scrub, the drives are probably fine.

>Wtf I'm a ZFS believer now.
Yeah that's how it goes. I became a believer after the lighting strike. Rebooting my router system and having both drives be failed but the system still working broke my brain for a bit. I was scared to power it down to attach the donor drive for the initial resilver, so I just raw dogged it and fortunately had hot stop sata enabled in the bios.

I started migrating all my archival stuff over after that. Tried btrfs a few times and had baffling issues every time. ZFS Just Werks™ and outside of the dkms headaches during setup is so painless to use that it's legitimately made me jaded about the garbage backend infrastructure we use at work.

>>106335683
it's like $300 for a decent one and once you have it you'll make excuses to use it.

>>106336004
Don't print with things that will gas you then. PLA, TPU, and PETG (or PCTG if you're cool) don't do a significant amount of offgassing.

>>106336699
DKMS headaches can be avoided entirely, if you use Alma or FreeBSD (though with the latter you will probably gain headaches of a different kind), possibly even with Ubuntu (but I can never tell with it).

>>106328385

3060 12GB even more. Only factor for me, my friends stream from me.

Anyone have one of these? what do you do with it? I'm running arr stack, docker, samba, pihole, mysql, elasticsearch, nodejs, nginx, a game server

it disgusts me that you all just do real time video transcoding seemingly without questioning the need or the possibility of there being a better way.

>>106337399
Got the older models, AMA.
Pretty much all what you do, even running MacOS/Windows/Android in docker.
And play retro games as well.

>>106337451
What's your setup for retro games? Monitor and controllers connected to it or something fancier? Honestly, I'd love to be able to use a 3.5" hdd on this, finding a high capacity 2.5" one sucks ass

>>106337443
real time is the better way

>>106337399
>Anyone have one of these?
Yes
>what do you do with it?
It's my main work PC and it runs Debian

>>106337399
yes they are pretty good. Connectivity is not very convenient but i still really liked mine.

>>106337443
never understood why so many people need it in the first place

>>106337736
i always thought of it as just one of those things you just do if you're in the hobby. a bit like if you're into mechanical keyboards in the current year, then you're almost certainly gonna be into swapping between different kinds of switches in one board. no, mom, you don't understand, i need this because everyone else needs this, etc.

>>106337443
>just store 20 different reencodes of every movie and series
Yeah I watch across multiple devices and TVs, some have HDR, some don't. I won't waste literally dozens of TB for reencodes because you're trying to be contrarian.

>>106337443
>>106337812
It exists to replicate the Netflix experience of picking a show/movie on any random device and just have it play.
That's really all there is to it.

I personally don't get it either. I just go into my NAS share and play the native file either on my own PC or the PC connected to the TV.

Smart tvs and apps are a pain in the ass.

>>106337860
I do this on my theater PC, but when in the living room or bedroom i dont want to use keyboard (and more importantly dont want to put a PC in there). Jellyfin works well and doesnt really hurt anything else to transcode. And then friends/family can use it too

>>106337451
how many cores do you assign for the arr stack, and how many to pihole

>>106337478
Retroarch as bare metal, it's connected to my TV in the living room.
>controllers connected
generic wired PS2 clone controller
>I'd love to be able to use a 3.5" hdd on this
Get DAS.
>>106338396
1 to both.

My jellyseerr stopped loading the images when i have Content-Security-Policy header added in nginx. This is the way i have been loading it under advanced, what am i doing wrong?

add_header Content-Security-Policy "default-src 'self'; script-src 'self'; style-src 'self' 'unsafe-inline'; img-src 'self' data:; font-src 'self'; connect-src 'self' wss:; frame-ancestors 'self';";

Will pinch flat ever be useful again or did """(((THEY)))""" win

anyone know how docker handles smb shares as volume mount points?
by that i mean not mounted to the host filesystem but in docker directly.
background here is i want to make an lxc on proxmox using a docker app but i dont want to have it be privileged or pass a mount point from the proxmox host.

>>106330930
bumping my q again before I start trying to install more stuff I barely understand tonight.
>>106330987
I have many photos and videos, but nowhere near 5k, maybe 2.5k rn. I'm pretty selective with what I save.

oh i never thought about it deeply enough but syncthing receive only-send only doesn't actually protect you if something happens to the send device.
I was using it as a backup.
been flying dangerous the past few months. Not that I delete anything from the sending device, but I'm planning to clean it up. Which is why I'm looking into this.

>>106335994
>>106336012
There are tons of low power ITX mobos from Supermicro and AsRock Rack, which is enterprise hardware. They also get shilled endlessly by jewtubers and redditors.
Then there's the rackmount fuck-the-energy-bill guys who either buy old server gear or new gear, which still draws a fuckton of power because it's meant to be in a datacenter.
I have a mATX mobo from Supermicro and it's a good compromise between power (30W idle) and server features like ECC and IPMI.

>>106337443
I just open my media folder and play the files like a caveman. Got tired of Jellyfin's bullshit years ago

>>106336139
I really don't get it. There are like three N100 mobos from major vendors out there. none of them well-suited for a NAS. it would be so easy for some vendor to dominate /hsg/ market with a N100 mobo with plenty of stable SATA.

What password manager is generally recommended, or which do you use?

>>106340422
Bitwarden + self-hosted vaultwarden

>>106340426
why is vaultwarden needed?

>>106340433
to sync passwords between your devices

>>106340422
What's your threat model?