Hosting a local assistant/companion - /g/ (#106118295) [Archived: 74 hours ago]

Anonymous
8/2/2025, 7:34:01 PM No.106118295
iphone assistant stay with me
iphone assistant stay with me
md5: 7dd85704347aa6994c2b6942b147037d🔍
Do any of you know of an open source local virtual assistant/companion similar to Ani from Twitter?

I am considering developing a Robo-wife via a web app which would make API calls to a home server (>=6GB GPU required)

>Robo-wife Phone Camera -> Image -> Server -> Image tagger ---(0.2 second delay)---> Image tags -> Server
>Robo-wife Phone Microphone -> Audio -> Server -> Speech to Text ---(0.2 second delay)---> Server
>Server compiles image tags and audio into a response (1 to 5 seconds) -> text to speech ---(0.4 second delay)---> Robo-wife -> Phone Speaker and Screen

Could also add in OCR to provide reading capabilities.

I think it'd be possible to get near real time responses with streaming response tokens from the server.
Replies: >>106118807 >>106120164 >>106122725
Anonymous
8/2/2025, 7:37:13 PM No.106118326
Can't you just with SillyTavern with TTS and a Live2D model?
Take a look at /aicg/.
Replies: >>106118771
Anonymous
8/2/2025, 8:31:21 PM No.106118771
>>106118326
I don't think those will work... Maybe I can use the silly tavern UI, or some other basic chat UI to avoid writing that myself
Anonymous
8/2/2025, 8:34:51 PM No.106118796
That shit is just some preset animations that play based on related keywords, its just standard chat-gpt replies that trigger those animations, how in the fuck is people losing his shit over that?
Replies: >>106118807
Anonymous
8/2/2025, 8:35:56 PM No.106118807
>>106118796
>>106118295 (OP)
Let's focus less on the animations - I want the same communication experience - the "animations" can be static images.
Anonymous
8/2/2025, 8:37:20 PM No.106118817
Just train an llm on lewd conversation dataset, BOOM there you have it.
Replies: >>106118829
Anonymous
8/2/2025, 8:38:39 PM No.106118829
>>106118817
>doesn't read the OP
nice bait, swaggot
Anonymous
8/2/2025, 11:12:10 PM No.106120164
>>106118295 (OP)
zump
Replies: >>106122306
Anonymous
8/3/2025, 3:46:19 AM No.106122306
>>106120164
again
Anonymous
8/3/2025, 4:51:41 AM No.106122725
>>106118295 (OP)
There is a project called open-llm-vtuber