doodlebob

joined 1 year ago
[–] [email protected] 1 points 1 month ago

I also suggest inovelli, they're solid

[–] [email protected] 2 points 4 months ago* (last edited 4 months ago)

Do you know if there is openai API compatibility? More specifically I'd like to get home assistant to interact with the LLM via the custom OpenAI hacs addon

[–] [email protected] 3 points 5 months ago (2 children)

It starts getting rusty lol They used a stainless steel alloy or something

[–] [email protected] 2 points 6 months ago

I think you're right. Saw a post on Reddit basically mentioning the same things I'm seeing.

It looks like autoawq supports it but it might be an issue with how oobabooga implements it or something...

[–] [email protected] 2 points 6 months ago (2 children)

I have two 3090 Turbo GPUs and it seems like oobabooga doesn't split the load between the two cards when I try to run TheBloke/dolphin-2.7-mixtral-8x7b-AWQ.

Does anyone know how to make text generation webui use both cards? Do I need an nvlink between the two cards?

[–] [email protected] 1 points 6 months ago

I tried this but much prefer to use oogabooga text generation webui. Couldn't get your solution to work in unraid for whatever reason

[–] [email protected] 1 points 6 months ago

Check out onju voice!

[–] [email protected] 6 points 6 months ago

I'm sure that's not that big of a deal to some people. For example, I'm mainly using LLMs for use in my home assistant instance

[–] [email protected] 4 points 6 months ago (2 children)

Do you know if there is anything that locks up to this that will automatically download the music they recommend?

It would be cool to have an app where if you like the track, you give it a thumbs up, but if you don't you give it a thumbs down and the track is deleted automatically

[–] [email protected] 23 points 7 months ago (3 children)

You're gonna make me look it up myself?!

 

Since the whole security issue popped up, I decided to disable remote access for both my udm pro and UNVR.

I am able to access the udm pro via the unifi app through wireguard but I am unable to access protect.

Has anyone gotten this to work?

[–] [email protected] 9 points 10 months ago (1 children)

You should probably also sync them. I use orbital sync for this. https://github.com/mattwebbio/orbital-sync

 

Has anyone successfully deployed something like Subs AI within unraid?

Basically I'd like to use this to grab all the missing subtitles that Bazarr isn't able to grab.

PS: If any one knows of a similar app with a scheduler built into the webui, please let me know

 

Hi guys, looks like the used dell 2080 ti I bought off of reddit died after a couple of months of life.

I have been throwing some AI workloads at it (image generation, speech to text, etc) and it looks like the Nvidia driver randomly stopped seeing it. Tried downgrading the driver version and rebooting but as soon as I started throwing some AI workloads at it, the same thing happened.

Can anyone suggest a good dual slot GPU? Doesn't really need to be one of the consumer cards as I'll only be using this for AI workloads and transcoding via tdarr and Plex.

Thank you!

[–] [email protected] 1 points 1 year ago

My god, that is horrible....

 

Has anyone run these yet? I'm super interested in having speech to text running as quickly as in there demos. Wake words are also a must now too!

view more: next ›