I like that, some YouTube video i came across had the sentiment that it was ok to be a renaissance man, jack of all trades kinda deal. I liked that a lot since i have a few different hobbies and im not particularly great at any of them but im good for the most part.

Made me feel like i didn’t have to be perfect and it was cool to just be doing stuff.

If i can figure it out I’ll be sure to post something lol.

So far, i found a python project that is supposed to enable RAG but i have yet to try it and after a reinstall of my linux pc to Popos, im having less than success getting ollama to run.

Me personally, i use my AMD 7700XT to run ollama on my main pc. Can be helpful for troubleshooting as the internet gets worse amd worse to search especially if i dont know what the issue is. Thats my main use case for it but id like to set up something with RAG and use it to help me with documentation if i have questions.

I don’t think its super worth it to use a VPS for an LLM if you already have a decrnt gpu that you can run it on. If yoy dont already have the hardware, plenty of older gpus can run the models pretty well. My 1070ti still kicks ass all these years later and you can find them for $100 bucks or less on ebay used. Ive used it for ollama as well and it does just fine.

Will it be super fast or a really big model? No, but if its for personal use, i dont see any benefit to paying a monthly subscription for it and like i said, works well enough for me.

Its also more secure and private to host it yourself if thats worth anything to you. Thats one of the biggest reasons i self host.

Lol i was thinking the same. Sounds like a light novel for sure.

“I became a vampire to enjoy my undead life in my library”

This is rough man, I’m really sorry to hear all that. Christmas is supposed to be a happy time for everyone even without all the gifts.

Maybe instead of gifts for your kids like physical things, plan a day with just you and them. Do something fun as a family or with each of them individually. Memories like that they can cherish for a long time after this year and gifts dont have to be material.

Given what you said, it sounds like you could use a day of fun with them.

Hey at least you could do it. Ive been barely able to hold a conversation with people, let alone do two things at once like that. Half the time i had to cobble together what the other person said from context clues because my mind started wandering while they were talking.

That said, when the hyper focus really kicks in, im a god damn machine. But i dont control when it happens and i forget to eat and drink so its a shitty super power at best lol.

I feel that. Messing with stuff can actually help me focus sometimes but usually im just bored lol.

Kinda, its hyperactivity, but ADHD isn’t just bouncing off the walls with the inability to focus. It can manifest in other ways. Theres a variety of symptoms that come with it.

I’m not exactly the classic example but a lot of the symptoms like hyper focus, making split second decisions, executive dysfunction, fidgeting, etc. I have along with co-morbid anxiety and depression from it being untreated for so long. Medication helps but your brain being in overdrive constantly is exhausting.

Such is life with ADHD.

30s?

Feel like I’ve been like this all my life tbh.

“This utility-style regulation will slow down rural broadband builds.”

What a load of shit. As someone who lives in a rural part of Washington, can confirm that Comcast makes no fucking effort whatsoever to bring internet out here. They could give two fucks about building new lines and only care about dominating existing copper shit.

God this makes me so mad. Fuck these assholes for making the internet actively worse for consumers.

I expected a rhyme and this a crime! This happens almost every time. The meme makes word play but doesnt finish the lines. Such is often the case for memes of felines.

Thanks for the recommendation! I’ve got around $300 to spend so I’m a bit flexible in the budget. I’ll keep an eye out. Hoping to get a decent black Friday or cyber Monday deal.

Thank you! Really appreciate the reply, trying to find info about this has been less than successful. Specifically this happened after firmware 1.0.4 amd was supposedly fixed in 1.0.6 but seems to be nothing else after this to indicate if its fixed or not.

So a couple more questions if you dont mind:

What firmware version are you running? Any reason in particular you didn’t update the firmware? And would you say you like the performance?

Personally speaking, I absolutely suck at math. It was and continues to be my worst subject. Likely to do with my adhd.

I was only able to really get up to and through basic algebra and some geometry in school. Past that, nothing else. I do fine. I’d say thats the minimum unless your in a field that requires a higher level of math.

I agree with this. I’m using a 1070ti for image gen and it would be more than capable for handling some LLM stuff. An AMD 7700xt ive found dors well with 7B models on my main rig but im sure you could get away with somthing cheaper or less powerful.

That said, the amount of text you can genrate or the context length of its answers will depend the model you use and the larger the model, the more power it takes.

If youre just messing around with it or want it to review or answer small questions, I’d say a 1070ti like I’m using would be just fine. Some folks use even more budget friendly options. If you got a gaming machine with any semi recent GPU, I’d say go for it. Worst case, you can pay for a subscription later if you really want.

Oh interesting. I may look into that. Thank you for the suggestion!

Well he’s gone now but like him and my dad, I too groan often lol.

That gave me a good laugh, my grandfather would most definitely refer to this as a “Groaner”.

Wouldn’t exactly fit my use case because this pc also doubles as my game in bed pc and is what I’m currently using for ai image generation. If i could get big picture mode but still run applications that arent games or for streaming, that’d be ideal. From the recommendations, seems like kodi is a fan favorite but not exactly a DE either. Might work but I’d rather it be a DE than an app i have to run but beggers cant be choosers.

That said, I have 2 chunky servers that my buddy gave me recently and I’m planning on self hosting a lot of things with them which likely include jellyfin.

I will say that im slowly getting the internet to a decent spot at least for streaming, generally as long as my connection is fast enough between starlink and my lte connection (using failover with pfsense) i can usually stream ok. Though with one tower in my area and trees surrounding my place, its never gonna be great.