Ai
Local AI using llama.cpp ā¦
Intro I recently acquired a Trashcan Mac Pro to use as a standalone dev machine. It has dual AMD FirePro D700 GPUs, and since I’ve been itching to try out locally hosted models, I ran llama.cpp to see what the performance looked like. There have been very few posts about it so I figured ā¦
Build and run ollama with ā¦
Intro I have an Intel Arc A380 in my Dell T440 server for Plex and remote gaming through Sunshine. I set up Hoarder and wanted a way to use the AI features without paying for OpenAI tokens. This proved extremely difficult, as none of the readily available solutions seemed to work. This was until I ā¦