Trashcan
Local AI using llama.cpp ā¦
Intro I recently acquired a Trashcan Mac Pro to use as a standalone dev machine. It has dual AMD FirePro D700 GPUs, and since I’ve been itching to try out locally hosted models, I ran llama.cpp to see what the performance looked like. There have been very few posts about it so I figured ā¦