Here's my thought on Ollama
ollama is the easiest to get going local llm tool that I have tried, and seems to be crazy fast. It feels faster than chat gpt, which has not been the experience I have had previously with running llm's on my hardware.
curl https://i.jpillora.com/jmorganca/ollama | bash ollama serve ollama run mistral ollama run codellama:7b-code ollama list
This post was a thought by Waylon Walker see all my thoughts at https://waylonwalker.com/thoughts