Posts tagged: llm

- Don’t stop learning! Stop trying because you have a doomer outlook on ai, llms, industry and think they are taking over. If you have no hope for the future, if you stop now you are cementing in that you will be no good and the ai will be better. Many, maybe most of us in this industry go here by hard work, long nights of learning, trying to solve problems that our job had. If llms take over then the world is going to be a whole lot different, it will be a world you cannot predict or plan for. For now put your head down and succeed in the world we have today. TEEJ has some great thoughts on this whole sentiment, put this on for you morning walk or whatever you do. Note This post is a thought [1]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /thoughts/

Quick Start - kotaemon Docs cinnamon.github.io [1] interesting UI for RAG based workflows, i.e. chatting with your documents. It looks like it can run a number of models, feels like ollama with RAG and a nice web ui. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://cinnamon.github.io/kotaemon/ [2]: /thoughts/

[1] Looks like a great start to a rules file for fastapi [2]. - Place the happy path last in the function for improved readability. I have never heard anyone say this. It feels weird to me. The other early return, find and handle errors early all make sense to me, but happy path last is new to me. Note This post is a thought [3]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /static/https://github.com/PatrickJS/awesome-cursorrules/blob/main/rules/py-fast-api/.cursorrules [2]: /fastapi/ [3]: /thoughts/

Generate Custom .cursorrules for Your Project Based on Community Examples expert led courses for front-end web developers and teams that want to level up through straightforward and concise lessons on the most useful tools available. egghead · egghead.io [1] Really interesting way to generate a rules file for agentic workflows based on your current repo. John uses gitingest here, looks like a fantastic tool, but probably not useful for most private repos. I’m sure you can replicate the same thing in a private repo wtih a small amount of effort the few times you need to do it. gitingest looks like a great way to pull in some extra context for some open source dependencies that you have though. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://egghead.io/generate-custom-cursorrules-for-your-project-based-on-community-examples~eimq2 [2]: /thoughts/

GitHub - coderamp-labs/gitingest: Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase - coderamp-labs/gitingest GitHub · github.com [1] Gitingest has a python package on pypi that you can run with uvx, and it accepts the same arguments as the web version, right in your terminal ⬢ [devtainer] ❯ uvx gitingest --help Usage: gitingest [OPTIONS] SOURCE Analyze a directory and create a text dump of its contents. Options: -o, --output TEXT Output file path (default: <repo_name>.txt in current directory) -s, --max-size INTEGER Maximum file size to process in bytes -e, --exclude-pattern TEXT Patterns to exclude -i, --include-pattern TEXT Patterns to include --help Show this message and exit. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://github.com/cyclotruc/gitingest [2]: /thoughts/

Gitingest Replace gitingest.com [1] Replace hub with ingest in any github and get a prompt friendly codebase ready to feed into any llm. It combines the entire codebase, based on a gitignore style glob that you pass in, into a single TXT file. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://gitingest.com/ [2]: /thoughts/

Replicate - Run AI with an API Run open-source machine learning models with a cloud API replicate.com [1] This is so easy compared to self hosting stable diffusion yourself. It even has a nice api that you can hit with curl or python. The pricing seems competitive as well. Bookmarking this to try next time I need something like it. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://replicate.com/ [2]: /thoughts/

I recently updated ollama [1], and it now installs a systemd service that I was not expecting. Seems like a great option, but I hadn’t expeted this and I was able to kill it previously. It was using up gpu, and I do other things on my machine with a gpu. I tried pkill, kill, and everything, it was still coming back. No matter what it comes back # stop it systemctl stop ollama.service # disable it if you want systemctl disable ollama.service # confirm its status systemctl status ollama.service You can confirm this with the following command. # checking running processes ps aux | grep ollama pgrep ollama # checking gpu processes gpustat --show-cmd --show-pid Next time you want to start you can do it as before with ollama serve. References: [1]: https://ollama.com/

Use an llm to automagically generate meaningful git commit messages I harper.blog [1] This is pretty sick, I wanted this early on when I was making lockhart. I wanted to do the git [2] hook thing but could not figure it out and did not know that prepare-commit-msg was a hook that I could use. Git Hooked Then I remembered! Git hooks! Lol. Why would I have that in my brain - who knows! I asked claude again, and they whipped up a simple script that would act as a hook that triggers with the prepare-commit-msg event. This is awesome, cuz if you want to add a git message, you can skip the hook. But if you are lazy, you exclude the message and it will call the LLM. Simon Willison’s llm cli comes in clutch here, it has such a good intereface to allow a prompt to be piped in, but the system prompt be set by -s. gpt = "!f() { git diff $1 | llm -s \"$(cat ~/.config/prompts/commit-system-prompt.txt)\" }; f" I love hacking on projects, but often I am super bad at making commits that make sense. I completely relate to this statement, and this is why I am trying it. Note This post is a thought [3]. It’s a short note that I make about someone else’s content online #thoughts Refere...

- This really makes me want to try Dolphin Mixtral with ollama now. It looks very impressive from this video. The ability to keep adding features before becoming confused is though with a lot of these llms. Being chat based, this is not a co pilot replacement. I was really hoping for an in line co pilot like tool that I can run locally. I have not used co pilot yet, but I have had great luck with codeium. Note This post is a thought [1]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /thoughts/

GitHub - charmbracelet/mods: AI on the command line AI on the command line. Contribute to charmbracelet/mods development by creating an account on GitHub. GitHub · github.com [1] This is a pretty sweet interface into llms. I used it a bit with my son tonight while he was asking me for datapack ideas. ❯ mods -f 'I am trying to have fun on my minecraft server and am creating a minecraft datapack send me some load.mcfuncions that will make it fun' You can continue the conversation with a -C ❯ mods -C -f 'I like where you are going with number 4, can you make it so that it runs when a player opens a door' You can pass it some data curl https://waylonwalker.com/thoughts-on-unit-tests/ | mods -f 'summarize this post' Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://github.com/charmbracelet/mods [2]: /thoughts/

[1] This seems like a promising tool to use with ollama. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /static/https://github.com/David-Kunz/gen.nvim [2]: /thoughts/

Ollama Ollama is the easiest way to automate your work using open models, while keeping your data safe. ollama.ai [1] ollama is the easiest to get going local llm tool that I have tried, and seems to be crazy fast. It feels faster than chat gpt, which has not been the experience I have had previously with running llm’s on my hardware. curl https://i.jpillora.com/jmorganca/ollama | bash ollama serve ollama run mistral ollama run codellama:7b-code ollama list Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://ollama.ai/ [2]: /thoughts/

External Link X (formerly Twitter) · twitter.com [1] Kinda mindblown that this is even possible. This is so far outside of my current thinking that i didn’t even think of an elegant way to implement semantic search accross images and text at the same time. I know it happens at Google, but I envision that as still text search accross tags and meta data about the image. Based on the number of responses CLIP is the thing that does this. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://twitter.com/simonw/status/1700528222382027039 [2]: /thoughts/

LLM now provides tools for working with embeddings LLM is my Python library and command-line tool for working with language models. I just released LLM 0.9 with a new set of features that extend LLM to provide tools … Simon Willison’s Weblog · simonwillison.net [1] Simon’s llm cli is getting quite interesting. I really want to run some clustering on my website content. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://simonwillison.net/2023/Sep/4/llm-embeddings/ [2]: /thoughts/