Posts tagged: ai

I’ve been using gitingest [1] web ui [[ thoughts-516 ]] for quite awhile to serialize git [2] repo into llm friendly text files. This gives tools context about repos that are not in the training data so that it knows about it and how to use the code in the repo. gitingest also has a python library [[ thoughts-517 ]] I had a use case for a project not yet on git, and found yek. Installing yek # [3] Their instructions tell you to curl to bash. curl -fsSL https://bodo.run/yek.sh | bash I don’t like curl to bash from random sites, so I have my own self hosted [4] version of i.jpillora.com. I like using this because it pulls from github and I trust github as a source for artifacts as good as the repo I am pulling from. curl https://i.jpillora.com/bodo-run/yek | bash Using yek # [5] yek /tmp/yek-output/yek-output-bb01e621.txt This will give you a link to a text file that you can add to many llm tools. This happened so fast for me that I didn’t even believe that it worked properly. more options # [6] As with most clis, you can run yek --help to see the options available. yek --help References: [1]: https://gitingest.com/ [2]: /glossary/git/ [3]: #installing-yek [4]: /self-h...

What ChatGPT is NOT - Tech Raven Blog There is a lot of excitement about ChatGPT and how it allows us to interact with information and technology. I am actually excited that it now exists and still, I think it is being way overhyped. I... Tech Raven Blog - · blog.techravenconsulting.com [1] Do you remember regression models from college: given some data, you find a best fit line that allows you to predict Y given X. At the end of the day, ChatGPT, and LLMs in general, are the same thing as the regression model – it’s just that ChatGPT is the largest and fanciest model we currently have to model language and information. I really am coming to the idea of calling it a “word calculator”, this seems to be the most succinct description of llms that the lay person can comprehend and relate to. ChatGPT does not hallucinate or become unhinged I think Steve goes much deeper on this in his intervew on fafo.fm [2]. They describe it more as a pleaser or “yes man” essentially all the companies that are building these models want to give the “best” answer, better than their competitors. With this comes the risk of it being completely wrong, they are designed to always give an answer. O...

- Under 2000 everything is happy, green field. Any decision you have made is relatively easy to back out of (barring you making a library with downstream users), but as you go, regret kicks in. Regret we didn’t make that pydantic 2 upgrade earlier, as new features become more apealing. Regret that we chose sqlite for simplicity, speed, agility, and now we might need robust and distributed. Regret that you chose a front end framework, or to have a front end at all to a backend problem. Regret that you put 6 layers of abstraction on your db early on and now that you understand the problem you want different abstractions, but all of your endpoints deeply depend on the current one. Vibe coding [1] will not save you, it will only make these wrong decisions for you without the context that you have. You will hate it’s decisions more because you had no input into some of them. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /vibe-coding/ [2]: /thoughts/

Vectorizing Your Databases with Steve Pousty What exactly is an LLM doing and why do you need to learn so many new terms? Steve Pousty is here to explain that most of those new terms are things you already kno… Fork Around And Find Out · fafo.fm [1] Steve is such a great listen, the neurospicy 🌶️ rambles this episode goes on is so relatable. I feel like I really missed out on some great takes on intellij vs neovim, but got some really great knowledge about vector db’s, embedding, text compression, similarities to vector algegra like infinite craft. Just popped open infinitecraft and I’ve definitely played this with my kids before, super fun, just could not remember the name of this one. I do remember an android one as well that is alchemist or something like that, which we have also played a lot. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://www.fafo.fm/vectorizing-your-databases-with-steve-pousty/ [2]: /thoughts/

A quote from Mark Zuckerberg You also mentioned the whole Chatbot Arena thing, which I think is interesting and points to the challenge around how you do benchmarking. How do you know what models are … Simon Willison’s Weblog · simonwillison.net [1] Interesting how confidently he says we can easily go to the top. really makes you wonder what we the normies are leaving on the table by using these general purpose models and what could be achieved with really tuned in models. Could I make an automatic blog tagger more accurately, maybe smaller, maybe tuned so well it runs fine on cpu? Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://simonwillison.net/2025/May/1/mark-zuckerberg/#atom-everything [2]: /thoughts/

External Link r.jina.ai [1] jina reader is a pretty sweet tool to convert a site to ai compatible text. There are other web to markdown types of tools, but the convenience of just adding r.jina.ai to the front of any page makes it so easy to grab for one page of docs. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://r.jina.ai/ [2]: /thoughts/

- the racked up 4 framework mainboards sound wild. connected with usb4 and 5gig ethernet. they said they can run big models quantized down from 600Gb to within the 512GB limit they have. This seems wild to bring this level of capability to such a low price point. It will be really cool to start to see demos come out. Note This post is a thought [1]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /thoughts/

OpenTools | The API for LLM tool use One API to use any LLM with every MCP tool OpenTools · opentools.com [1] OpenTools is an index for mcp servers to work with new agentic workflows like roo code and windsurf. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://opentools.com/ [2]: /thoughts/

- Damn prime makes an interesting point near then end of this video. He’s seen a bunch of people able to just throw down charts and shit at their company and end up being “the coding guy” cause they proompted something once. In a way I can relate, I got into software in a similar way, but at a time that it took a lot more hard work, understanding , and copy past from the right stack overflow. Based on some of the people around me at the time I can only imagine how some people must feel like they got pushed into it without wanting it, and now are building something they don’t know anything about with no care about it or care to build any expertise. Is the future proompted charts from enterprise chatgpt or do we only continue growing more need for software from here. [1] Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://dropper.waylonwalker.com/api/file/d43265cd-7fe1-4cb4-a22e-d82a37a2e368.webp [2]: /thoughts/

- There is a glimmer of hope out there that normal people can scrap together enough gpu to really run the latest models themselves. The ui really appears to be having huge leaps forward such that doing things like rag is no longer such a research project that it was just a few years ago. So excited to see Prime go through this homelab [1] exercise. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /homelab/ [2]: /thoughts/

- Damn these deepseek memes go hard. Wild to see openai get played by their own game. It’s crazy that the normie news that I have seen on deepseek shows that the Chinese made what the Americans did at a fraction of the price, without taking notice that they are building on the shoulders of openai. Note This post is a thought [1]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /thoughts/

- 👏👏👏 This one is really good. I’m right there with him on most of this. I am very hesitant on subscription models, and all the ai tools feel like they are getting ready to be the next round of death by a thousand cuts, this time with pretty limited free tier and relatively high prices to run. I’m sure we will see companies get taken by huge bills soon by building off of someone else’s service. On the flip side I’m definitely the guy that gets in a rut of just copy paste to the ai, wait for codeium to to inject. I feel like I have issues of momentum more than anything. When I’m on one side or the other I tend to stick it out for too long, but less so on going without because that llm drug is calling you when you hit a hard problem. I’m excited to see him build out a homelab [1] for llm stuff that he mentioned at the top. I’m interested, but probably not building one out for myself until we start to see some cheaper maybe used hardware to do it. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /homelab/ [2]: /thoughts/

- Don’t stop learning! Stop trying because you have a doomer outlook on ai, llms, industry and think they are taking over. If you have no hope for the future, if you stop now you are cementing in that you will be no good and the ai will be better. Many, maybe most of us in this industry go here by hard work, long nights of learning, trying to solve problems that our job had. If llms take over then the world is going to be a whole lot different, it will be a world you cannot predict or plan for. For now put your head down and succeed in the world we have today. TEEJ has some great thoughts on this whole sentiment, put this on for you morning walk or whatever you do. Note This post is a thought [1]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /thoughts/

Quick Start - kotaemon Docs cinnamon.github.io [1] interesting UI for RAG based workflows, i.e. chatting with your documents. It looks like it can run a number of models, feels like ollama with RAG and a nice web ui. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://cinnamon.github.io/kotaemon/ [2]: /thoughts/

[1] Looks like a great start to a rules file for fastapi [2]. - Place the happy path last in the function for improved readability. I have never heard anyone say this. It feels weird to me. The other early return, find and handle errors early all make sense to me, but happy path last is new to me. Note This post is a thought [3]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /static/https://github.com/PatrickJS/awesome-cursorrules/blob/main/rules/py-fast-api/.cursorrules [2]: /fastapi/ [3]: /thoughts/

Generate Custom .cursorrules for Your Project Based on Community Examples expert led courses for front-end web developers and teams that want to level up through straightforward and concise lessons on the most useful tools available. egghead · egghead.io [1] Really interesting way to generate a rules file for agentic workflows based on your current repo. John uses gitingest here, looks like a fantastic tool, but probably not useful for most private repos. I’m sure you can replicate the same thing in a private repo wtih a small amount of effort the few times you need to do it. gitingest looks like a great way to pull in some extra context for some open source dependencies that you have though. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://egghead.io/generate-custom-cursorrules-for-your-project-based-on-community-examples~eimq2 [2]: /thoughts/

GitHub - coderamp-labs/gitingest: Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase - coderamp-labs/gitingest GitHub · github.com [1] Gitingest has a python package on pypi that you can run with uvx, and it accepts the same arguments as the web version, right in your terminal ⬢ [devtainer] ❯ uvx gitingest --help Usage: gitingest [OPTIONS] SOURCE Analyze a directory and create a text dump of its contents. Options: -o, --output TEXT Output file path (default: <repo_name>.txt in current directory) -s, --max-size INTEGER Maximum file size to process in bytes -e, --exclude-pattern TEXT Patterns to exclude -i, --include-pattern TEXT Patterns to include --help Show this message and exit. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://github.com/cyclotruc/gitingest [2]: /thoughts/

Gitingest Replace gitingest.com [1] Replace hub with ingest in any github and get a prompt friendly codebase ready to feed into any llm. It combines the entire codebase, based on a gitignore style glob that you pass in, into a single TXT file. Note This post is a thought [2]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: https://gitingest.com/ [2]: /thoughts/

- Holy shit these AGI models are incredibly expensive to run, require lots of wild hardware that there is not enough to go around, and requires shit tons of power to run. Now more than ever is time to distinguish yourself with deep expertise, jack of all trades is being eaten by ai. People with deep expertise are getting a jack of all trades bump from ai, not o3, just the regular stuff. Note This post is a thought [1]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: /thoughts/

- This was an eye opening video into agentic editing workflows. setting rules # [1] Dfferent ai tools use different rules files, windsurf uses .windsurfrules. [2] testing out rules # [3] Test out your rules file by having it say something at the beginning of the output to verify that the rules are being applied correctly. [4] First line # [5] He suggests to use this key rule for debugging purposes, otherwise you are guessing to what rules if any it is following. Every time you choose to apply a rule(s), explicitly state the rule(s) in the output. You can abbreviate the rule description to a single word or phrase. Note This post is a thought [6]. It’s a short note that I make about someone else’s content online #thoughts References: [1]: #setting-rules [2]: https://dropper.waylonwalker.com/api/file/f75bf439-919f-4c19-8695-176ca8a7d52d.webp [3]: #testing-out-rules [4]: https://dropper.waylonwalker.com/api/file/ebeed79c-435b-4aab-b3dc-c744b144c438.webp [5]: #first-line [6]: /thoughts/