Posts tagged: database

💭 Rewriting SQLite from prison with Preston Thorpe - YouTube

2025-11-02T15:46:38Z

Absolutely incredible what Preston is doing with his time. What a life changing experience this must be for him. Good job to Turso for making this happen. We are going to end up with very feature rich file based databases out of this that the whole world will benefit from.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 From Prisma Founder to LiveStore: Building local-first apps wi...

2025-05-31T20:58:05Z

This talk about live store really made me think about database transactions in a new way. They are talking about live-store, and the complexity of distributed applications like a notes app with the ability to go offline and continue working. The complexity of resyncing each instance is not simple, conflict resolution accross all the possible installs that may or may not even be online is a really hard problem. They go deep on discussing an event driven paradigm that is driven off of a log of events and how this changes how we deal with databases. Using the event log as the source of truth we can do things like forget about database migrations, we can replay all of the events onto a new database. Its very interesting to rethink in terms of a log system that speaks in terms of understandable events (not table operations) as the source of truth for an application.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 Aaron Francis on X: "📣 We're excited to announce Mastering Pos...

2024-10-27T02:52:38Z

External Link

X (formerly Twitter) · x.com

Aaron Francis is a database master, pumped for thsi dude and all that he is able to accomplish.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 Open source, not open contribution with Ben Johnson (Changelog...

2023-10-05T01:11:19Z

Open source, not open contribution with Ben Johnson (Changelog Interviews #433)

This week we're talking with Ben Johnson. Ben is known for his work on BoltDB, his work in open source, and as a freelance Go developer. Late January when Ben open sourced his newest project Litest...

Changelog · changelog.com

Ben Johnson was on the Changelog a few years back covering his work on litestream, and talks about why he chose to go open source, but not open contribution.

You should have a good reason to move off of sqlite.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 DjangoCon Europe 2023 | Use SQLite in production - YouTube

2023-10-03T13:22:19Z

Very inspiring talk, TLDR, you probably don’t need a database server. sqlite will probably be faster, simpler to maintain, and simpler to test your application.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 benbjohnson/litestream: Streaming replication for SQLite.

2023-10-01T02:19:18Z

GitHub - benbjohnson/litestream: Streaming replication for SQLite.

Streaming replication for SQLite. Contribute to benbjohnson/litestream development by creating an account on GitHub.

GitHub · github.com

    `litestream` is a sick cli tool for steaming replicas of sqlite.  It automatically does daily snapshots, and streams all of the writes to the replica live.

install #

Install is fast using installer, no compilation, just copy the binary and run.

curl https://i.wayl.one/benbjohnson/litestream

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 Why I Built Litestream - Litestream

2023-09-30T16:16:47Z

Why I Built Litestream - Litestream

Despite an exponential increase in computing power, our applications require more machines than ever because of architectural decisions made 25 years ago. You can eliminate much of your complexity ...

litestream.io

As applications scale to the edge, to put compute as close to the user as possible, database queries back to the master node get slower and slower. Enter sqlite replication, put the database wtih the application code and replicate from master.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 I'm All-In on Server-Side SQLite · The Fly Blog

2023-09-30T14:54:33Z

I'm All-In on Server-Side SQLite

Ben Johnson has joined Fly.io

Fly · fly.io

SQLite is the next big database trend. with more horizontal scaling, close to user read heavy applications, having your database in the same application stack makes a lot of sense. Tools like litestream are going to enable global distribution in an impressive way.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 LiteFS Cloud: Distributed SQLite with Managed Backups · The Fl...

2023-09-30T14:49:41Z

LiteFS Cloud: Distributed SQLite with Managed Backups

Documentation and guides from the team at Fly.io.

Fly · fly.io

Fly.io’s solution to sqlite managed backups.I definitely want to look into this a bit, but moreso the tech under the hook litestream.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 SQLite FTS5 Extension

2023-08-21T13:33:24Z

sqlite has 3 different tokenizers, porter, ascii, trigram.

These can be used with sqlite-utils.

sqlite-utils enable-fts --tokenize porter database.db post title message tags

And with the python api.

db = Database('database.db')
db["post"].enable_fts(
                ["title", "message", "tags"], create_triggers=True, tokenize="trigram"
            )
posts = list(db["post"].search(search))

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 simonw/datasette-render-markdown: Datasette plugin for renderi...

2023-08-16T00:48:07Z

GitHub - simonw/datasette-render-markdown: Datasette plugin for rendering Markdown

Datasette plugin for rendering Markdown. Contribute to simonw/datasette-render-markdown development by creating an account on GitHub.

GitHub · github.com

datasette really does everything doesn’t it!

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 `ValueError: Constraint must have a name` in alembic 1.10.0 · ...

2023-08-05T01:25:07Z

`ValueError: Constraint must have a name` in alembic 1.10.0 · Issue #1195 · sqlalchemy/alembic

Describe the bug ValueError: Constraint must have a name in alembic 1.10.0. Expected behavior Migration succeeds. To Reproduce Please try to provide a Minimal, Complete, and Verifiable example, wit...

GitHub · github.com

After a nasty time with alembic upgrades, thoughts is about to get a new users table. This may have came from incorrectly setting up alembic for sqlite from the start, but I was able to fix the issue with this GitHub issue.

alembic sqlite ValueError: Constraint must have a name

The change I needed to make to get my migration to run.


        + batch_op.create_foreign_key('fk_post_author_id_user', 'user', ['author_id'], ['id'])

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 Use Alembic Check to check for possible upgrades

2023-08-05T01:22:06Z

![[None]]

Since using alembic I have been just running out a new revision checking its content and deleting it if its empty, today I learned there is an alembic check command to check for operations that need to be created.

❯ alembic check
INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
No new upgrade operations detected.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 DuckDB vs. MotherDuck — should you switch to the cloud version...

2023-07-31T22:36:12Z

DuckDB vs. MotherDuck — should you switch to the cloud version? | Kestra

Why and when to use MotherDuck over local DuckDB

kestra.io

duckdb is a new in process database that has been making its rounds in analytics for its high performance in those applications.

Mother duck is a centeralized server that brings manages storage, data sharing and an ide to duckdb.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 kndndrj/nvim-dbee: Interactive database client for neovim

2023-07-29T01:08:20Z

GitHub - kndndrj/nvim-dbee: Interactive database client for neovim

Interactive database client for neovim. Contribute to kndndrj/nvim-dbee development by creating an account on GitHub.

GitHub · github.com

A neovim database client that I need to check out.

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 Full-text search - Datasette documentation

2023-07-28T14:59:37Z

Full-text search - Datasette documentation

docs.datasette.io

Enable full-text search in sqlite using sqlite-utils.

$ sqlite-utils enable-fts mydatabase.db items name description

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 sqlite-utils command-line tool - sqlite-utils

2023-07-28T14:59:37Z

sqlite-utils command-line tool - sqlite-utils

sqlite-utils.datasette.io

I want to like jq, but I think Simon is selling me on sqlite, maybe its just me but this looks readable, hackable, editable, memorizable. Everytime I try jq, and its 5 minutes fussing with it just to get the most basic thing to work. I know enough sql out of the gate to make this work off the top of my head

curl  https://thoughts.waylonwalker.com/posts/ | sqlite-utils memory - 'select title, message from stdin where stdin.tags like "%python%"' | jq

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts

💭 sqlite-utils command-line tool - sqlite-utils

2023-07-28T14:59:37Z

sqlite-utils command-line tool - sqlite-utils

sqlite-utils.datasette.io

insert a json array directly into into sqlite with sqlite-utils.

echo '{"name": "Cleo", "age": 4}' | sqlite-utils insert dogs.db dogs -

Note

This post is a thought. It’s a short note that I make about someone else’s content online #thoughts