-
💭 Choosing color palettes — seaborn 0.13.2 documen...
Good overview of seaborn color palettes. They have all sorts of different types, some designed to purposfully give each
-
💭 Proper handling of None in WHERE condition · Iss...
SQLModel models ship with an is, and isnot that you can use to compare to None without pesky linters complaining.
-
💭 Aaron Francis on X: "📣 We're excited to announce...
Aaron Francis is a database master, pumped for thsi dude and all that he is able to accomplish.
-
💭 Database Remote-Copy Tool For SQLite (draft)
Simon shared a really cool new utility tool for sqlite ispired by rsync. It checks hashes of each sqlite page and syncs
-
💭 Sqlite-jiff
Sqlite is getting rust extensions now, and datetimes make it totally worth if if they work well and and fast, two things
-
💭 sql - How can I list the tables in a SQLite data...
I learned about the sqlitemaster table from this stack overflow answer. This helps make a lot of sense to how sqlite w
-
💭 nalgeon/redka: Redis re-implemented with SQLite
Redka a sick new redis compatable api, that uses sqlite as its backend datastore. It feels lightweight to use as it is
-
sqlite vacuum
Today I learned how to VACUUM a sqlite database and cut its size in about half. It's a database that I have had running for quite awhile and has some decen
-
💭 sql - SQLite: COUNT slow on big tables - Stack O...
Another interesting option for slow count queries in sqlite. > If you haven't DELETEd any records, doing: sql SELE
-
💭 Optimizing SQLite for servers
Very interesting article by Sylvain, suggested by Simon Willison. Definitely some things that I want to come back and t
-
💭 learning strawberry
python import logging from typing import List import strawberry from fastapi import FastAPI from strawberry.fastapi
-
💭 searching my thoughts locally
First I need to fetch my thoughts from the api, and put it in a local sqlite database using sqlite-utils. bash ft
-
💭 Creating One-To-Many Relationships in Flask-SQLA...
Great example from Anthony showing how easy it is to practice building database orm models and playing with them in a re
-
💭 python - Concepts of backref and back_populate i...
Today I came across some sqlalchemy models that created some relationships, some used backref some used backpopula
-
💭 Read a Range of Data - LIMIT and OFFSET - SQLMod...
Today I was running some sqlmodel queries through the sqlalchemy orm. Admittedly I've not done enough orm queries befor
-
💭 Open source, not open contribution with Ben John...
Ben Johnson was on the Changelog a few years back covering his work on litestream, and talks about why he chose to go op
-
💭 DjangoCon Europe 2023 | Use SQLite in production...
Very inspiring talk, TLDR, you probably don't need a database server. sqlite will probably be faster, simpler to mainta
-
Set up minio bucket entrypoint
I recently se tup minio object storage in my homelab for litestream sqlite backups. The litestream quickstart made it easy to get everything up and running on l
-
💭 benbjohnson/litestream: Streaming replication fo...
litestream is a sick cli tool for steaming replicas of sqlite. It automatically does daily snapshots, and str
-
why-is-postgres-default
Serious question. No one ever got fired for choosing PostgreSQL But, why. It's the most loved db, right? Right? Maybe it's time to rethink it. Don
-
💭 Why I Built Litestream - Litestream
As applications scale to the edge, to put compute as close to the user as possible, database queries back to the master
-
💭 I'm All-In on Server-Side SQLite · The Fly Blog
SQLite is the next big database trend. with more horizontal scaling, close to user read heavy applications, having your
-
💭 LiteFS Cloud: Distributed SQLite with Managed Ba...
Fly.io's solution to sqlite managed backups.I definitely want to look into this a bit, but moreso the tech under the hoo
-
💭 SQLite FTS5 Extension
sqlite has 3 different tokenizers, porter, ascii, trigram. These can be used with sqlite-utils. bash sqlite-ut
-
💭 sqlite_utils Python library - sqlite-utils
sqlite-utils is primarily a cli tool for sqlite operations such as enabling full text search, and executing searches, bu
-
💭 simonw/datasette-render-markdown: Datasette plug...
datasette really does everything doesn't it!
-
💭 `ValueError: Constraint must have a name` in ale...
After a nasty time with alembic upgrades, thoughts is about to get a new users table. This may have came from incorrect
-
💭 Use Alembic Check to check for possible upgrades
Since using alembic I have been just running out a new revision checking its content and deleting it if its empty, today
-
💭 DuckDB vs. MotherDuck — should you switch to the...
duckdb is a new in process database that has been making its rounds in analytics for its high performance in those appli
-
💭 s3-tree · PyPI
Super useful way to show a tree view of an s3 bucket's structure! python pip install s3-tree python s3-t
-
💭 python - SQLAlchemy ORDER BY DESCENDING? - Stack...
How to sort results from a sqlalchemy based orm. python .orderby(model.Entry.amount.desc()) I needed this to
-
💭 kndndrj/nvim-dbee: Interactive database client f...
A neovim database client that I need to check out.
-
💭 sqlite-utils now supports plugins
As the title states sqlite-utils now supports plugins. I dug in just a bit and Simon implemented this completely with e
-
💭 Column INSERT/UPDATE Defaults — SQLAlchemy 1.4 D...
sqlalchemy serverdefaults end up as defaults in the database when new values are inserted. python t = Table( "
-
💭 Harlequin SQL IDE - DuckDB
Harlequin is a pretty sweet example of what textual can be used to create. Its a terminal based sql ide for DuckDB.
-
💭 Python API - DuckDB
To persist data in duckdb you need to first make a connection to a duck db database. python con = duckdb.connect('f
-
💭 SQL on Pandas - DuckDB
duckdb can just query any pandas dataframe that is in memory. > I tried running it against a list of objects and got th
-
💭 Filter Data - WHERE - SQLModel
When fetching pydantic models from the database with sqlmodel, and you cannot select your item by id, you probably need
-
💭 Full-text search - Datasette documentation
Enable full-text search in sqlite using sqlite-utils. bash $ sqlite-utils enable-fts mydatabase.db items name descr
-
💭 sqlite-utils command-line tool - sqlite-utils
I want to like jq, but I think Simon is selling me on sqlite, maybe its just me but this looks readable, hackable, edita
-
💭 sqlite-utils command-line tool - sqlite-utils
insert a json array directly into into sqlite with sqlite-utils. bash echo '{"name": "Cleo", "age": 4}' | sqlite-ut
-
JUT | Read Notebooks in the Terminal
Trying to read a .ipynb file without starting a jupyter server? jut has you covered. https://youtu.be/t8AvImnwor0 watch the video version of this post on [YouT
-
Minimal Kedro Pipeline
How small can a minimum kedro pipeline ready to package be? I made one within 4 files that you can pip install. It's only a total of 35 lines of python,
-
Kedro - My Data Is Not A Table
In python data science/engineering most of our data is in the form of some sort of table, typically a DataFrame from a library like pandas, spark, or dask. Data
-
Gracefully adopt kedro, the catalog
Why use kedro catalog? While using the catalog alone will not reap all of the benefits of the framework, it does get you and your project ready for the full fra
-
How to find things in your kedro catalog
kedro 0.16.2 just dropped last week with a long-awaited feature... **catalog search**! I went as far as monkey patching this into each of my projects. I work
-
How Kedro handles your inputs
Passing inputs into kedro is a key concept. Understanding how it accepts a single catalog key as input is quite trivial that easily makes sense, but passing a
-
Create Custom Kedro Dataset
Kedro provides an efficient way to build out data catalogs with their yaml api. It allows you to be very declaritive about loading and saving your data. For t
-
What is YOUR Advice for New Data Scientists
Learn the business Learn Git Your code does not need to be amazing Keep Learning Learn Git You dont have to start out as a git wizard with the cleanest possible
-
Filtering Pandas
Filtering pandas DataFrames many different ways.
-
Clean up Your Data Science with Named Tuples
If you are a regular listener of [TalkPython](https://talkpython.fm) or PythonBytes you have hear Michael Kennedy talk about Named Tuples many times, but what a
-
Background Tasks in Python for Data Science
This post is intended as an extension/update from [background tasks in python](https://waylonwalker.com/background-1/). I started using `background` the week t