-
K3S Config After First Install
-
๐ญ Python Is Simultaneously At The Top And The Bott...
Hard to argue this take, happy to see that its at the top. With it being such an old language its amazing that it still
-
๐ญ Diskcache Api Reference โ Diskcache 5.6.1 Docume...
diskcache has a peekitem method that allows you to lookup the expire_time of a cached item without changing it. I recen
-
๐ญ Markdown-It-Pyrs ยท Pypi
markdown it py running in rust claims to be 20x faster. I'll definitely look into this if markdown it py is ever a bott
-
Diskcache As Debounce
I ! I am using it for longer running tasks and I don check if a job is running automatically expire jobs My brain first went to thinking I needed another servic
-
๐ญ Tusharsadhwani/Yen: Create Virtual Environments ...
> Create virtual environments for any Python version, without needing Python installed.
-
๐ญ Pyannotate: Auto-Generate Pep-484 Annotations
pyannotate is a tool that uses runtime types to suggest type annotations to use. Test runners such as pytest can be use
-
๐ญ Xxhash ยท Pypi
I hit an issue with markata where even though a bunch of articles were cached, the site build was still slow because I w
-
๐ญ Xxhash - Extremely Fast Non-Cryptographic Hash A...
> xxHash is an extremely fast non-cryptographic hash algorithm, working at RAM speed limit. It is proposed in four flavo
-
Latest Page In Markata
I just implemented a latest blog post link in Markata by asking for the first Feeds are setup in For more information on markata check out the full
-
Thinking About Static Sites In 2024
actions build k8s build fastapi sqlite
-
Markata
This post is a work in progress. Markata is the static site generator that I created to build my website It Gatsby and Next.js hit the scene as the next genera
-
Sick Wikilink Hover
Today I set up some sick wikilink hover effects using tailwind see I
-
๐ญ Hatch V1.10.0 - Hatch
Hatch be flyin. This new release of hatch includes support for the new package installer `uv` which is just mind blowin
-
Control Minio Token Access
To allow access only to the
-
How To List Sqlite Tables
You can inspect sqlite tables with the sqlite shell. note that you get into the shell with I also learned that Here is an output from my redka database. The
-
Copier Trust
I recently had to update my copier-gallery command to trust my own templates All the the copier copy api can be found with help.
-
Ipython F2
Today I accidentally ran f2 in ipython to discover that it opens your $EDITOR better yet add
-
Python Inline Snapshot
inline-snapshot Here is the most basic starter. Now when I run It also works with pydantic models.
-
Sqlmodel Indexes
I For every field that you will be querying on, you can create an index, by ! The docs cover this pretty well, and in quite depth -
-
Composing Typer Clis
Typer makes it easy to compose your cli applications, like you might with a web You will see similar patterns in the wild, namely the Lets setup the cli app it
-
One Day Build - Play Outside
Inspired by Adam Savage and his One Day builds on youtube. I often build This post will not directly show how to make a weather app, but document the It often
-
Jinja Macros
I am working on a page for Now I can use the same code for all of my links, and call the macro to use it.
-
Jinja Loop Variable And Htmx
jinja has a loop variable that is very handy to use with htmx. Whether you Now for every chunk of contacts that we load we will trigger the infinite
-
Fastapi Jinja Url_For With Query Params
Out of the box Starlette does not support url In my searching for this I found ! The route might look something like this. To access the home route using url
-
Setting Up A Kind Cluster With Argocd Installed
Kind (Kubernetes in Docker) is a tool that makes it easy to create and tear Argocd is a continuous delivery tool that makes it easy to setup gitops Here is how
-
Feeds
I have several feeds that you can consume my content with. Many posts will This is a feed of everything that I have published on my site to date. This is a fee
-
๐ญ We Finally Agree On Unit Tests - Youtube
Theo's response puts a lot of my feelings about unit testing into words. It's crazy how cargo culty it becomes that the
-
Thoughts On Unit Tests
Theo So much of software engineering is assembling existing well tested code. Crud This kind of reminds me of Manufacturing. Individual components are QA teste
-
๐ญ Mastodon.Py โ Mastodon.Py 1.8.1 Documentation
Mastadon.py is a python api client for mastadon that makes it easy to cross post to mastadon. ``` python from mastodon
-
๐ญ Datadog/Ddqa: Datadog'S Qa Manager For Releases ...
DataDog ddqa is building out a textual app and deploying it with pyapp. They have CI setup to fully build and cross com
-
Stripe Cancellations In Fastapi And Sqlmodel
Today I am working on fokais.com, trying to get to a point where I can launch I am building the fokais backent in python primarilyt with fastapi and sqlmodel He
-
Looking For A Heroku Replacement, What I Found Was...
I Now the part that I have struggled with is how to cheaply host a server I never really deployed anything that useful on heroku, but it seems like the fly is a
-
Hosted Platform Brainstorm
<img src="http://localhost:8000/shot/?url=https://asdf.com&height=450&width=800&scaled_width=800&scaled_height=450&selectors="
-
How To Host Static Content With Fastapi
I wanted to host some static files through fastapi. Typical use cases for this The docs cover how to host static files, and give this solution that is built If
-
Setup Tailwind For Jinja
I npm You will need to create a tailwind.config.js file, to get this you can use the cli. To set up tailwind to work with jinja templates you will need to point
-
๐ญ Read A Range Of Data - Limit And Offset - Sqlmod...
Implement paging in sqlmodel with where, limit, and offset. ``` python def select_heroes(): with Session(engine) as
-
๐ญ Python Script Is Not Found
When setting up a new machine, vm, docker image you might be installing command line tools from places like pip. They w
-
๐ญ (106) Python Sucks And I Love It | Prime Reacts ...
Prime reviews an article with some hot takes about python being slow and quirky, but good enough for a lot of things. E
-
Python Scandir Ignores Hidden Directories
The next version of markata will be around a full second faster at building I was looking through my profiler for some unexpected performance hits, and I starte
-
Pycon 2023
I don In an alternate timeline the maintainer of newton could have chose to use
-
Getting Started With Pydantic
Pydantic is a Python library for serializing data into models that can be To install pydantic you will first need python and pip. Once you have pip Always insta
-
Marvin'S Ai_Fn
-
Playing Star Wars Text Adventure With A 10 Yr Old
The following is a playthrough of Star Wars Text Adventure with a 10 yr old.The
-
Pydantic And Singledispatch
I was reading about Let Here is our model for our settings. We will create a CommonSettings model Now let Let results in Let results in So far one down side to
-
Pipx Textual Devtools
I really like having global cli command installed with pipx. Since textual You can pipx install textual. But if you try to run any textual cli commands you wil
-
Textual App Devtools
I am working through the textual tutorial, and I want to put it in a proper cli I set up a new project running If you are using Now to get devtools through a
-
Caching Python Virtual Environments In Github Acti...
-
Markata Github Pages
11ty https://www.rockyourcode.com/how-to-deploy-eleventy-to-github-pages-with-github-actions/ hugo puts it in the base url https://gohugo.io/getting-started/con
-
Markata Supports Jinja Plugins 0.5.0.Dev2
Markata now allows you to create jinja extensions that will be loaded right in The entry for 0.5.0.dev2 from markata Created entrypoint hook allowing for users
-
Using Django Rest Framework Inside React
-
Getting Started With Django Rest Framework
In my adventure to learn django, I want to be able to setup REST api To get started lets open up a Now we need to declare Next I will create all the files tha
-
Markata Now Uses Hatch
Markata now uses hatch as its build backend, and version bumping tool. Markata 0.5.0 is now out, and it Over the last month I made a big push to get 0.5.0 out,
-
Django Disallowed Host
I am continuing my journey into django, but today I am not at my workstation. I I found this in
-
Django Polls App
-
Django Create Superuser
My next step into django made me realize that I do not have access to the admin panel, turns out that I need to create a cuper user first. Right away when tryin
-
Trying Out Django
I have no experience in django, and in my exploration to become a better python If you found this at all helpful make sure you check out the The first thing I
-
How To Escape Variables In Jinja Templates
While updating my site to use Markata Jinja comes with a handy utility for escaping strings. I definitly tried to The issue I ran into was when trying to setup
-
I'Ve Made My Ipython Config Too Complicated, Let'S...
When I am developing python code I often have a repl open alongside of it So in the past the way I have setup a few extensions for myself is to add I missed the
-
Markata Extend In Configuration
A long needed feature of markata has been the ability to really configure out Now you can add some extra style to your site with the existing built-in Each text
-
Create A New Python Project With The Hatch Cli
I creating new versions created by myself with stable diffusion Note Running After running and naming the project You can also fill in the project name ahead
-
Versioning Python Projects With Hatch
Hatch has an amazing versioning cli for python packages that just works. It creating new versions created by myself with stable diffusion For trying out the T
-
From Markdown To Blog With Markata | Lightning Tal...
Markata is a great python framework that allows you to go from markdown to a Full transparancy... I built markata. The talk is live on YouTube. Make sure you c
-
I Spoke At Python Web Conf 2022
I spoke at python webconf in March 2022 about how I deploy this blog on a Building this blog has brought me a lot of benefits. I have I also bump into people f
-
Packages I Maintain
I open sourced the static site framework that I use to build {% gh {% gh I am a heavy user of the {% gh I use vim for all of my text editing needs. It brings m
-
I Turned On 2Fa For All Of My Pypi Packages
I got all the pypi packages that I own behind 2 factor authentication. ๐ช Recently this really made it I feel like this caused a bit of confusion as turning on 2
-
I Was On Talk Python
After years of listening to I was quite nervous to talk on a show that I helped shape my career in such a During the episode I tried my best to let Yetu and Iv
-
Use Vim To Remove Duplicates
I just love how some features of vim are so discoverable and memorable once you I recently used this to dedupe my autogenerated links section for Here is what t
-
Highlighting Text Ranges With Rich | Python
{% for year in markata.map( {% for post in markata.map( [
-
Highlighting Text Ranges With Rich | Python
Today I https://twitter.com/ While waiting for that reply let Lets import all the classes that we need from Now we need some code to highlight. I am going to r
-
Markata 0.3.0 Is 15-20% Faster
a sprinter edging out his opponent by Dall-e It Markata started off partly as a python developer frustrated with using nodejs Over time this side project has gr
-
How To Disable Kedro Viz | Or Any Kedro Hook
-
Gpu Stats In My Linux Statusbar
-
Get The Version Of Any Python Package | Python Api
A common meta thing that I need in python is to find the version of a package. In searching the internet for an answer nearly every one of them pointed me to Wh
-
Running My Blog On 3.11-Dev
3.10.5: 109.441
-
Manage Your Displays With Xrandr Manager
xrandr is a great cli to manage your windows in a linux distro using x11, which Check out the xrander-manager is a python cli application that is simply a nice
-
Ipython Q To Exit
So many terminal applications bind After digging way too deep into how IPython implements its It was that simple. This is not a game changer by any means, but
-
Copier Slugify | Python Templating | Using Cookiec...
It Yes the solution comes from a competing templating framework. I install copier with pipx, so I need to inject cookiecutter in to my copier If you are using a
-
Textual Has Devtools
Textual has devtools in the upcoming css branch, and its pretty awesome Textual is still very early and not really ready for prime time, but it As Textual is a
-
The One Pip Config You Need To Have
Whenever you are installing python packages, you should always use a virtual Pip is the pacakage tool for python. It installs third-party packages and is pytho
-
Pyenv No Module Named '_Sqlite3'
I I talked about why and how to use pyenv along with my first impressions in According to libsqlite3-dev When I make a fresh env and install ipython I still ge
-
Using Different Versions Of Python With Pipx | Pye...
I love using pipx for automatic virtual environment management of my globally This one took me a minute to figure out at first, please let me know if there My f
-
Live-Replay - Python Dev | Markata Todoui | 4/6/20...
https://youtu.be/-42A5210HYo Super fun steam Broadcasted live on Twitch -- Watch live at https://www.twitch.tv/waylonwalker We worked on markata todoui, a comma
-
Qutebrowser Clean Up All Status Bars
I really like the super clean look of no status menus, no url bar, no bookmarks
-
Convert Your Qutebrowser Config To Config.Py
When you first start qutebrowser It will create some config files in As far as I know qutebrowser will create this default config out of the You might want to c
-
List All Git Commits With Gitpython
I am getting ready to do some timeseries analysis on a git repo with python, my This returns a generator, if you are iterating over them this is likely what The
-
Using Git From Python
GitPython I recently made myself a handy tool for making screenshots in python and it [ GitPython Import Repo from the git library and create an instance of the
-
How I Quickly Capture Screenshots Directly Into My...
When I am creating blog posts it When I have something to take a screenshot of, I need to take the shot, take screenshot optimize conversion publish create img
-
Copier < 6.0.0B0 Considered Dangerous
Copier is a fantastic templating library written in python, but older versions As of May 15, 2022, the stable release of copier now includes these changes, if I
-
Pipx On Windows
Python, click install Edit the System Environment Variables Environment Variables button Add the following path to your users Path Variable
-
Pyohio Cfp'S
Here are some CFP Markata is a plugins all the way down static site generator, that covers all Lets build a whole blog site in 5 minutes. Sometimes python scrip
-
Python Sys.Excepthook
Sometimes you just want python to do something else when you hit an exception, I am working on a quick and dirty python script designed to take screenshots I co
-
Pygame Events Are Queued | Don'T Make This Mistake
pygame events are stored in a queue, by default the most suggested way You don Let printing the events reveal this Let printing the events reveals that there ar
-
Display Sprites In Pygame | Load And Blit
One of the most essential concepts of pygame to start making a game you will I started by making a spotlight in Gimp, by opening a 64x64 pixel image and This is
-
Dunk Is My New Diff Pager
Browsing through twitter the other day I discovered it through this Before I dive in deep, I do want to mention that Dunk is super new and beta at The author re
-
Pygame Boilerplate Apr 2022
I I What currently have is a single module starter package that is on github Since it You can make a quick game by inheriting from Game, and calling Here is wha
-
Did My Site Build Just Go Down?
My personal Site build went down last week, and I was unable to publish a new Classic IT fix, rerun it and see if you get the same error. Everyone is busy Also
-
Don'T Inherit From Python Baseexception, Here'S Wh...
I ran into a PR this week where the author was inheriting what BaseException Try running these examples in a Since things such as If you except from exception
-
How I Make Cache-Keys From Python Objects
When I need a consistent key for a pythohn object I often reach for Yesterday we talked about setting up a persistant cache with python diskcache. [ My first th
-
How I Setup A Sqlite Cache In Python
When I need to cache some data between runs or share a cache accross multiple Install diskcache into your virtual environement of choice using pip from your com
-
Cache A Python Function With Lru_Cache
The easiest way to speed up any code is to run less code. A common technique The easiest and most common to setup in python is a builtin functools.lru Any time
-
Set User Agent On Pandas Read_Csv
I keep a small I recently switched hosting from netlify over to cloudflare. Well cloudflare This breaks my go to example dataset. What After a bit of googling
-
Get Webpage With Python Requests
Python Requests is on pypi and can be installed into your virtual environtment with pip. Requests makes getting content from a web url as easy as possible. Requ
-
Style Lookatme Slides A Bit More Personal
I recently gave a talk at python web conf 2022, and one of the things I did Lets use this section to show what it โ This is how my write markdown build site p
-
How I Load Markdown In Python
I use a package It Frontmatter is a handy way to add metadata to your plain text files. It Here is the exact frontmatter for this post you are reading on my si
-
Python'S Dict Union Operator | Pep 584
Today I was watching the python web conf 2022 and saw I [ More on unpacking in this post. With the release there is also a new update syntax Are you writing li
-
How I Present Markdown Slides From The Terminal
I love the freedom of writing in markdown. It allows me to write content from I will most often just present right from the terminal using I sometimes also use
-
How I Read Files In Python
When I need to read contents from a plain text file in python I find the
-
How I Glob For Files In Python
A very common task for any script is to look for files on the system. My go to I setup a directory to make some examples about globbing. Here is what the 1 di
-
Pytest-Mock Basics
Last Thursday I learned about Watching him use pytest-mock is out on pypi and can be installed with pip. Sometimes I fall victim to making these posts nice an
-
Python Walrus Inside List Comprehension
Python 3.8 came out two and a half years ago and I have yet to really lean in Now that Python 3.6 is end of life, and most folks are using at least The assignm
-
Make Kedro Runs Beautiful
Kedro rich is a very new and unstable (it There is no pypi package yet, but it You can run your pipeline just as you normally would, except you get progress Lis
-
Open Files With Nvim Remote
I recently found a really great I have this added to my In my workflow I open a tmux session for each project, so this First open neovim, but with the If you
-
Textual Popup Hack
As I am toying around with textual, I am wanting some popup user input The main issue is that when you are in a textual app, it kinda owns the textual is still
-
Github Markdown Now Supports Mermaid Diagrams
Mermaid diagrams provide a way to display graphs defined as plain text. You can define nodes like this in mermaid, and GitHub will now render
-
Glances Can Watch Docker Processes
Glances is a system monitor with a ton of features, including docker processes. I have started using portainer to look at running docker processes, its a great
-
Glances Webui With Pipx
Glances has a pretty incredible webui to view system processes and information The nice thing about the webui is that it can be accessed from a remote system. Y
-
Run Glances Without Install With Pipx
Glances is a fully featured system monitoring tool written in python. Out of Once you run this you will be in a tui application similar to htop. You can
-
Nested Requirements.Txt In Python
python requirements text files can in fact depend on each other due to Lets create two requirements files in a new directory to play with. Then add the followin
-
View Aws Event Bridge Rules With Visidata
Reading eventbridge rules from the command line can be a total drag, pipe it I just love when I start thinking through how to parse a bunch of json at the
-
Python String Of Letters Is A String Of Letters, B...
In python, a string is a string until you add special characters. In browsing twitter this morning I came accross this tweet, that showed that https://twitter.c
-
Read Stderr From Python Subprocess.Popen
I often run shell commands from python with Popen, but not often enough To get the stderr we must get it from the proc, read it, and decode the Now that we can
-
Using A Python Markdown Ast To Find All Paragraphs
In looking for a way to automatically generate descriptions for pages I It When I originally wrote this post, I did not realize at the time that
-
Python Dict Get
For an embarassingly long time, til today, I have been wrapping my dict Lets consider this example for prices of supplies. Here we set a variable of What I wou
-
Find All Headings With Beautifulsoup
BeautifulSoup is a DOM like library for python. It Lets make a sample.html file with the following contents. It mainly has Lets import our packages, read in o
-
Lambda Function As A Kedro Node
I keep my nodes short and sweet. They do one thing and do it well. I Here are two examples, the first one Many times I just want to get the data in as fast as
-
Add New Dependencies To Your Kedro Project
As you work on your kedro projects you are bound to need to add more Before you start mucking around with any changes to dependencies make sure that New require
-
Practice Making Pipelines With Kedro
I am a huge believer in practicing your craft. Professional athletes [ Go to your playground directory, and if you don Install pipx in your system python. Thi
-
Tmux Hotkey For Copier Templates
I have added a hotkey to my copier template setup to quickly access all my I
-
Markata Filters As Telescope Pickers In Neovim
I often pop into my blog from neovim with the intent to look at just a To tie these into a Telescope picker you add the command as the NOTE telescope treates ea
-
Copier Tasks | Python Templating Post Run Task
Copier allows you to run post render tasks, just like cookiecutter. These are The example I have below runs an I have put the script in
-
Gradual Typing In Python
I https://youtu.be/Rk-Y71P Run Mypy as is, don Next we will add The final stage to this series is to add Make sure that you watch Anthony https://www.youtube.
-
Python Reverse Sluggify
In order to make an auto title plugin for markata I needed to come up ! Here I have a To turn this into a markata plugin I put it into a pre
-
Get Python Docstring With Ast
Getting docstrings from python First you need to load in some python code as a string, and parse it with You can then use To get all of the functions docstring
-
Python Respect The .Gitignore
Many tools such as ripgrep respect the Editors like vscode often do not include files that are .gitignored in pathspec pathspec
-
Rename Python Variables With Nvim
I don I first tried the nvim lsp rename, and it failed, Then I pip installed Once you have rope installed you can call rename on the variable.
-
Python Find Available Port
When running a python process that requires a port it
-
Python Functools Total Ordering
functools.total From the Docs: The class must define one of one of these and required to have this one Here is an example using the Enum I was working on the o
-
Implement --Pdb In A Python Cli
Adding a
-
Python Enum
Python comes with an enum module for creating enums. You can make your Enum values can be auto incremented by importing auto, and calling Enum
-
Installing Pipx On Ubuntu
I recently paired up with another dev running windows with Ubuntu running in Open up a terminal and get your required system dependencies using the apt I like r
-
Using Copier Answers To Rerun Templates Quickly
The copier answers file is a key component to making your templates Inside of my Inside my copier.yml I have setup my Once I change the I After rendering the
-
Making A Textual Widget From A Rich Renderable
Once you have made your sick looking cli apps with rich, eventually you are Install them from the command line. Import make a .py file and import them in it. If
-
Pipx Examples
-
Copier Templates
%%include til/copier %%include til/copier-template-variables %%include til/copier-answers
-
Changing Copier Template Strings (_Endops)
I was completely stuck for awhile. copier was not replacing my template !
-
Copier Template Variables
I By default copier uses double square brackets for its variables. note Before running copier we need to tell copier what variables to ask for, I prefer to inst
-
Running Kedro On Ubuntu 21.10 Impish Indri
I just installed a brand new Ubuntu 21.10 Impish Indri, and wanted a But what I got back was not what I expected This is weird, why cant I run kedro new with pi
-
A Minimal Pluggy Example
Pluggy makes it so easy to allow users to modify the behavior of a framework I As long as the framework document the hooks that are available and what it Instal
-
My First Impressions With Pyenv
pyenv provides an easy way to install almost any version of python from I needed to install an older version of python on ubuntu I Based on the Readme it looked
-
Installing Packages With Ansible Only If They Do N...
Part of my neovim setup requires having the re-installing a bunch of things that are already installed can be quite check if the command is installed with reg
-
Adding __Rich__ Methods To Python Classes
Adding a
-
Smoother Python With Automatic Imports | Pyflyby
This is not a flaky works half the time kind of plugin, it I can Give the video a watch, I did not have noise-cancelling on in obs. My pyflyby is hosted on pypi
-
Kedro Course
find all nodes with raw in the name use parameters make and use a logger use find-kedro in spaceflights slide in a new node vizualize your pipeline find slow no
-
Kedro Catalog Create
I use [ ๐ Unsure what kedro is? Check out this post. The command to ensure there are catalog entries for every dataset in the passed Create Fills in new datas
-
Using Nix To Manage My Python Interpreter
I recently started playing with nix. automatically select correct python version per project activating one doesn https://search.nixos.org/
-
Just Ask Ipython For Help
We can https://youtu.be/TZrRAP-9UMk In any python repl you can access the docstring of a function by calling for In Ipython we can even get some syntax highlig
-
Setting Parameters In Kedro
Parameters are a place for you to store variables for your pipeline that can be [ ๐ Unsure what kedro is? Check out this post. You can have multiple parameters
-
Writing Your First Kedro Nodes
https://youtu.be/-gEwU-MrPuA Before we jump in with anything crazy, let You will need to import node from kedro.pipeline to start creating nodes. The Inputs an
-
Running Your Kedro Pipeline From The Command Line
Running your kedro pipeline from the command line could not be any easier to [ ๐ Unsure what kedro is? Check out this post. To run the whole darn project all w
-
Kedro Virtual Environment
Avoid serious version conflict issues, and use a virtual environment anytime conda venv pipenv I prefer to use conda as my virtual environment manager of choice
-
Kedro Pipeline Create
Kedro pipeline create is a command that makes creating new https://youtu.be/HtyIKqlEoNw The kedro cli comes with the following command to scaffold out The direc
-
Kedro Install
Kedro comes with an https://youtu.be/IWimEs-hHQg You must start by having your kedro project either cloned down [ this post covers kedro new [ This post covers
-
Kedro Git Init
Immediately after https://youtu.be/IGba3ytf Its as simple as these three commands to get started. I don
-
Kedro New
Kedro new is simply a wrapper around the cookiecutter templating library. The [ Unsure what kedro is, Check out yesterdays post on What is Kedro. I reccomend u
-
What Is Kedro
Kedro is an unopinionated Data Engineering framework that comes with a somewhat [ This is an updated version of my original what-is-kedro article If you are doi
-
Incremental Versioned Datasets In Kedro
Kedro versioned datasets can be mixed with incremental and partitioned datasets [ ๐ Unsure what kedro is? Check out this post. This was a question presented to
-
Manage Many Git Repos With Ease
mu-repo
-
I Started Streaming On Twitch
I recently started streaming on python kedro Data Science Data Engineering webdev digital gardening It all started with My introduction to twitch came from Afte
-
Upcoming Stream
I am starting to stream 3 days per week, before I start work in the morning. On Monday kedro-diff test kedro-diff on piplines with history setup deploy pipeline
-
Kedro Spaceflights - Part 2 | Stream Replay June 7...
This was my seconf time ever streaming on
-
๐ฑ Digital Gardening | Gif To Mp4 | Stream Replay J...
https://youtu.be/I4VenHqIEng Doing some Digital Gardening on stream Ahrefs Errors ahrefs large images Automatic gif to mp4 After this stream all gifs on my site
-
Kedro Spaceflights - Part 1 | Stream Replay June 4...
This was my first time ever streaming on https://youtu.be/Y07UBr9Ccjs It all started with
-
Comprehensive Guide To Creating Kedro Nodes
The Kedro node is an essential part of the pipeline. It defines what catalog ๐ Unsure what kedro is? Check out this post. The node function is the most common a
-
Using Kedro In Scripts
With the latest releases of kedro [ If your just learning about kedro check out this post walking through it I To get kedro running, you will need a pipeline,
-
Creating Pypi-List With Kedro
I had an idea come to me via twitter. Short one word name packages are becoming I started with the simple index. Pypi provides a single page listing to every
-
Silence Kedro Logs
Kedro can have a chatty logger. While this is super nice in production First, how does one silence a python log? Python loggers can be retrieved by | Level
-
Python Lsp Setup
Setting up python with the native nvim>0.5 lsp was mr https://github.com/neovim/nvim-lspconfig https://github.com/palantir/python-language-server/issues/190
-
Python Diskcahe Is Locked
Running multiple processes using the same diskcache object can cause issues Minimum reporducible error is one of my superpowers in development. I do this Marka
-
Vim Fugitive
:on This one has nothing to do with fugitive, but is a native vim feature that C-i jump The jumplist is sorted Oldest to newest When navigating the jumplist wit
-
What Is If __Name__ == "__Main___", And How Do I U...
When a python module is called it is assigned the Let I have set this module up to execute one of two if statements based on whether Note it is not common to h
-
Custom Kedro Logger
DRAFT -
-
How To Install Micromamba On Linux (From The Comam...
I really like using conda ( Mamba is a reimplementation of the conda package manager in C++. parallel downloading of repository data and package files using mul
-
Kedro Replit
I am trying to see what an embeded replit
-
Zev Averbach Interview
Zev Averbach, Q: Tell me about your journey as a spreadsheet jockey into Data Engineering? A: First of all, it I Now that I As the business grew I was spending
-
Pytest Capsys
Testing print/log statements in pytest can be a bit tricky, capsys makes it capsys is a builtin pytest fixture that can be passed into any test to capture Simpl
-
Building Rich A Dev Server
I I am working on a project in which I want to have a dev automatic port number auto-restart display I am very novice at best when it comes to sockets, the fol
-
Fix Crlf For Entire Git Repo
-
Automatic Conda Environments
I have automated my process to create virtual environments in my python I You can learn more about direnv is in many package repos, or can be installed from bi
-
How I Review Pipeline Code
I have started doing more regular PR [ passing ci Variable Names Antipatterns No commented out code Docsttrings generally make sense Phase1 is typically a quick
-
Kedro Pipeline_Registry.Py
With the realease of create a register_pipelines register hook_impl class You should now have something that looks like this in your pipeline I was not able t
-
๐ Pluggable Architecture With Python
pytest has open sourced their amazing plugin framework My experience so far as a plugin user, and plugin author has been great. A hook is a single function tha
-
Create Og Image Covers Using Python
There are so many tutorials out there for creating OG images with
-
โ How Python Tools Are Configured
There are various ways to configure python tools, config files, code, or This will not include how they are implemented, I The motivation of this article is to
-
Markdown Cli
This is a post that may be a work in progress for awhile, Its a collections of posts tags draft posts frontmatter filepath content template html Markdown.Markdo
-
Minimal Kedro Pipeline
How small can a minimum kedro pipeline ready to package be? I made one within 4 files that you can pip install. It ๐ Note this is only a composable pipeline,
-
Blog Data With Python
Generating an api for a blog is much simpler than one might expect with python. fix missing data
-
Kedro - My Data Is Not A Table
In python data science/engineering most of our data is in the form of some sort These containers for data contain many convenient methods to manipulate table [
-
Quickly Change Conda Env With Fzf
Changing conda environments is a bit verbose, I use a function with fzf that I have used conda as a virtual environment tool for years now. I started using Wha
-
Minimal Python Package
What does it take to create an installable python package that can be hosted on pypi? setup.py my This post is somewhat inspired by the bottle framework, which
-
Ipython-Config
I use my ipython terminal daily. It Activate your virtual environment of choice and pip install it. Any time you You are using a virtual environment right? Vi
-
Custom Ipython Prompt
I If you already have an ipython config you can move on otherwise check out this [ I want something similar to the starship prompt I am using in the python vers
-
Ipython Ninjitsu
?docstring ??sourcecode %run %debug %autoreload %history autoformat %reset ! Stop going to google everytime your stuck and stay in your workflow. The Docstring
-
Automating My Post Starter
One thing we all dread is mundane work of getting started, and all the hoops it When I start a new post I need to cd into my blog directory, start neovim in a f
-
Windowing Python Lists
In python data science we often will reach for pandas a bit more than This post is a walkthrough of me solving a problem with I am working on a one-line-link
-
Testing Data Pipelines
Thinking through testing best practices for Data Pipelines
-
Reasons-To-Kedro
There are many reasons that you should be using kedro. If you are on a team of [ Kedro makes it super easy to get started with their cli that utilizes [ read m
-
What'S New In Kedro 0.16.6
This version of kedro releases a new set of supported deployment options and the spaceflights pipeline is officially added as a starter alias.
-
Designing A "Router" For Kedro
I released a router-like plugin for kedro back in April 2020. This was not the first design, the idea actually came from one of the QB folks who taught me kedr
-
Reclaim Memory Usage In Jupyter
Today I ran into an issue where we had a one-off script that just needed to It started with a colleague asking me How do I clear the memory in a Jupyter How do
-
Strip Trailing Whitespace From Git Projects
A common linting error thrown by various linters is for trailing whitespace. I read more about how
-
Three Things To Automate With Python Using Pandas
Here are three things that I see my non programming counterparts doing every single day. These really sum up so much of what folks do within an office. So man
-
How To Install Miniconda On Linux (From The Comman...
Installing miniconda from only the command line can be a bit of an intimidating task your first time. Lets walk through how to do it.
-
What'S New In Kedro 0.16.4
If we take a look at the This one comes a bit surprising as it was just casually mentioned in As mentioned in It feels a bit crazy that simply installing a p
-
Integration Testing With Python, Testproject.Io, A...
As I continue to build out Running integration tests will not prevent bugs from happening completely, but it will allow me to quickly spot them and rollback. T
-
๐ Practice Python Online
When learning a new skill it When learning a new skill it Here are three different options that I have used in the past to try out something at some various lev
-
Kedro Catalog
I am exploring a kedro catalog meta data hook
-
How Python Tools Configure
Mypy only uses pyproject.toml only uses pyproject.toml
-
๐ Parsing Rss Feeds With Python
I am looking into a way to replace my google reader experience that I had back This is how I used python to parse rss and setup my own custom feed. Install the
-
Slides - Understanding Python \*Args And \*\*Kwarg...
Python I generally post these as a carousel on LinkedIn based on a full article. Let mw know what you think of it shown inside of a blog See the full article
-
Gracefully Adopt Kedro, The Catalog
While using the catalog alone will not reap all of the benefits of the framework, it does get you and your project ready for the full framework eventually. For
-
How To Find Things In Your Kedro Catalog
kedro 0.16.2 just dropped last week with a long-awaited feature... The kedro data catalog is a key component to the kedro framework. It handles all data loadi
-
How Kedro Handles Your Inputs
Passing inputs into kedro is a key concept. Understanding how it accepts a Check out this post for a review of how [ When kedro runs your pipeline it uses the
-
016
-
017
-
015
-
018
-
Understanding Python \*Args And \*\*Kwargs
Python Python * When recieving variables as a Never add Generally I find If your Here Here the function signature makes it clear what Inversely we can s
-
011
Load
-
009
Combine a directory of
-
012
๐ add this to your
-
010
load remote
-
006
Setup
-
005
-
Pre-Commit Is Awesome
I recently discovered the โจ awesomeness that is pre-commit. I steered away I recently discovered the โจ awesomeness that is pre-commit. I steered away from it fo
-
002
-
Kedro Static Viz 0.3.0 Is Out With Hooks Support
Even though it is a static site there is no functionality lost. The only thing that Even though it Kedro viz is a fantastic kedro plugin that allows you to vis
-
001
-
Interrogate Is A Pretty Awesome, Brand New, Cli Fo...
dead simple docstring coverage for your python project
-
Create Custom Kedro Dataset
Kedro provides an efficient way to build out data catalogs with their yaml api. It allows you to be very declaritive about loading and saving your data. For t
-
Creating The Kedro-Preflight Hook
Kedro Hooks Intro - kedro hooks are an exciting upcoming feature of kedro kedro hooks are an exciting upcoming feature of kedro [ If you are completely unsure
-
๐ Kedro Preflight Notes
run checks before running the pipeline
-
Til: Bind Arguments To Dynamically Generated Lambd...
This past week I had a really weird bug in my After a few days of looking at it off and on, I pinpointed that it was all the way down in the raw layer. Right as
-
Python-Deepwatch
Is it possible to deep watch a single python function for changes? keeping track of a python functions hash is quite simple. There is a Using hashlib provides a
-
Four Github Actions For Python
If you are developing python packages and using GitHub here are four actions If you are developing python packages and using GitHub here are four actions that y
-
Variables Names Don'T Need Their Type
So often I see a variables Pandas Sometimes vanilla structures too It Always name your containers plural, so that naming while iterating is simple. Before I s
-
Create New Kedro Project
This is a quickstart to getting a new ๐งน Install ๐ข Create the Example Pipeline ๐จ Run the example ๐ Show the pipeline visualization I use conda to control my vi
-
What Is Kedro
[ This is my original what-is-kedro article. There is a brand new one Kedro is an open source data pipeline framework. It provides guardrails to set Currently
-
Long Variable Names Are Good
๐ท๏ธ Long variable names are a good thing. Self documenting code is more important than poorly documented code. Simply adding a few characters to your variable na
-
Simple Click 2
-
Simple Click
Add helpful cli to your python libraries... All of them!
-
Sqlalchemy Models
My Notes about using sqlalchemy models
-
Building Cli Apps In Python
learning about building cli apps in python
-
Kedro
My Notes about using kedro
-
๐ Packages To Investigate Notes
jmespath Tabnine |-|-| I definitely want to try this out with kedro. Bulwark is a package for convenient property-based testing of pandas dataframes, supported
-
Debugging Python
Debugging Python
-
Just Use Pathlib
Pathlib is an amazing cross-platform path tool.
-
Filtering Pandas
Filtering pandas DataFrames many different ways.
-
Making Good Documentation In Python
I just started using portray and it is amazingly simple to use
-
Pyspark
I have been using pyspark since March 2019, here are my thoughts.
-
Quick Progress Bars In Python Using Tqdm
Quick Progress Bars in python using TQDM
-
Clean Up Your Data Science With Named Tuples
If you are a regular listener of As you graduate your scripts into modules and libraries you might start to notice that you need to pass a lot of data around t
-
Background Tasks In Python For Data Science
This post is intended as an extension/update from This post is intended as an extension/update from I use it in more places than I probably should Before we g
-
Autoreload In Ipython
Autoreload in python
-
๐ Bash Notes
Waylon Walker's Bash Notes
-
Python Tips
** func( locals().update(d)
-
Generating Readme Tables From Pandas
none
-
Pycon 2018 Roundup
none
-
My Favorite Pandas Pattern
I work with a lot of transactional timeseries data that includes categories. I often want to create timeseries plots with each category as its own line. This is
-
Background Tasks In Python
none
-
Pycon 2017 Roundup
none
-
Python Atexit
I