If you’re into interesting projects, don’t miss out on asdf [1], created by asdf-vm [2].
Extendable version manager with support for Ruby, Node.js, Elixir, Erlang & more
References:
[1]: https://github.com/asdf-vm/asdf
[2]: https://github.com/asdf-vm
Archive
All published posts
2469 posts
latest post 2026-05-08
Publishing rhythm
I came across outputformat [1] from delestro [2], and it’s packed with great features and ideas.
Python library to decorate and beautify strings
References:
[1]: https://github.com/delestro/outputformat
[2]: https://github.com/delestro
pyenv [1] has done a fantastic job with pyenv [2]. Highly recommend taking a look.
Simple Python version management
References:
[1]: https://github.com/pyenv
[2]: https://github.com/pyenv/pyenv
pyenv [1] has done a fantastic job with pyenv-installer [2]. Highly recommend taking a look.
This tool is used to install pyenv and friends.
References:
[1]: https://github.com/pyenv
[2]: https://github.com/pyenv/pyenv-installer
vim-abolish [1] by tpope [2] is a game-changer in its space. Excited to see how it evolves.
abolish.vim: Work with several variants of a word at once
References:
[1]: https://github.com/tpope/vim-abolish
[2]: https://github.com/tpope
I came across Talkpython.fm-Notable-Packages [1] from xandrade [2], and it’s packed with great features and ideas.
[unofficial] Talkpython.fm podcast notable PyPI packages compilation
References:
[1]: https://github.com/xandrade/Talkpython.fm-Notable-Packages
[2]: https://github.com/xandrade
Smoother Python with automatic imports | pyflyby
This is not a flaky works half the time kind of plugin, it’s a seriously smooth
editing experience. I’ve just started using pyflyby, and it is solid so far.
I have automatic imports on every save of a python file in neovim, and
automatic imports on every command in ipython.
I can’t tell you how pumped I am for this, and how good its felt to use over
the past few weeks. It’s glorious.
YouTube video # [1]
Listen to me rant on how great pyflyby is
https://youtu.be/2QW5DJiEJH4
Give the video a watch, I did not have noise-cancelling on in obs. My
apologies for the background hum and the mic stand bumps. I did my best to fix
them up.
Installation # [2]
How to install pyflyby for automatic python imports
pyflyby is hosted on pypi, so you can get it with pip. I have had no issues
installing it on 3.8+ so far.
pip install pyflyby
Configuration setup with stow # [3]
always stow your dotfiles
If you’re going to configure any of your tools the first thing you should do is
set it up w...
Check out aoc-2021-kedro-playground [1] by pypeaday [2]. It’s a well-crafted project with great potential.
No description available.
References:
[1]: https://github.com/pypeaday/aoc-2021-kedro-playground
[2]: https://github.com/pypeaday
Looking for inspiration? dotfiles [1] by elnappo [2].
my .files - powered by Ansible
References:
[1]: https://github.com/elnappo/dotfiles
[2]: https://github.com/elnappo
You must use augroup with autocmd in vim | Here's how
If you are running vim autocmd’s without a group, you’re killing your
performance. Granted your probably not sourcing your vimscript files with
autocmd’s too often, but every time you source that vimscript you are adding
another command that needs to run redundantly.
https://youtu.be/2ITTn4Dl0lc
This is what I had # [1]
Not silky smooth
For WAAY too long I have had something like this in my vimrc or init.vim.
It formats my python for me on every save, works great except if I source my
dotfiles more than once I start adding how many times black runs.
autocmd bufwritepre *.py execute 'Black'
Why is a bare autocmd bad # [2]
let me demonstrate
Lets create a new file called format.vim and give it the :so %. Works
great, it starts telling me that its formatting.
autocmd bufwritepre *.py :echo("formatting with black")
[3]
BUT as every time I give it the :so % it formats an extra time on every
single save.
Setting up an augroup # [4]
I’ve been told I need an augroup to prevent ...
Code Review from the comfort of vim | Diffurcate
I often review Pull requests from the browser as it just makes it so easy to see
the diffs and navigate through them, but there comes a time when the diffs get
really big and hard to follow. That’s when its time to bring in the comforts of
vim.
https://youtu.be/5NKaZFavM0E
Plugins needed # [1]
This all stems from the great plugin by
AndrewRadev [2]. It breaks a down
into a project. So rather than poping into a pager from git [3] diff,
you can pipe to diffurcate and it will setup a project in a tmp
directory for you and you can browse this project just like any
other except it’s just a diff.
Plug 'AndrewRadev/diffurcate.vim'
My aliases # [4]
First to quickly checkout PR’s from azure devops I have setup an alias to fuzzy
select a pr and let the az command do the checkout.
alias azcheckout='az repos pr checkout --id $(az repos pr list --output table | tail -n -2 | fzf | cut -d " " -f1)'
Next I have a few aliases setup for checking diffs. The first one checks what
is staged vs the...
Setup a yaml schema | yamlls for a silky smooth setup
I’ve gone far too long without a good setup for editing yaml
files, I am missing out on autocomplete and proper diagnostics.
This ends today as I setup yaml-language-server in neovim.
https://youtu.be/xo4HrFoKF4c
The video for this one is part of a
challenge-playlist [1]
I put out for myself to constantly improve my dotfiles for all of December.
init.vim # [2]
I have my init.vim setup to only source other modules, if you want everything
in a single config, feel free to do as you wish. I broke mine up earlier this
year as I doubled into nvim and am not going back.
source ~/.config/nvim/plugins.vim
lua require'waylonwalker.cmp'
lua require'waylonwalker.lsp-config'
Plugin setup # [3]
You will need the following plugins. I use plug, if you don’t you will have to
convert the syntax over to the plugin manager you use.
neovim/nvim-lspconfig [4] is for
configuring the lsp. It comes with a bunch of sane defaults for most servers,
so you pretty much just have to call setup on that serv...
Just starred aoc_2021 [1] by borgmanJeremy [2]. It’s an exciting project with a lot to offer.
No description available.
References:
[1]: https://github.com/borgmanJeremy/aoc_2021
[2]: https://github.com/borgmanJeremy
Just starred aoc-2021 [1] by pypeaday [2]. It’s an exciting project with a lot to offer.
Advent of Code 2021 repo
References:
[1]: https://github.com/pypeaday/aoc-2021
[2]: https://github.com/pypeaday
Open files FAST from zsh | or bash if thats your thing
https://youtu.be/PQw_is7rQSw
I am often in a set of tmux splits flying back and forth, accidentally close my
editor, so when I come back to that split and hit my keybinds to edit files I
enter them into zsh rather than into nvim like I intended. Today I am going to
sand off that rough edge and get as similar behavior to nvim as I can with a
couple of aliases.
Make sure you check out the YouTube video to see all of my improvements.
what’s an alias # [1]
If you have never heard of an alias before it’s essentially a shortcut to a
given command. You can pass additional flags to the underlying command and
they will get passed in. Most of the time they are just shorter versions of
commands that you run often or even like in this case a common muscle memory
typo that occurs for you.
My new alias’s for fuzzy editing files from zsh # [2]
Here are the new aliases that I came up with to smooth out my workflow. These
give me a similar feel to how these keys work in neovim but from zsh.
#...
How linux users install a text editor
In honor of the neovim 0.6.0 release, I decided to do a funny skit installing
neovim, and fix up my install script in the process as part of my challenge to
fix up my dotfiles. I ran into one snag where I was not updating the repo that
I cloned. I moved it to the directory I now keep third-party git [1] repos and set
it to update with ansible.
https://youtu.be/64oKLphhBuo
The thing that took me the longest to realize was…. I had a path issue
pointing me to an old install of the appimage over the fresh build, fixed that
up and now we are on 0.7.0 nightly.
Related Links # [2]
https://neovim.io/
https://github.com/neovim/neovim
https://github.com/neovim/neovim/releases/tag/v0.6.0
References:
[1]: /glossary/git/
[2]: #related-links
The work on neovim [1] by neovim [2].
Vim-fork focused on extensibility and usability
References:
[1]: https://github.com/neovim/neovim
[2]: https://github.com/neovim
lewis6991 [1] has done a fantastic job with gitsigns.nvim [2]. Highly recommend taking a look.
Git [3] integration for buffers
References:
[1]: https://github.com/lewis6991
[2]: https://github.com/lewis6991/gitsigns.nvim
[3]: /glossary/git/
30 days dotfile ricing
https://youtu.be/Jq1Y48F_rOU
I am challenging myself to 30 days of dotfile ricing. I have been on linux
desktop for a few months now and have a pretty good workflow going, I have the
coarse edits done to my workflow, but it has some rough edges that need sanded
down. It’s time to squash some of those little annoyances that still exist in
my setup.
This is primarily going to be focused on productivity, but may have a few
things to just look better. This will comprise heavily of aliases, zsh, and
nvim config.
Follow the YouTube channel [1] or the rss
feed [2] to stay up to date.
References:
[1]: https://youtube.com/waylonwalker
[2]: https://waylonwalker/rss/
JUT | Read Notebooks in the Terminal
Trying to read a .ipynb file without starting a jupyter server? jut has you
covered.
https://youtu.be/t8AvImnwor0
watch the video version of this post on YouTube [1]
install # [2]
jut is packaged and available on pypi so installing is as easy as pip installing it.
pip install jut
[3]
! This is my first time including snippets of the video in the article like this, let me know what you think!
examples # [4]
jut https://cantera.org/examples/jupyter/thermo/flame_temperature.ipynb
jut https://cantera.org/examples/jupyter/thermo/flame_temperature.ipynb --head 3
jut https://cantera.org/examples/jupyter/thermo/flame_temperature.ipynb --tail 2
[5]
what are all the commands available for jut? # [6]
Take a look at the help of the jut cli to explore all the options that it
offers.
jut --help
There is some good information on the projects
readme [7] as well.
[8]
without installing # [9]
using pipx
Don’t want jut cluttering up your venv, or want to save yourself from making a
...
Waylon Walker
Hi, Hello, I’m Waylon # [1]
Husband, dad of two, and hobbyist builder of things on the internet.
When I’m not wrangling data pipeline platforms or building web platforms,
you’ll find me gaming [2] with my kids, making art, or skating
around the neighborhood. Reliving my mechanical engineering days with my 3d
printer. Winding down at the end of the day binge-watching Big Bang Theory
with my wife.
What I Do # [3]
I’m a Senior Software Engineer who specializes in data pipelines and
Python-based web platforms. I help teams turn messy data into reliable systems
that actually work.
Why I Built This Site # [4]
from scratch
I got tired of:
- Build times that took forever
- Node modules folders that became black holes
- Bloated pages that took ages to load
- SEO tools that felt like an afterthought
So I built my own platform from scratch using pluggy and diskcache.
It’s under-funded, over-dreamed, barely documented, and I love it. This site is
my sandbox for learning, teaching, a...
Looking for inspiration? dotfiles [1] by thoughtbot [2].
A set of vim, zsh, git [3], and tmux configuration files.
References:
[1]: https://github.com/thoughtbot/dotfiles
[2]: https://github.com/thoughtbot
[3]: /glossary/git/
kedro catalog create
I use kedro catalog create to boost my productivity by automatically
generating yaml catalog entries for me. It will create new yaml files for each
pipeline, fill in missiing catalog entries, and respect already existing
catalog entries. It will reformat the file, and sort it based on catalog key.
https://youtu.be/_22ELT4kja4
What is Kedro [1]
👆 Unsure what kedro is? Check out this post.
Running Kedro Catalog Create # [2]
The command to ensure there are catalog entries for every dataset in the passed
in pipeline.
kedro catalog create --pipeline history_nodes
- Create’s new yaml file, if needed
- Fills in new dataset entries with the default dataset
- Keeps existing datasets untouched
- it will reformat your yaml file a bit
- default sorting will be applied
- empty newlines will be removed
CONF_ROOT # [3]
Kedro will respect your CONF_ROOT settings when it creates a new catalog
file, or looks for existing catalog files. You can change the location of your
configuration f...
telescope-media-files.nvim [1] by nvim-telescope [2] is a game-changer in its space. Excited to see how it evolves.
Telescope extension to preview media files using Ueberzug.
References:
[1]: https://github.com/nvim-telescope/telescope-media-files.nvim
[2]: https://github.com/nvim-telescope
sqlfluff [1] by sqlfluff [2] is a game-changer in its space. Excited to see how it evolves.
A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
References:
[1]: https://github.com/sqlfluff/sqlfluff
[2]: https://github.com/sqlfluff
cmp-copilot [1] by hrsh7th [2] is a game-changer in its space. Excited to see how it evolves.
copilot.vim source for nvim-cmp
References:
[1]: https://github.com/hrsh7th/cmp-copilot
[2]: https://github.com/hrsh7th
Looking for inspiration? pypandoc [1] by JessicaTegner [2].
Thin wrapper for “pandoc” (MIT)
References:
[1]: https://github.com/JessicaTegner/pypandoc
[2]: https://github.com/JessicaTegner
I’m impressed by kedro-wdbc-tf [1] from abhinavsp0730 [2].
No description available.
References:
[1]: https://github.com/abhinavsp0730/kedro-wdbc-tf
[2]: https://github.com/abhinavsp0730
Check out chipsenkbeil [1] and their project distant.nvim [2].
🚧 (Alpha stage software) Edit files, run programs, and work with LSP on a remote machine from the comfort of your local environment 🚧
References:
[1]: https://github.com/chipsenkbeil
[2]: https://github.com/chipsenkbeil/distant.nvim
nvim conf 2021 | IDE's are slow | Waylon Walker
https://youtu.be/E18m4KkJUnI
---
Slides 👇 # [1]
welcome # [2]
Other possible titles # [3]
- Using Vim as a Team Lead
- I 💜 Tmux
- Why I stopped using @code
- Get there fast
- How I vim
It’s ok # [4]
Use a graphical IDE if it works for you.
Trick it out # [5]
vim is so well integrated into the terminal, take advantage
It wasn’t working for me anymore # [6]
dozens of instances # [7]
As a team lead I bounce betweeen a dozen projects a per day
https://pbs.twimg.com/media/FAEmRjYUcAUk2eR?format=jpg&name=large [8]
Move With Intent # [9]
Running vim inside tmux lets me move swiftly between the exact project I need.
https://twitter.com/_WaylonWalker/status/1438849269407047686/photo/1// [10]: <> (__)
Hub and Spoke # [11]
- direct link to specific projects
- fuzzy into all projects
- fuzzy into open projects
How I navigate tmux in 2021 [12]#hub-and-spoke
Other Things That Make this Possible # [13]
- tmux
- direnv
vim adjacent things
yes, vim is ugly, make it your...
tesseract [1] by tesseract-ocr [2] is a game-changer in its space. Excited to see how it evolves.
Tesseract Open Source OCR Engine (main repository)
References:
[1]: https://github.com/tesseract-ocr/tesseract
[2]: https://github.com/tesseract-ocr
The work on sqlite.lua [1] by kkharji [2].
SQLite LuaJIT binding with a very simple api.
References:
[1]: https://github.com/kkharji/sqlite.lua
[2]: https://github.com/kkharji
I’m impressed by telescope-frecency.nvim [1] from nvim-telescope [2].
A telescope.nvim extension that offers intelligent prioritization when selecting files from your editing history.
References:
[1]: https://github.com/nvim-telescope/telescope-frecency.nvim
[2]: https://github.com/nvim-telescope
Check out flick-it [1] by cmgriffing [2]. It’s a well-crafted project with great potential.
An OBS overlay game similar to the !drop game.
References:
[1]: https://github.com/cmgriffing/flick-it
[2]: https://github.com/cmgriffing
Check out diffurcate.vim [1] by AndrewRadev [2]. It’s a well-crafted project with great potential.
Split a git [3] diff into separate files
References:
[1]: https://github.com/AndrewRadev/diffurcate.vim
[2]: https://github.com/AndrewRadev
[3]: /glossary/git/
codelucas [1] has done a fantastic job with newspaper [2]. Highly recommend taking a look.
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
References:
[1]: https://github.com/codelucas
[2]: https://github.com/codelucas/newspaper
I recently discovered delta-rs [1] by delta-io [2], and it’s truly impressive.
A native Rust library for Delta Lake, with bindings into Python
References:
[1]: https://github.com/delta-io/delta-rs
[2]: https://github.com/delta-io
I recently discovered cmp-skkeleton [1] by rinx [2], and it’s truly impressive.
skkeleton source for nvim-cmp
References:
[1]: https://github.com/rinx/cmp-skkeleton
[2]: https://github.com/rinx
The work on coveragepy [1] by nedbat [2].
The code coverage tool for Python
References:
[1]: https://github.com/nedbat/coveragepy
[2]: https://github.com/nedbat
I like coveragepy’s [1] project coveragepy [2].
The code coverage tool for Python
References:
[1]: https://github.com/coveragepy
[2]: https://github.com/coveragepy/coveragepy
I like pytest-dev’s [1] project pytest-cov [2].
Coverage plugin for pytest.
References:
[1]: https://github.com/pytest-dev
[2]: https://github.com/pytest-dev/pytest-cov
Just Ask Ipython for help
It happens to the best of us # [1]
We can’t all remember every single function signature out there, it’s just not
possible. If you want to stay productive while coding without the temptation
to hit YouTube or Twitter. Use the built in help. Here are 5 ways to get help
without leaving your terminal.
https://youtu.be/TZrRAP-9UMk
Docstrings # [2]
In any python repl you can access the docstring of a function by calling for help.
help(df.rolling)
In Ipython we can even get some syntax highlighting with the ?.
df.rolling?
Source Code # [3]
Sometimes the docstrings are not good enough, and don’t give us the content we
need, and we just need to look at the source. Without leaving your terminal
there are two ways I often use to get to the source of a function I am trying
to use.
import inspect
inspect.getsource(df.rolling)
The more common way I do it is with the ipython ??.
df.rolling??
Bonus rich.inspect # [4]
You thought the syntax highlighting was good with ipython, check out w...
Hacktoberfest 2021?
Are you participating in Hacktoberfest 2021?
I got my start with open source with Hacktoberfest 2018. I remember being so
nervous for those first pr’s. I have continued to participate every year, and
it feels good to give back.
It made a big change on me # [1]
Something that it really did for me was to lower the hurdle to contribute
regularly. I am not a huge contributor to open source. I am not necessarily a
regular maintainer of any large project, but I do often raise issues when I see
things as a user that would make things easier or more clear.
After participating it does not feel like such a big deal to go through the
motions of making my own fork, making a small change, and submitting it for
review.
What can you do? # [2]
As a user, you might be in a unique position to see a library from the
perspective of other users rather than from the eyes of a maintainer. You can
help bring the user perspective to your favorite library.
https://twitter.com/_WaylonWalker/status/1446...
I made a neovim plugin
I’ve slowly adding more and more lua functions into my neovim configuration,
and recently I noticed a pattern for a class of functions that reach out to run
shell commands that can be abstracted away.
https://youtu.be/8m5ipBuopPU
Telegraph.nvim # [1]
Check out the project readme [2]
for the most up to date details on the plugin itself.
Motivation # [3]
I want a simple way to make remaps into shell commands that can open new tmux
windows, popups, or just run a command with context from the editor.
For example I want to make remaps to do things like open the current file in lookatme.
# vim :terminal
nnoremap <leader>s <cmd>Telegraph pipx run lookatme {filepath} --live-reload --style gruvbox-dark<cmd>
# tmux session
nnoremap <leader><leader>s <cmd>lua require'telegraph'.telegraph({cmd='pipx run lookatme {filepath} --live-reload --style gruvbox-dark', how='tmux'})<CR>
# tmux popup
nnoremap <leader><leader>S <cmd>lua require'telegraph'.telegraph({cmd='pipx run lookatme {filepath...
The work on ansible [1] by ThePrimeagen [2].
No description available.
References:
[1]: https://github.com/ThePrimeagen/ansible
[2]: https://github.com/ThePrimeagen
Setting Parameters in kedro
Parameters are a place for you to store variables for your pipeline that can be
accessed by any node that needs it, and can be easily changed by changing your
environment. Parameters are stored in the repository in yaml files.
https://youtu.be/Jj5cQ5bqcjg
What is Kedro [1]
👆 Unsure what kedro is? Check out this post.
parameters files # [2]
You can have multiple parameters files and choose which ones to load by setting
your environment. By default kedro will give you a base and local
parameters file.
- conf/base/parameters.yml
- conf/local/parameters.yml
base # [3]
The base environment should contain all of the default values you want to run.
# /conf/base/parameters.yml
test_size: 0.2
random_state: 3
features:
- engines
- passenger_capacity
- crew
- d_check_complete
- moon_clearance_complete
- iata_approved
- company_rating
- review_scores_rating
NOTE base will always be loaded first.
accessing parameters # [4]
Parameters can be accessed through context or throug...
Writing your first kedro Nodes
https://youtu.be/-gEwU-MrPuA
Before we jump in with anything crazy, let’s make some nodes with some vanilla
data structures.
import node # [1]
You will need to import node from kedro.pipeline to start creating nodes.
from kedro.pipeline import node
func # [2]
The func is a callable that will take the inputs and create the outputs.
inputs / outputs # [3]
Inputs and outputs can be None, a single catalog entry as a string, mutiple
catalog entries as a List of strings, or a dictionary of strings where the key
is the keyword argument of the func and the value is the catalog entry to use
for that keyword.
our first node # [4]
Sometimes in our pipelines our data is coming from an api where we already have
python functions built to pull with. Thats ok, kedro supposrts that with
inputs=None.
def create_range():
return range(100)
make_range = node(
func=create_range,
inputs=None,
outputs='range'
)
second node # [5]
Now we have some data to work from, lets use that as our inpu...
I’m impressed by Telegraph.nvim [1] from WaylonWalker [2].
Send commands system commands in an elegant way
References:
[1]: https://github.com/WaylonWalker/Telegraph.nvim
[2]: https://github.com/WaylonWalker
I came across nvim-example-lua-plugin [1] from jacobsimpson [2], and it’s packed with great features and ideas.
A simple Neovim Lua plugin using the Lua embedded in Neovim, suitable as a template.
References:
[1]: https://github.com/jacobsimpson/nvim-example-lua-plugin
[2]: https://github.com/jacobsimpson
I’m impressed by skimpy [1] from aeturrell [2].
skimpy is a light weight tool that provides summary statistics about variables in data frames within the console.
References:
[1]: https://github.com/aeturrell/skimpy
[2]: https://github.com/aeturrell