Archive

All published posts

2586 posts latest post 2026-10-03
Publishing rhythm
Sep 2026 | 27 posts

Open files FAST from zsh | or bash if thats your thing

https://youtu.be/PQw_is7rQSw I am often in a set of tmux splits flying back and forth, accidentally close my editor, so when I come back to that split and hit my keybinds to edit files I enter them into zsh rather than into nvim like I intended. Today I am going to sand off that rough edge and get as similar behavior to nvim as I can with a couple of aliases. Make sure you check out the YouTube video to see all of my improvements. what’s an alias # If you have never heard of an alias before it’s essentially a shortcut to a given command. You can pass additional flags to the underlying command and they will get passed in. Most of the time they are just shorter versions of commands that you run often or even like in this case a common muscle memory typo that occurs for you. My new alias’s for fuzzy editing files from zsh # Here are the new aliases that I came up with to smooth out my workflow. These give me a similar feel to how these keys work in neovim but from zsh. Follow the YouTube…

How linux users install a text editor

In honor of the neovim 0.6.0 release, I decided to do a funny skit installing neovim, and fix up my install script in the process as part of my challenge to fix up my dotfiles. I ran into one snag where I was not updating the repo that I cloned. I moved it to the directory I now keep third-party git repos and set it to update with ansible. https://youtu.be/64oKLphhBuo The thing that took me the longest to realize was…. I had a path issue pointing me to an old install of the appimage over the fresh build, fixed that up and now we are on 0.7.0 nightly. Related Links # https://neovim.io/ https://github.com/neovim/neovim https://github.com/neovim/neovim/releases/tag/v0.6.0

30 days dotfile ricing

https://youtu.be/Jq1Y48F_rOU I am challenging myself to 30 days of dotfile ricing. I have been on linux desktop for a few months now and have a pretty good workflow going, I have the coarse edits done to my workflow, but it has some rough edges that need sanded down. It’s time to squash some of those little annoyances that still exist in my setup. This is primarily going to be focused on productivity, but may have a few things to just look better. This will comprise heavily of aliases, zsh, and nvim config. Follow the YouTube channel or the rss feed to stay up to date.

JUT | Read Notebooks in the Terminal

Trying to read a.ipynb file without starting a jupyter server? jut has you covered. https://youtu.be/t8AvImnwor0 watch the video version of this post on YouTube install # is packaged and available on pypi so installing is as easy as pip installing it. examples # what are all the commands available for jut? # Take a look at the help of the cli to explore all the options that it offers. There is some good information on the projects readme as well. without installing # using pipx Don’t want jut cluttering up your venv, or want to save yourself from making a new one, can manage a separate virual environment for you. This is one of the biggest selling points for me. nbconvert # is the lightweight option that I think will fit the bill often for me, but it just doesn’t always cut it. Mostly if there are images in the notebook or large output that is hard to read, its time to pull out the medium guns that sit between fulling running jupyter and. nbconvert does not have its own cli, instead it…

Waylon Walker

Hi, Hello, I’m Waylon # Husband, dad of two, and hobbyist builder of things on the internet. When I’m not wrangling data pipeline platforms or building web platforms, you’ll find me gaming with my kids, making art, or skating around the neighborhood. Reliving my mechanical engineering days with my 3d printer. Winding down at the end of the day binge-watching Big Bang Theory with my wife. What I Do # I’m a Senior Software Engineer who specializes in data pipelines and Python-based web platforms. I help teams turn messy data into reliable systems that actually work. Why I Built This Site # from scratch I got tired of: Build times that took forever Node modules folders that became black holes Bloated pages that took ages to load SEO tools that felt like an afterthought So I built my own platform from scratch using pluggy and diskcache. It’s under-funded, over-dreamed, barely documented, and I love it. This site is my sandbox for learning, teaching, and sharing ideas on my own terms. Infra…

kedro catalog create

I use to boost my productivity by automatically generating yaml catalog entries for me. It will create new yaml files for each pipeline, fill in missiing catalog entries, and respect already existing catalog entries. It will reformat the file, and sort it based on catalog key. https://youtu.be/_22ELT4kja4 What is Kedro 👆 Unsure what kedro is? Check out this post. Running Kedro Catalog Create # The command to ensure there are catalog entries for every dataset in the passed in pipeline. Create’s new yaml file, if needed Fills in new dataset entries with the default dataset Keeps existing datasets untouched it will reformat your yaml file a bit default sorting will be applied empty newlines will be removed CONF_ROOT # Kedro will respect your settings when it creates a new catalog file, or looks for existing catalog files. You can change the location of your configuration files by editing your variable in your projects.. I prefer to keep my configuration packaged inside of my project. This…
⭐ sqlfluff sqlfluff
sqlfluff by sqlfluff is a game-changer in its space. Excited to see how it evolves. A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
⭐ chipsenkbeil distant.nvim
Check out chipsenkbeil and their project distant.nvim. 🚧 (Alpha stage software) Edit files, run programs, and work with LSP on a remote machine from the comfort of your local environment 🚧

nvim conf 2021 | IDE’s are slow | Waylon Walker

https://youtu.be/E18m4KkJUnI Slides 👇 # welcome # Other possible titles # Using Vim as a Team Lead I 💜 Tmux Why I stopped using @code Get there fast How I vim It’s ok # Use a graphical IDE if it works for you. Trick it out # vim is so well integrated into the terminal, take advantage It wasn’t working for me anymore # dozens of instances # As a team lead I bounce betweeen a dozen projects a per day https://pbs.twimg.com/media/FAEmRjYUcAUk2eR?format=jpg&name=large Move With Intent # Running vim inside tmux lets me move swiftly between the exact project I need. https://twitter.com/_WaylonWalker/status/1438849269407047686/photo/1 //: <> (__) Hub and Spoke # direct link to specific projects fuzzy into all projects fuzzy into open projects How I navigate tmux in 2021 #hub-and-spoke Other Things That Make this Possible # tmux direnv vim adjacent things yes, vim is ugly, make it yours # @rook @_waylonwalker lsp # treesitter # telescope # fuzzy matching like a boss fzf is ok too Check Messages…
⭐ tesseract-ocr tesseract
tesseract by tesseract-ocr is a game-changer in its space. Excited to see how it evolves. Tesseract Open Source OCR Engine (main repository)
⭐ cmgriffing flick-it
Check out flick-it by cmgriffing. It’s a well-crafted project with great potential. An OBS overlay game similar to the!drop game.
⭐ codelucas newspaper
codelucas has done a fantastic job with newspaper. Highly recommend taking a look. newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
⭐ delta-io delta-rs
I recently discovered delta-rs by delta-io, and it’s truly impressive. A native Rust library for Delta Lake, with bindings into Python

Just Ask Ipython for help

It happens to the best of us # We can’t all remember every single function signature out there, it’s just not possible. If you want to stay productive while coding without the temptation to hit YouTube or Twitter. Use the built in help. Here are 5 ways to get help without leaving your terminal. https://youtu.be/TZrRAP-9UMk Docstrings # In any python repl you can access the docstring of a function by calling for. In Ipython we can even get some syntax highlighting with the. Source Code # Sometimes the docstrings are not good enough, and don’t give us the content we need, and we just need to look at the source. Without leaving your terminal there are two ways I often use to get to the source of a function I am trying to use. The more common way I do it is with the ipython. Bonus rich.inspect # You thought the syntax highlighting was good with ipython, check out what can do! As far as I know there is no way to get to source code, but the results are still fantastic. Install rich then insp…
2 min read
python

Hacktoberfest 2021?

Are you participating in Hacktoberfest 2021? I got my start with open source with Hacktoberfest 2018. I remember being so nervous for those first pr’s. I have continued to participate every year, and it feels good to give back. It made a big change on me # Something that it really did for me was to lower the hurdle to contribute regularly. I am not a huge contributor to open source. I am not necessarily a regular maintainer of any large project, but I do often raise issues when I see things as a user that would make things easier or more clear. After participating it does not feel like such a big deal to go through the motions of making my own fork, making a small change, and submitting it for review. What can you do? # As a user, you might be in a unique position to see a library from the perspective of other users rather than from the eyes of a maintainer. You can help bring the user perspective to your favorite library. https://twitter.com/_WaylonWalker/status/1446440878864846909 My…

I made a neovim plugin

I’ve slowly adding more and more lua functions into my neovim configuration, and recently I noticed a pattern for a class of functions that reach out to run shell commands that can be abstracted away. https://youtu.be/8m5ipBuopPU Telegraph.nvim # Check out the project readme for the most up to date details on the plugin itself. Motivation # I want a simple way to make remaps into shell commands that can open new tmux windows, popups, or just run a command with context from the editor. For example I want to make remaps to do things like open the current file in lookatme. The main goal here is that remaps become one liners that can just be put directly in my without creating a whole new lua module for each shell command I want to bind. how # takes in a argument to determine where to tun the command.j (default) runs command in the built in terminal runs command in a new tmux session and joins it. runs command in a tmux popup window. runs command in a tmux session and displays it in a popu…

Setting Parameters in kedro

Parameters are a place for you to store variables for your pipeline that can be accessed by any node that needs it, and can be easily changed by changing your environment. Parameters are stored in the repository in yaml files. https://youtu.be/Jj5cQ5bqcjg What is Kedro 👆 Unsure what kedro is? Check out this post. parameters files # You can have multiple parameters files and choose which ones to load by setting your environment. By default kedro will give you a and parameters file. base # The base environment should contain all of the default values you want to run. NOTE base will always be loaded first. accessing parameters # Parameters can be accessed through context or through the catalog. Generally when you are working with nodes it will be loaded through the catalog. Loding with the context. Loading with the catalog. Loading a specific key with the catalog. using parameters in nodes # Here is an example from the complete spaceflights demo. The entire parameters dict is passed in, t…

Writing your first kedro Nodes

https://youtu.be/-gEwU-MrPuA Before we jump in with anything crazy, let’s make some nodes with some vanilla data structures. import node # You will need to import node from kedro.pipeline to start creating nodes. func # The is a callable that will take the and create the. inputs / outputs # Inputs and outputs can be None, a single catalog entry as a string, mutiple catalog entries as a List of strings, or a dictionary of strings where the key is the keyword argument of the func and the value is the catalog entry to use for that keyword. our first node # Sometimes in our pipelines our data is coming from an api where we already have python functions built to pull with. Thats ok, kedro supposrts that with. second node # Now we have some data to work from, lets use that as our input. Multiple Inputs # Kedro can take lists or dicts as either input or output when your function needs more than one input or output. Links # all of my kedro articles kedro playlist on YouTube node docs first_nod…
⭐ aeturrell skimpy
I’m impressed by skimpy from aeturrell. skimpy is a light weight tool that provides summary statistics about variables in data frames within the console.
⭐ dstein64 vim-startuptime
I’m really excited about vim-startuptime, an amazing project by dstein64. It’s worth exploring! A plugin for viewing Vim and Neovim startup event timing information.
⭐ wbthomason packer.nvim
I like wbthomason’s project packer.nvim. A use-package inspired plugin manager for Neovim. Uses native packages, supports Luarocks dependencies, written in Lua, allows for expressive config
⭐ andymass vim-matchup
Looking for inspiration? vim-matchup by andymass. vim match-up: even better % 👊 navigate and highlight matching words 👊 modern matchit and matchparen. Supports both vim and neovim + tree-sitter.

Running your Kedro Pipeline from the command line

Running your kedro pipeline from the command line could not be any easier to get started. This is a concept that you may or may not do often depending on your workflow, but its good to have under your belt. I personally do this half the time and run from ipython half the time. In production, I mostly use docker and that is all done with this cli. https://youtu.be/ZmccpLy-OEI What is Kedro 👆 Unsure what kedro is? Check out this post. Kedro run # To run the whole darn project all we need to do is fire up a terminal, activate our environment, and tell kedro to run. Specific Pipelines # Running a sub pipeline that we have created is as easy as telling kedro which one we want to run. Single Nodes # While developing a node or a small list of nodes in a larger pipeline its handy to be able to run them one at a time. Besides the use case of developing a single node I would not reccomend leaning very heavy on running single nodes, let the DAG do the work of figuring out which nodes to run for y…

kedro Virtual Environment

Avoid serious version conflict issues, and use a virtual environment anytime you are running python, here are three ways you can setup a kedro virtual environment. https://youtu.be/ZSxc5VVCBhM conda venv pipenv conda # I prefer to use conda as my virtual environment manager of choice as it give me both the interpreter and the packages I install. I don’t have to rely on the system version of python or another tool to maintain python versions at all, I get everything in one tool. stores environment in a root directory i.e. conda can use its own way to manage environments the python interpreter is packaged with the environment virtualenv # Virtual env (venv) is another very respectable option that is built right into python, and requires no additional installs or using a different distribution of pytyhon. environments are typically stored in the project directory does not package the interpreter pipenv # Pipenv is another virtual enviroment tool that comes with its own system for managing…

Kedro Install

Kedro comes with an command to install and manage all of your projects dependencies. https://youtu.be/IWimEs-hHQg cd into your project directory and activate env # You must start by having your kedro project either cloned down from an existing project or created from kedro new. Then activate your environment. Kedro New this post covers kedro new kedro Virtual Environment This post covers creating your virtual environment for kedro install kedro # Make sure you have kedro installed in your current environment, if you dont already have it. pip-tools # Kedro uses the package under the hood to pin dependencies in a very robust way to ensure that the project will continue to work on everyone’s machine day, including production, day in and day out. No matter what happens to the dependencies you have installed. pip-compile # The command that kedro uses from is. It will look at what you have in a file, compile the dependencies down to exact versions, and create a requirements.txt that is fully…

Kedro Git Init

Immediately after, before you start running or your first line of code the first thing you should always do after getting a new kedro template created is to. https://youtu.be/IGba3ytf_6U git init # Its as simple as these three commands to get started. I don’t care if this project is for learning, if it will never have a remote or not, use git.