Archive

All published posts

2605 posts latest post 2026-10-24
Publishing rhythm
Sep 2026 | 28 posts

Nov 23 – Nov 29, 20205 years ago

Featured this weekWriting

Adding Audio to my blog posts

This is episode 1 of the Waylon Walker Audio experience, posts from waylonwalker.com {.hoverlink} in audio form. So I have had this idea for awhile to add audio to my blog posts. The idea partly comes from the aws blog, if you have ever been on their blog you will have noticed that they have a voiced by amazon polly se…

Link

I’m really excited about auto-editor, an amazing project by WyattBlue. It’s worth exploring! Auto-Editor: Efficient media analysis and rendering

Link

Nov 16 – Nov 22, 20205 years ago

Featured this weekWriting

gatsby-remark-embedder

Inspired by discourse’s link expansion I am rolling out expansions for one line links on the blog waylonwalker. I was able to find a gatsby plugin gatsby-remark-embedder that expands one line links for social cards for popular platforms like twitter and YouTube through a repose from Kyle Mathews to my tweet. https://tw…

Writing

Expand One Line Links

I wanted a super simple way to cross-link blog posts that require as little effort as possible, yet still looks good in vanilla markdown in GitHub. I have been using a snippet that puts HTML into the markdown. While this works, it’s more manual/difficult for me does not look the best, and does not read well as Goals fo…

Link

Link

astronomer has done a fantastic job with dag-factory. Highly recommend taking a look. Dynamically generate Apache Airflow DAGs from YAML configuration files

Nov 9 – Nov 15, 20205 years ago

Featured this weekLink

orchest by orchest is a game-changer in its space. Excited to see how it evolves. Build data pipelines, the easy way 🛠️

Nov 2 – Nov 8, 20205 years ago

Featured this weekLink

Link

mingrammer has done a fantastic job with diagrams. Highly recommend taking a look. 🎨 Diagram as Code for prototyping cloud system architectures

Link

Oct 26 – Nov 1, 20206 years ago

Featured this weekWriting

reasons-to-kedro

There are many reasons that you should be using kedro. If you are on a team of Data Scientists/Data Engineers processing DataFrames from many data sources should be considering a pipeline framework. Kedro is a great option that provides many benefits for teams to collaborate, develop, and deploy data pipelines What is…

Link

Just starred Second-Brain by KasperZutterman. It’s an exciting project with a lot to offer. A curated list of awesome Public Zettelkastens 🗄️ / Second Brains 🧠 / Digital Gardens 🌱

Link

Just starred Repo-Roster by nastyox. It’s an exciting project with a lot to offer. Shout-out supporters in your GitHub README file.

Oct 19 – Oct 25, 20206 years ago

Featured this weekWriting

What’s New in Kedro 0.16.6

Kedro 0.16.6 is out! Let’s take a look through the release notes Deployment Docs This is really exciting to see more deployment options coming from the kedro team. It really shows the power of the framework. The power of some of these orchestrations options is incredible. Argo Prefect Kubeflow Batch SageMaker Most of t…

Writing

A brain dump of stories

I started making stories as kind of a brain dump a few times per day and posting them to [LinkedIn]( https://www.linkedin.com/in/waylonwalker/(https://www.linkedin.com/in/waylonwalker/). Here are the last 11 days of stories. I store all the stories on my website with the hopes of doing something with them on my own pla…

Link

mkdocs by mkdocs is a game-changer in its space. Excited to see how it evolves. Project documentation with Markdown.

Link

Check out mmchougule and their project kedro-grpc-server. Kedro gRPC Server is a Kedro plugin that creates a gRPC server for triggering and monitoring pipeline runs using a general-purpose RPC framework gRPC

Link

Link

The work on flynt by ikamensh. A tool to automatically convert old string literal formatting to f-strings

Oct 12 – Oct 18, 20206 years ago

Featured this weekWriting

Fix git commit author

I was 20 commits into a hackoberfest PR when I suddenly realized they they all had my work email on them instead of my personal email 😱. This is the story of how I corrected my email address on 19 individual commits after already submitting for a PR. Change the email for this repo Prepare for rebasing start the rebase…
3 min read

Link

charmbracelet has done a fantastic job with glow. Highly recommend taking a look. Render markdown on the CLI, with pizzazz! 💅🏻

Link

Check out mytechnotalent and their project Python-For-Kids. A FREE comprehensive online Python development tutorial FOR KIDS utilizing an official BBC micro:bit Development Board going step-by-step into the world of Python for microcontrollers.

Link

Oct 5 – Oct 11, 20206 years ago

Featured this weekWriting

Designing a “Router” for kedro

nodes_global I released a router-like plugin for kedro back in April 2020. This was not the first design, the idea actually came from one of the QB folks who taught me kedro nearly a year before. We were assembling our pipelines with something called. It worked fairly well but did have some issues around being set as a…
4 min read

Link

Sep 28 – Oct 4, 20206 years ago

Featured this weekWriting

Reclaim memory usage in Jupyter

Today I ran into an issue where we had a one-off script that just needed to work, but it was just chewing threw memory like nothing. It started with a colleague asking me How do I clear the memory in a Jupyter notebook, these are the steps we took to debug the issue and free up some memory in their notebook. How do I c…
3 min read

Writing

Strip Trailing Whitespace from Git projects

A common linting error thrown by various linters is for trailing whitespace. I most often use flake8. I generally have [pre-commit]( https://waylonwalker.com/pre-commit-is-awesome hooks setup to strip this, but sometimes I run into situations where I jump into a project without it, and my editor lights up with errors.…

Link

Link

github has done a fantastic job with renaming. Highly recommend taking a look. Guidance for changing the default branch name for GitHub repositories

Link

tpope has done a fantastic job with vim-sleuth. Highly recommend taking a look. sleuth.vim: Heuristically set buffer options

Link

actions has done a fantastic job with setup-python. Highly recommend taking a look. Set up your GitHub Actions workflow with a specific version of Python

Link

Link

checkout by actions is a game-changer in its space. Excited to see how it evolves. Action for checking out a repo

Sep 21 – Sep 27, 20206 years ago

Featured this weekLink

Sep 14 – Sep 20, 20206 years ago

Featured this weekLink

Just starred zk by sirupsen. It’s an exciting project with a lot to offer. Zettelkasten on the command-line 📚 🔍

Link

Link

deepyaman has done a fantastic job with kedro-accelerator. Highly recommend taking a look. Kedro-Accelerator speeds up pipelines by parallelizing I/O in the background.

Sep 7 – Sep 13, 20206 years ago

Featured this weekWriting

Chrome Extensions I use

There are many useful chrome extensions out there. I probably have way too many installed, here are four that I am currently using. This post was inspired from Chris over at daily-dev-tips LastPass Stylus Vimium hypothesis LastPass Love it or hate it passwords are hard to manage. Everyone needs a password manager to av…
2 min read

Aug 31 – Sep 6, 20206 years ago

Featured this weekLink

Link

Link

Aug 10 – Aug 16, 20206 years ago

Featured this weekWriting

Creating Reusable Bash Scripts

Bash is a language that is quite useful for automation no matter what language you write in. Bash can do so many powerful system-level tasks. Even if you are on windows these days you are likely to come across bash inside a cloud VM, Continuous Integration, or even inside of docker. I have three techniques that help me…

Writing

Three things to Automate with Python using Pandas

Here are three things that I see my non programming counterparts doing every single day. These really sum up so much of what folks do within an office. So many of us dabble in or become power users of spreadsheets without knowing there is an alternative out there that can save us time, automate boring things, and allow…
4 min read

Writing

How to Install miniconda on linux (from the command line only)

miniconda is a python distribution from continuum. It’s a slimmed-down version of their very popular anaconda distribution. It comes with its own environment manager and has eased the install process for many that do not have a way to compile c-extensions. It made it much easier to install the data science stack on win…

Aug 3 – Aug 9, 20206 years ago

Featured this weekWriting

How to crush amazing posts on DEV

This post was inspired by a comment I left on @dsteenman’s post. {% post dsteenman/how-long-should-a-blogpost-be-2k6n %} Most of the time I prefer short as I am more likely to read the whole thing. If its setup as a series I am more likely to work my way through the whole series in a matter of a few sessions. Just my p…

Writing

Black Tech Pipeline

I was particularly inspired by @chantastic episode 103 of the react podcast with @ParissAthena. They spoke about the black tech pipeline as well as Diversity, Equity, and Inclusion. Pariss is quite an inspiration. She has done so much work to create a better place for POC in tech. I like that not only is she helping th…

Writing

Review of the git-auto-commit-action

It’s a really cool GitHub action that will automatically commit files changed during the action. I was using this to render a new readme based on a template. Check out the repo for git-auto-commit-action. It’s a really cool GitHub action that will automatically commit files changed during the action. I was using this t…

Link

I like RanaEmad’s project metrics-of-awesome-api. A Node.js API with the main purpose of acting as a backend for practicing authentication in React. It enables the user to sign up, sign in and view a dashboard with his metrics of awesome through different endpoints.

Link

Link

shreyashankar has done a fantastic job with gpt3-sandbox. Highly recommend taking a look. The goal of this project is to enable users to create cool web demos using the newly released OpenAI GPT-3 API with just a few lines of Python.