Archive

Kedro New

https://youtu.be/uqiv5LAiJe0 Kedro new is simply a wrapper around the cookiecutter templating library. The kedro team maintains a ready made template that has everything you need for a kedro project. They also maintain a few kedro starters, which are very similar to the base template. What is Kedro Unsure what kedro is, Check out yesterdays post on What is Kedro. pipx # I reccomend using when running kedro new. is designed for system level cli tools so that you do not need to maintain a virtual environment or worry about version conflicts, manages the environment for you. The kedro team does not reccomend in their docs as they already feel like there is a bit of a tool overload for folks that may be less familiar with I like using as it gives you better control over using a specific version or always the latest version, unlike when you run what you have on your system depends on when you last installed or upgraded. Kedro New # The kedro team also has a set of starters, by passing in yo…

⭐ AckslD nvim-neoclip.lua

Check out AckslD and their project nvim-neoclip.lua. Clipboard manager neovim plugin with telescope integration

What is Kedro

Kedro is an unopinionated Data Engineering framework that comes with a somewhat opinionated template. It gives the user a way to build pipelines that automatically take care of io through the use of abstract that the user specifies through entries. These entries are loaded, ran through a function, and saved by. The order that these are executed are determined by the, which is a DAG. It’s the ’s job to manage the execution of the. https://youtu.be/Wf4rnFsaFFU What is Kedro This is an updated version of my original what-is-kedro article Hot Take # If you are doing a series of operations to data with python, especially if you are using something as supported as pandas, you should be using a framework that gives you a pipeline as a DAG and abstracts io. Orchestrators # Like I said, is unopinionated it does determine where or how your data should be ran. The kedro team does support the following Orchestrators with very little add on to the base template. Argo Workflows Prefect Kubeflow Work…

How I Kedro

https://youtu.be/bw5_FWDVRpU Ubuntu # I recently switched over to using Ubuntu, it works well pretty much out of the box for me. I am using gnome with a dark theme. Gnome Terminal # I am still using the built in default gnome terminal, it just works. It does all the things that I need it to do. It supports transparency renders my fonts and allows me to highlight things well. One Dark Theme dotfiles # You can find my dotfiles on github. Feel free to read through and take anything that you find useful. I would encourage you not to steal them, but to integrate the parts that you want into your own dotfiles. dotfiles are a very personal thing. They are an extension of ones fingertips designed for how you think and type. zsh # I use zsh as my default shell. I like to use it as my interactive shell. It works, and does a bit better with things like tab completion out of the box. starship # I use the starship prompt for my shell. It works well out of the box. It looks good and includes all of…

tmux show-messages

https://youtu.be/LLk94fKpGg4 As we push the limits of tmux further and further you are bound to end up in a situation where you are mashing down a hotkey and it’s just not doing what you want it to do, and you have no idea why. is a tmux command that can be used to show what tmux is actually doing behind the scenes. This might highlight any hot key conflicts you might have in your. man page for show-messages # In case you wnat more information about show-messages, here is the man page. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux ta

https://youtu.be/nT0FA1RNZEs Now your creating, jumping, and killing sessions like a boss. You are slicing through projects with ease, let me show you one more thing that can be the cream on top of this silky smooth setup we have been working towards. Chris Toomey’s Tmux Course # This script is simply my fork of Chris Toomey’s script straight out of his course. It helps us create or jump to project specific sessions with ease. a directory of projects # My version of the script will let you pass it a directory, and it will give you a fuzzy popup. setting up a keybinding # default layout # By default I have my projects open with a vertical split, vim is on top, with my file finder open and the lower split is set to just my terminal. This is what I do 90% of the time that I open a project anyways. More projects # I also have a directory setup that is a symlink-gallery of all of my projects, both private and public. This makes it easy to have one key that lets me see all of my projects. ht…

tmux display-message

https://youtu.be/utfLA6L8o5s You’ve got some long running tasks, and you’re trying to stay productive and knock tasks off that board, but you keep finding that your processes finish and you stay on other tasks for longer than you should. You were in the flow and just did not check back in on it. With you can send yourself a notification when that long running task is complete. from the man page # Here is a snippet of from the tmux man page. I rarely need to do anything other than just display message, but there are other flags for it. notifier # With we can do things like setup notifications that will work cross platform. Without setting the target-pane defaults to the active pane. This is a very handy feature that allows us to switch windows, or sessions and still recieve the message. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

⭐ heathdbrown python_code_tips

If you’re into interesting projects, don’t miss out on python_code_tips, created by heathdbrown. No description available.

killing tmux

https://youtu.be/QWPyYx54JbE Now it’s time to switch gears, we are onto a different part of our day and there are just too many sessions running and we need to clean up shop. kill-server # One viable option is to nuke the whole dang thing. I actually do this more than you might think. save and commit your work diligently before kill-session # A more reasonable option might be to kill a single session. choose-tree # Killing sessions one by one from the command line can be a bit tedious, and involve more keystrokes than necessary. Another option built right into tmux is. By default is bound to, that’s pressing control+b then s. Once you are in, you can navigate around with your configured navigation scheme, press to kill a session, or pane or window then to confirm. You can also batch delete by tagging items with t, and killing them all at once with. tmux choose-tree check out this post for a bit more information on choose-tree fuzzy matcher # Here is my preferred way, using a fuzzy matc…

tmux has-session

https://youtu.be/XucVVgGmesM I see you there, trying to script out your tmux layouts. Tryig to get each project setup just perfect with a script, but you keep stumbling over yourself with error messages The tmux command is a handy tool to prevent this error message when scripting your tmux layouts. command line # The command is pretty straight forward, you simply ask tmux if the session name you are looking for exists. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

⭐ bigskysoftware htmx

I’m impressed by htmx from bigskysoftware. </> htmx - high power tools for HTML

tmux list-keys

https://youtu.be/Y1MYmL8ZolE Tmux list keys can be a useful tool to help remind you of what kebindings you have setup. You can search for them and scroll just like in tmux copy-mode. command line # You can call list-keys from the command line but the interface is not very usable by itself. It might be nice to mix with grep or a pager in some circumstances. tmux command line # Running from within the tmux command line puts you into a much more pleasant. default keybinging # By default tmux comes with bound to prefix+?. list-keys man page # You can see the additional flags provided by tmux in the man page for. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux status-bar

https://youtu.be/mvgM8UH11_U The tmux status bar can be a handy tool to remind yourself where you are within tmux. It can also include a bunch of system information like battery status, cpu, mem, whatever you can get from the command line. Honestly I like to keep it minimal, and actually keep it turned off most of the time. I find that it helps a little bit for others to follow along if I keep it on in certain circumstances. show the status bar # You can set a hotkey to show or hide the status bar. setting the background transparent # I really want a minimal status bar with very little bling, I want it to get out of the way an not draw too much attention, so step one is to set the background to transparent. setting default colors # I want my status bar to somewhat match the rest of my theme, so I set the default foreground as magenta and the default background as transparent. my status bar # Honestly I set this up quite awhile ago, and it does everything I need it to for now. It shows…

tmux source-file

https://youtu.be/dDq0depPrTs So you have been tricking out that, you’re looking for a silky smooth workflow that lets you fly through tmux with super speed, but every time you tweak out that you have to restart your whole session. Not amymore, Let’s add this to the bottom of our tmux.conf so that you can see everytime it gets sourced. command # We can run this command from your shell to re-source your changed It also works from the tmux command line. tmux hotkey # It’s very common to set this up as a keybinding so that you can do it easily without needing to memorize the exact command. from vim # This is my preferred way of re-sourcing my. It sits quietly in the background, and I dont need to remember to do anything. If you are a vim user you can automate this process by creating a. This will shell out the everytime you save your. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of…

tmux fzf session jumper

https://youtu.be/DkJ9rb85LC0 Quickly getting between tmux splits is critical skill for productivity. You can get by with or session for awhile, but if you have more than about three session you need something a bit more targeted. Full Screen selector # I have used this fzf one keybinding for quite awhile, honestly I did not make it up, and cannot remember where it came from. It will open up a session picker in a new full screen window. Popup selector # Like with many of my keybindings I have swapped this one out for a popup version. It just feels so smooth. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux next/prev session

https://youtu.be/8kZnjHPYnKU Now that we are splitting up work into their own sessions, lets talk about how to navigate between them without the command line. Navigating sessions is what kept me using a too many splits and windows workflow for far too long. It was rough, I was always tripping over panes and windows until I got too frustrated and just ran to start on a new blank slate. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux start application

https://youtu.be/c-a2Bnv_NJ0 Scripting tmux to open up specific applications can be intimidating your first time. It can be tricky to get it to start in the right directory. If you are trying to assign applictaions to a keybinding it can be easy to mess up and have weird things happen every time your gets sourced. Open htop in an above split # I used this one for a number of years to take a quick peek into my systems performance while a memory intensive task was running. 🗒️ note that the will make the htop split active immediately Open htop in a popup # With the new tmux popup windows I really like the flow of just peeking at htop in a popup and jumping back into what I was doing. It can have a more consistennt look, and not mess with the window layouts. Open an applicaiton in the current directory # One thing that can be tricky is getting apps that need to be in a specific directory started in the directory that you want. Here are two examples I use to open or. 🗒️ note that takes in a…

tmux rename session

https://youtu.be/WRLRiQDjVIA So you have been working on your tmux workflow, you’ve dropped a too many window workflow for scoping work that belongs together into separate sessions, but you cannot remember what session your work is in. If your diligent you have named your window when you created it, but sometimes its intent has changed or your were just plain too lazy at the time for the extra characters needed to name it. Don’t worry we can still give that session a descriptive name. Let’s rename some sessions in the terminal. There is a default keybinding that you can use to rename the current session in the tmux command line. I’ve also had this keybinding kicking around for years, but I rarely use it anymore. You will see why in an upcoming video. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux targeted session

https://youtu.be/5KE7Il7SOEk This is something that I made up but use every single day, this is what keeps much of what is on my blog or my teams private work wiki going. I have a few very important directories that I have assigned directly to a hotkey for fast session switching. tmux new-session This one is building off of yeserday’s new-session post, make sure you check that one out as well. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

⭐ ThePrimeagen vim-nav-playground

Check out ThePrimeagen and their project vim-nav-playground. No description available.

⭐ ThePrimeagen vim-fundamentals

I recently discovered vim-fundamentals by ThePrimeagen, and it’s truly impressive. No description available.

tmux new-session

https://youtu.be/LbQNdCAUogE This one starts a new chapter in our series that is going to open up a whole new set of workflow productivity options, understanding how the command is a critical command in our adventure into tmux glory. This is going to open the door for some seriously game changing hotkeys and scripting. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux detach

https://youtu.be/A1qx3tNKDdA tmux detach is a handy tmux command that will quit your current session while keeping it running. The full name of the comamnd is, is a shorthand. default keybinding I have mine bound to where mod is alt. https://waylonwalker.com/tmux-nav-2021/ for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux attach

https://youtu.be/JQ0yDCVu44E attach is one of the most useful features of tmux. If you have no interest in tmux for pane and window management, you should use tmux for this. It can be a life saver if you ever get disconnected from the host machine or accidently close your terminal you can connect right back into the session you were just in using attach. attach # this command will simply attach back to tmux if you are ever disconnected If you ever run long running tasks on a remote machine by sshing into this you should be doing it inside tmux, or something like tmux so that you do not loose your work. attach to a specific session # If you have multiple sessions running you can select the session that you want to attach to by passing. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

Git in Depth Notes

These are my notes from taking @nnja’s FEM course git-in-depth. requirements # > than 2.0 creating a git #

tmux ls

https://youtu.be/LY41GLn_DGg tmux ls will list the sessions that you have running within the tmux server if tmux is currently running. This is handy to combine with commands such as. tmux attach How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux command line

https://youtu.be/SNu-4IrkjAs So far we have covered a lot of tmux commands and how they map to keybindings but these same commands can be executed at the command line. From the command line # Let’s make a popup that displays our git status for 5s or until we close it manually. We can run the following command at the command line, in a split. From the tmux command line # Or we can open the tmux command line and run it from tmux’s built in command line, which is very similar to bim EX mode. By default the tmux command line can be opened with. 🗒️ note that the tmux command is called by default when inside of tmux. Make it a keybinding # Finally we can make it a keybinding by adding a bind command ahead of our tmux command, then we can execute this in the tmux command line or add it to our. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux copy-mode

https://youtu.be/-ypY_-VmBKk tmux copy-mode is a tmux mode that lets you scroll, search, copy, and jump your way through a pane. There are a ton of keybindings for copy-mode, the main ones you will need to know are for searching down for searching up, for next item, for starting a selection, and enter to copy the selection. Arrow keys will be used for navigation unless you have specified vi mode, then it will be. Default keybinding to get into copy mode is. If you are a vim user you will likely want to use vi style keys, add this to your file to enable vi mode. full list of copy-mode keybindings from the man page. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux join-pane

https://youtu.be/Vm5rRtcVXLw Join-pane allows you to join panes that you have broken away from your window, or created in a different window to the window you want it in. As far as I know there is not a default keybinding for it. Before you can join a pane you must first have a pane marked to join. Once you mark a pane, go back to the window you want to join it to and join-pane. My keybindings, you must add this to your file to use them. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post Also check out the full YouTube tmux-playlist to see all of the videos in this series.

tmux break-pane

https://youtu.be/ICL609F2xnc Break-pane is a handy tmux command when your layout gets too cramped and you want to just move a split into its own window. Calling does exactly that, it creates a for you and moves your currently selected split into that window Default key binding for How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

tmux zoom

https://youtu.be/Rn6mOarCQ-Y Zooming into the current split in tmux is a valuable tool to give yourself some screen real estate. These days I am almost always presenting, streaming, or pairing up with a co-worker over a video call. Since I am always sharing my screen I am generally zoomed in to a level that is just a bit uncomfortable, so anytime I make a split it is really uncomfortable, being able to zoom into the split I am focused on is a big help, and also help anyone watching follow where I am currently working. Default key bindings for zooming the current split I have rebound this to match the default binding with mod+z rather so that I get that single keystroke experience. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

tmux new-window

https://youtu.be/YRPZBv-iYyE New window as it sounds makes new windows in tmux. Windows are kind of like tabs. They are another screen within your sessions that you can name and make new panes in. Default key bindings for creating and navigating windows in tmux. As always I have rebound these keys because I generally prefer a single keystroke over the prefix plus keybinding approach that tmux gives by default. When I started using tmux I did almost everything in one giant session with many panes and windows. It became a nightmare to manage and quickly get between two sets work efficiently. This year I leaned in on sessions quite heavily. Checkout this 👇 post to see that workflow in depth. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

⭐ emkademy jumpcutter

I came across jumpcutter from emkademy, and it’s packed with great features and ideas. Automatically jump-cut silent parts of your videos using Python

tmux slect-pane

https://youtu.be/CPZJZjN9YTY These are my MOST often used keybindings that I use in tmux. They allow me to jump between splits with ease with a vim style layout. I can hold mod and jump between panes with a familiar arrow key. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

tmux rotate-window

https://youtu.be/06z5qf81ofo Rotate window is the main way that I navigated tmux before I learned. It allows you to change your focused pane, or rotate the position of the panes easily. Default keybindings My keybindings look just a bit different than the default ones, I do not like needing to hit prefix for every command, especially for repeated commands. I set a similar keybinding to the default one that uses mod instead of prefix. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

tmux select-layout

https://youtu.be/F0mHnwTrNNc When you get many splits going in tmux sometimes its time for a new layout. There are four layout strategies that I use, main-vertical, main-horizontal, even-vertical, even-horizontal. Almost always I am useing the main ones with mod plus a or mod plus shift a keybindings. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

tmux resize-panes

https://youtu.be/hpFYE2LU7xc Resizing panes in tmux can be quite difficult in default tmux, I use a set of keybingings to help resize panes in the rare occasions that I do need just a bit more space. I set the keybinding to the same as my split navigation bindings but shifted. They are very vim like (h,j,k,l). Most often when I need to resize panes I just grab the edge of the pane with my mouse. Yes the mouse, its not that often that I actually need to change the size of a pane. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

⭐ ThePrimeagen refactoring.nvim

ThePrimeagen has done a fantastic job with refactoring.nvim. Highly recommend taking a look. The Refactoring library based off the Refactoring book by Martin Fowler

tmux choose-tree

https://youtu.be/79Y-kqAiMpw Choose tree is a powerful tmux utility that provides a graphical interface to preview all sessions, windows, and panes, move between them kill them, move them and much more. The default keybinding my preferred keybinding to open sessions and windows collapsed and Zoomed in. From the man page. https://waylonwalker.com/tmux-nav-2021/ for more information on how I navigate tmux, check out this full post

tmux prefix

https://youtu.be/BMkpbfhbkKM The prefix key is an essential part of tmux, by default all of tmux’s key-bindings sit behind a prefix. This prefix is very similar to vim’s leader key. It is common for folks to change the default (control b) to or if they are a vim user something to match their vim leader key. A few of the essential default key-bindings. A more complete list of key-bindings can be found in this gist https://gist.github.com/mzmonsour/8791835. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

tmux splitting panes

https://youtu.be/kzgyiHap1nQ splitting panes is a core feature of tmux. It allows us to split the terminal vertically or horizontally into new panes. 🗒️ note that ‘#{pane_current_path}‘will keep the split in the same directory as it’s parent, without this it will default to your home directory. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

⭐ laktak extrakto

I like laktak’s project extrakto. extrakto for tmux - quickly select, copy/insert/complete text without a mouse

⭐ Mar1cX kedro-toolkit

Check out kedro-toolkit by Mar1cX. It’s a well-crafted project with great potential. Kedro Toolkit is a VSCode Extension for the Kedro Framework

tmux last session

https://youtu.be/RB87EEnnMnU An ultimate productivity key-binding in tmux is one to switch to the last session. I use this to quickly get between sessions really quick. Often I am working and need to lookup a quick note, or copy something into my notes, then get back to where I was quickly. I think of this hub and spoke model, and use to quickly drive it. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

tmux floating popups

https://youtu.be/2ZqFDsJywt8 Tmux popups are actually floating windows that you can drag around the screen. They always open in the middle (by default) when you open them, no matter where you leave them. Here are a couple of keybindings I use to open up popup windows. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post

tmux popups

https://youtu.be/2I8fB28zfB4 Tmux-popups are a great feature that is relatively new to tmux, many repos such as the standard ubuntu repos do not have it. Popups came in 3.2a, if your package manager does not have it, you can follow the tmux’s install instructions to build from source. How I navigate tmux in 2021 for more information on how I navigate tmux, check out this full post I use popups quite a bit in my workflow to ssh into another machine for a short period, or make a new project with a template.

⭐ pysonDB pysonDB

Check out pysonDB by pysonDB. It’s a well-crafted project with great potential. A Simple, ☁️ Lightweight, 💪 Efficent JSON based database for 🐍 Python. PysonDB-V2 has been released ⬇️

⭐ nvim-pack nvim-spectre

I came across nvim-spectre from nvim-pack, and it’s packed with great features and ideas. Find the enemy and replace them with dark power.

Incremental Versioned Datasets in Kedro

Kedro versioned datasets can be mixed with incremental and partitioned datasets to do some timeseries analysis on how our dataset changes over time. Kedro is a very extensible and composible framework, that allows us to build solutions from the individual components that it provides. This article is a great example of how you can combine these components in unique ways to achieve some powerful results with very little work. What is Kedro 👆 Unsure what kedro is? Check out this post. How does our dataset change over time?? # This was a question presented to me at work. We had some plots being produces as the output of our pipeline and the user wanted the ability to compare results over time. Luckily this was asked early in the project so we were able to proactively setup versioning on the right datasets. To enable this all we needed to do now was to add and we will be able to compare results over time. Yes kedro makes it that easy to setup. set up a project # Set up a new project just as…

⭐ markstos qmk_firmware

Just starred qmk_firmware by markstos. It’s an exciting project with a lot to offer. Open-source keyboard firmware for Atmel AVR and Arm USB families