telescope-media-files.nvim [1] by nvim-telescope [2] is a game-changer in its space. Excited to see how it evolves.
Telescope extension to preview media files using Ueberzug.
References:
[1]: https://github.com/nvim-telescope/telescope-media-files.nvim
[2]: https://github.com/nvim-telescope
Publishing rhythm
sqlfluff [1] by sqlfluff [2] is a game-changer in its space. Excited to see how it evolves.
A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
References:
[1]: https://github.com/sqlfluff/sqlfluff
[2]: https://github.com/sqlfluff
cmp-copilot [1] by hrsh7th [2] is a game-changer in its space. Excited to see how it evolves.
copilot.vim source for nvim-cmp
References:
[1]: https://github.com/hrsh7th/cmp-copilot
[2]: https://github.com/hrsh7th
Looking for inspiration? pypandoc [1] by JessicaTegner [2].
Thin wrapper for “pandoc” (MIT)
References:
[1]: https://github.com/JessicaTegner/pypandoc
[2]: https://github.com/JessicaTegner
I’m impressed by kedro-wdbc-tf [1] from abhinavsp0730 [2].
No description available.
References:
[1]: https://github.com/abhinavsp0730/kedro-wdbc-tf
[2]: https://github.com/abhinavsp0730
Check out chipsenkbeil [1] and their project distant.nvim [2].
🚧 (Alpha stage software) Edit files, run programs, and work with LSP on a remote machine from the comfort of your local environment 🚧
References:
[1]: https://github.com/chipsenkbeil
[2]: https://github.com/chipsenkbeil/distant.nvim
nvim conf 2021 | IDE's are slow | Waylon Walker
https://youtu.be/E18m4KkJUnI
---
Slides 👇 # [1]
welcome # [2]
Other possible titles # [3]
- Using Vim as a Team Lead
- I 💜 Tmux
- Why I stopped using @code
- Get there fast
- How I vim
It’s ok # [4]
Use a graphical IDE if it works for you.
Trick it out # [5]
vim is so well integrated into the terminal, take advantage
It wasn’t working for me anymore # [6]
dozens of instances # [7]
As a team lead I bounce betweeen a dozen projects a per day
https://pbs.twimg.com/media/FAEmRjYUcAUk2eR?format=jpg&name=large [8]
Move With Intent # [9]
Running vim inside tmux lets me move swiftly between the exact project I need.
https://twitter.com/_WaylonWalker/status/1438849269407047686/photo/1// [10]: <> (__)
Hub and Spoke # [11]
- direct link to specific projects
- fuzzy into all projects
- fuzzy into open projects
How I navigate tmux in 2021 [12]#hub-and-spoke
Other Things That Make this Possible # [13]
- tmux
- direnv
vim adjacent things
yes, vim is ugly, make it your...
tesseract [1] by tesseract-ocr [2] is a game-changer in its space. Excited to see how it evolves.
Tesseract Open Source OCR Engine (main repository)
References:
[1]: https://github.com/tesseract-ocr/tesseract
[2]: https://github.com/tesseract-ocr
The work on sqlite.lua [1] by kkharji [2].
SQLite LuaJIT binding with a very simple api.
References:
[1]: https://github.com/kkharji/sqlite.lua
[2]: https://github.com/kkharji
I’m impressed by telescope-frecency.nvim [1] from nvim-telescope [2].
A telescope.nvim extension that offers intelligent prioritization when selecting files from your editing history.
References:
[1]: https://github.com/nvim-telescope/telescope-frecency.nvim
[2]: https://github.com/nvim-telescope
Check out flick-it [1] by cmgriffing [2]. It’s a well-crafted project with great potential.
An OBS overlay game similar to the !drop game.
References:
[1]: https://github.com/cmgriffing/flick-it
[2]: https://github.com/cmgriffing
Check out diffurcate.vim [1] by AndrewRadev [2]. It’s a well-crafted project with great potential.
Split a git [3] diff into separate files
References:
[1]: https://github.com/AndrewRadev/diffurcate.vim
[2]: https://github.com/AndrewRadev
[3]: /glossary/git/
codelucas [1] has done a fantastic job with newspaper [2]. Highly recommend taking a look.
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
References:
[1]: https://github.com/codelucas
[2]: https://github.com/codelucas/newspaper
I recently discovered delta-rs [1] by delta-io [2], and it’s truly impressive.
A native Rust library for Delta Lake, with bindings into Python
References:
[1]: https://github.com/delta-io/delta-rs
[2]: https://github.com/delta-io
I recently discovered cmp-skkeleton [1] by rinx [2], and it’s truly impressive.
skkeleton source for nvim-cmp
References:
[1]: https://github.com/rinx/cmp-skkeleton
[2]: https://github.com/rinx
The work on coveragepy [1] by nedbat [2].
The code coverage tool for Python
References:
[1]: https://github.com/nedbat/coveragepy
[2]: https://github.com/nedbat
I like coveragepy’s [1] project coveragepy [2].
The code coverage tool for Python
References:
[1]: https://github.com/coveragepy
[2]: https://github.com/coveragepy/coveragepy
I like pytest-dev’s [1] project pytest-cov [2].
Coverage plugin for pytest.
References:
[1]: https://github.com/pytest-dev
[2]: https://github.com/pytest-dev/pytest-cov
Just Ask Ipython for help
It happens to the best of us # [1]
We can’t all remember every single function signature out there, it’s just not
possible. If you want to stay productive while coding without the temptation
to hit YouTube or Twitter. Use the built in help. Here are 5 ways to get help
without leaving your terminal.
https://youtu.be/TZrRAP-9UMk
Docstrings # [2]
In any python repl you can access the docstring of a function by calling for help.
help(df.rolling)
In Ipython we can even get some syntax highlighting with the ?.
df.rolling?
Source Code # [3]
Sometimes the docstrings are not good enough, and don’t give us the content we
need, and we just need to look at the source. Without leaving your terminal
there are two ways I often use to get to the source of a function I am trying
to use.
import inspect
inspect.getsource(df.rolling)
The more common way I do it is with the ipython ??.
df.rolling??
Bonus rich.inspect # [4]
You thought the syntax highlighting was good with ipython, check out w...
Hacktoberfest 2021?
Are you participating in Hacktoberfest 2021?
I got my start with open source with Hacktoberfest 2018. I remember being so
nervous for those first pr’s. I have continued to participate every year, and
it feels good to give back.
It made a big change on me # [1]
Something that it really did for me was to lower the hurdle to contribute
regularly. I am not a huge contributor to open source. I am not necessarily a
regular maintainer of any large project, but I do often raise issues when I see
things as a user that would make things easier or more clear.
After participating it does not feel like such a big deal to go through the
motions of making my own fork, making a small change, and submitting it for
review.
What can you do? # [2]
As a user, you might be in a unique position to see a library from the
perspective of other users rather than from the eyes of a maintainer. You can
help bring the user perspective to your favorite library.
https://twitter.com/_WaylonWalker/status/1446...
I made a neovim plugin
I’ve slowly adding more and more lua functions into my neovim configuration,
and recently I noticed a pattern for a class of functions that reach out to run
shell commands that can be abstracted away.
https://youtu.be/8m5ipBuopPU
Telegraph.nvim # [1]
Check out the project readme [2]
for the most up to date details on the plugin itself.
Motivation # [3]
I want a simple way to make remaps into shell commands that can open new tmux
windows, popups, or just run a command with context from the editor.
For example I want to make remaps to do things like open the current file in lookatme.
# vim :terminal
nnoremap <leader>s <cmd>Telegraph pipx run lookatme {filepath} --live-reload --style gruvbox-dark<cmd>
# tmux session
nnoremap <leader><leader>s <cmd>lua require'telegraph'.telegraph({cmd='pipx run lookatme {filepath} --live-reload --style gruvbox-dark', how='tmux'})<CR>
# tmux popup
nnoremap <leader><leader>S <cmd>lua require'telegraph'.telegraph({cmd='pipx run lookatme {filepath...
The work on ansible [1] by ThePrimeagen [2].
No description available.
References:
[1]: https://github.com/ThePrimeagen/ansible
[2]: https://github.com/ThePrimeagen
Setting Parameters in kedro
Parameters are a place for you to store variables for your pipeline that can be
accessed by any node that needs it, and can be easily changed by changing your
environment. Parameters are stored in the repository in yaml files.
https://youtu.be/Jj5cQ5bqcjg
What is Kedro [1]
👆 Unsure what kedro is? Check out this post.
parameters files # [2]
You can have multiple parameters files and choose which ones to load by setting
your environment. By default kedro will give you a base and local
parameters file.
- conf/base/parameters.yml
- conf/local/parameters.yml
base # [3]
The base environment should contain all of the default values you want to run.
# /conf/base/parameters.yml
test_size: 0.2
random_state: 3
features:
- engines
- passenger_capacity
- crew
- d_check_complete
- moon_clearance_complete
- iata_approved
- company_rating
- review_scores_rating
NOTE base will always be loaded first.
accessing parameters # [4]
Parameters can be accessed through context or throug...
Writing your first kedro Nodes
https://youtu.be/-gEwU-MrPuA
Before we jump in with anything crazy, let’s make some nodes with some vanilla
data structures.
import node # [1]
You will need to import node from kedro.pipeline to start creating nodes.
from kedro.pipeline import node
func # [2]
The func is a callable that will take the inputs and create the outputs.
inputs / outputs # [3]
Inputs and outputs can be None, a single catalog entry as a string, mutiple
catalog entries as a List of strings, or a dictionary of strings where the key
is the keyword argument of the func and the value is the catalog entry to use
for that keyword.
our first node # [4]
Sometimes in our pipelines our data is coming from an api where we already have
python functions built to pull with. Thats ok, kedro supposrts that with
inputs=None.
def create_range():
return range(100)
make_range = node(
func=create_range,
inputs=None,
outputs='range'
)
second node # [5]
Now we have some data to work from, lets use that as our inpu...
I’m impressed by Telegraph.nvim [1] from WaylonWalker [2].
Send commands system commands in an elegant way
References:
[1]: https://github.com/WaylonWalker/Telegraph.nvim
[2]: https://github.com/WaylonWalker
I came across nvim-example-lua-plugin [1] from jacobsimpson [2], and it’s packed with great features and ideas.
A simple Neovim Lua plugin using the Lua embedded in Neovim, suitable as a template.
References:
[1]: https://github.com/jacobsimpson/nvim-example-lua-plugin
[2]: https://github.com/jacobsimpson
I’m impressed by skimpy [1] from aeturrell [2].
skimpy is a light weight tool that provides summary statistics about variables in data frames within the console.
References:
[1]: https://github.com/aeturrell/skimpy
[2]: https://github.com/aeturrell
I like mobilemancer’s [1] project windows-terminal-aurelia [2].
Aurelia inspired Windows Terminal theme
References:
[1]: https://github.com/mobilemancer
[2]: https://github.com/mobilemancer/windows-terminal-aurelia
I’m really excited about vim-startuptime [1], an amazing project by dstein64 [2]. It’s worth exploring!
A plugin for viewing Vim and Neovim startup event timing information.
References:
[1]: https://github.com/dstein64/vim-startuptime
[2]: https://github.com/dstein64
I like wbthomason’s [1] project packer.nvim [2].
A use-package inspired plugin manager for Neovim. Uses native packages, supports Luarocks dependencies, written in Lua, allows for expressive config
References:
[1]: https://github.com/wbthomason
[2]: https://github.com/wbthomason/packer.nvim
Just starred nvim-lspconfig [1] by neovim [2]. It’s an exciting project with a lot to offer.
Quickstart configs for Nvim LSP
References:
[1]: https://github.com/neovim/nvim-lspconfig
[2]: https://github.com/neovim
If you’re into interesting projects, don’t miss out on nvim-treesitter [1], created by nvim-treesitter [2].
Nvim Treesitter configurations and abstraction layer
References:
[1]: https://github.com/nvim-treesitter/nvim-treesitter
[2]: https://github.com/nvim-treesitter
Looking for inspiration? vim-matchup [1] by andymass [2].
vim match-up: even better % 👊 navigate and highlight matching words 👊 modern matchit and matchparen. Supports both vim and neovim + tree-sitter.
References:
[1]: https://github.com/andymass/vim-matchup
[2]: https://github.com/andymass
treesitter-unit [1] by David-Kunz [2] is a game-changer in its space. Excited to see how it evolves.
A Neovim plugin to deal with treesitter units
References:
[1]: https://github.com/David-Kunz/treesitter-unit
[2]: https://github.com/David-Kunz
Running your Kedro Pipeline from the command line
Running your kedro pipeline from the command line could not be any easier to
get started. This is a concept that you may or may not do often depending on
your workflow, but its good to have under your belt. I personally do this half
the time and run from ipython half the time. In production, I mostly use docker
and that is all done with this cli.
https://youtu.be/ZmccpLy-OEI
What is Kedro [1]
👆 Unsure what kedro is? Check out this post.
Kedro run # [2]
To run the whole darn project all we need to do is fire up a terminal, activate
our environment, and tell kedro to run.
kedro run
Specific Pipelines # [3]
Running a sub pipeline that we have created is as easy as telling kedro which
one we want to run.
kedro run --pipeline dp
Single Nodes # [4]
While developing a node or a small list of nodes in a larger pipeline its handy
to be able to run them one at a time. Besides the use case of developing a
single node I would not reccomend leaning very heavy on running single nodes,
le...
kedro Virtual Environment
Avoid serious version conflict issues, and use a virtual environment [1] anytime
you are running python, here are three ways you can setup a kedro virtual
environment.
https://youtu.be/ZSxc5VVCBhM
- conda
- venv
- pipenv
conda # [2]
I prefer to use conda as my virtual environment manager of choice as it give me
both the interpreter and the packages I install. I don’t have to rely on the
system version of python or another tool to maintain python versions at all, I
get everything in one tool.
conda create -n my-project python=3.8 -y
conda activate my-project
python -m pip install --upgrade pip
pip install -e src
conda info --envs
- stores environment in a root directory i.e. ~/miniconda3
- conda can use its own way to manage environments environment.yml
- the python interpreter is packaged with the environment
virtualenv # [3]
Virtual env (venv) is another very respectable option that is built right into
python, and requires no additional installs or using a different dis...
I’m impressed by circles.nvim [1] from projekt0n [2].
uniform icons for neovim
References:
[1]: https://github.com/projekt0n/circles.nvim
[2]: https://github.com/projekt0n
Kedro Install
Kedro comes with an install command to install and manage all of your
projects dependencies.
https://youtu.be/IWimEs-hHQg
cd into your project directory and activate env # [1]
You must start by having your kedro project either cloned down
from an existing project or created from kedro new. Then
activate your environment.
Kedro New [2]
this post covers kedro new
kedro Virtual Environment [3]
This post covers creating your virtual environment [4] for kedro
install kedro # [5]
Make sure you have kedro installed in your current
environment, if you dont already have it.
pip install kedro==0.17.4
pip-tools # [6]
Kedro uses the pip-tools package under the hood to pin
dependencies in a very robust way to ensure that the project
will continue to work on everyone’s machine day, including
production, day in and day out. No matter what happens to the
dependencies you have installed.
pip-compile # [7]
The command that kedro uses from pip-tools is pip-compile. It will look at
what yo...
Kedro Git Init
Immediately after kedro new, before you start running kedro install or your first line of code the first
thing you should always do after getting a new kedro template created is to
git init.
https://youtu.be/IGba3ytf_6U
git init # [2]
Its as simple as these three commands to get started.
git init
git add .
git commit -m init
I don’t care if this project is for learning, if it will never have a remote or not, use git.
References:
[1]: /glossary/git/
[2]: #git-init
Kedro New
https://youtu.be/uqiv5LAiJe0
Kedro new is simply a wrapper around the cookiecutter templating library. The
kedro team maintains a ready made template that has everything you need for a
kedro project. They also maintain a few kedro starters, which are very similar
to the base template.
What is Kedro [1]
Unsure what kedro is, Check out yesterdays post on What is Kedro.
pipx # [2]
I reccomend using pipx when running kedro new. pipx is designed for system
level cli tools so that you do not need to maintain a virtual environment [3] or
worry about version conflicts, pipx manages the environment for you.
The kedro team does not reccomend pipx in their docs as they already feel
like there is a bit of a tool overload for folks that may be less familiar with
pipx kedro new
I like using pipx as it gives you better control over using a specific
version or always the latest version, unlike when you run what you have on your
system depends on when you last installed or upgraded.
Kedro Ne...
Check out AckslD [1] and their project nvim-neoclip.lua [2].
Clipboard manager neovim plugin with telescope integration
References:
[1]: https://github.com/AckslD
[2]: https://github.com/AckslD/nvim-neoclip.lua
What is Kedro
Kedro is an unopinionated Data Engineering framework that comes with a somewhat
opinionated template. It gives the user a way to build pipelines that
automatically take care of io through the use of abstract DataSets that the
user specifies through Catalog entries. These Catalog entries are loaded,
ran through a function, and saved by Nodes. The order that these Nodes are
executed are determined by the Pipeline, which is a DAG. It’s the
runner’s job to manage the execution of the Nodes.
https://youtu.be/Wf4rnFsaFFU
---
What is Kedro [1]
This is an updated version of my original what-is-kedro article
---
Hot Take # [2]
If you are doing a series of operations to data with python, especially if you
are using something as supported as pandas, you should be using a framework
that gives you a pipeline as a DAG and abstracts io.
Orchestrators # [3]
Like I said, kedro is unopinionated it does determine where or how your data
should be ran. The kedro team does support the following ...
How I Kedro
https://youtu.be/bw5_FWDVRpU
Ubuntu # [1]
I recently switched over to using Ubuntu, it works well pretty much out of the
box for me. I am using gnome with a dark theme.
Gnome Terminal # [2]
I am still using the built in default gnome terminal, it just works. It does
all the things that I need it to do. It supports transparency renders my fonts
and allows me to highlight things well.
- One Dark Theme
dotfiles # [3]
You can find my
dotfiles [4] on
github. Feel free to read through and take anything that you
find useful. I would encourage you not to steal them, but to
integrate the parts that you want into your own dotfiles.
dotfiles are a very personal thing. They are an extension of
ones fingertips designed for how you think and type.
zsh # [5]
I use zsh as my default shell. I like to use it as my
interactive shell. It works, and does a bit better with
things like tab completion out of the box.
starship # [6]
I use the starship prompt for my shell. It works well out of
the...
tmux show-messages
https://youtu.be/LLk94fKpGg4
As we push the limits of tmux further and further you are bound to end up in a
situation where you are mashing down a hotkey and it’s just not doing what you
want it to do, and you have no idea why.
show-messages is a tmux command that can be used to show what tmux is
actually doing behind the scenes. This might highlight any hot key conflicts
you might have in your ~/.tmux.conf.
man page for show-messages # [1]
In case you wnat more information about show-messages, here is the man page.
show-messages [-JT] [-t target-client]
(alias: showmsgs)
Show server messages or information. Messages are stored, up to a
maximum of the limit set by the message-limit server option. -J and -T
show debugging information about jobs and terminals.
How I navigate tmux in 2021 [2]
for more information on how I navigate tmux, check out this full post
Also check out the full YouTube
tmux-playlist [3]
to see all of the videos in this series.
References:
[1]: #man-...
tmux ta
https://youtu.be/nT0FA1RNZEs
Now your creating, jumping, and killing sessions like a boss. You are slicing
through projects with ease, let me show you one more thing that can be the
cream on top of this silky smooth setup we have been working towards.
Chris Toomey’s [1] Tmux Course # [2]
This script is simply my fork of Chris Toomey’s tat script straight out of
his course. It helps us create or jump to project specific sessions with ease.
a directory of projects # [3]
My version of the ta script will let you pass it a directory, and it will
give you a fuzzy popup.
ta ~/git
setting up a keybinding # [4]
bind C-g display-popup -E "ta ~/git"
[5]
default layout # [6]
By default I have my projects open with a vertical split, vim is on top, with
my file finder open and the lower split is set to just my terminal. This is
what I do 90% of the time that I open a project anyways.
[7]
More projects # [8]
I also have a directory setup that is a symlink-gallery of all of my projec...
tmux display-message
https://youtu.be/utfLA6L8o5s
You’ve got some long running tasks, and you’re trying to stay productive and
knock tasks off that board, but you keep finding that your processes finish and
you stay on other tasks for longer than you should. You were in the flow and
just did not check back in on it. With display-message you can send yourself
a notification when that long running task is complete.
from the man page # [1]
Here is a snippet of display-message from the tmux man page. I rarely need
to do anything other than just display message, but there are other flags for
it.
display-message [-aINpv] [-c target-client] [-d delay] [-t target-pane] [message]
(alias: display)
Display a message. If -p is given, the output is printed to stdout,
otherwise it is displayed in the target-client status line for up to
delay milliseconds. If delay is not given, the message-time option is
used; a delay of zero waits for a key press. ‘N’ ignores key presses
and closes only after the delay e...
If you’re into interesting projects, don’t miss out on python_code_tips [1], created by heathdbrown [2].
No description available.
References:
[1]: https://github.com/heathdbrown/python_code_tips
[2]: https://github.com/heathdbrown
killing tmux
https://youtu.be/QWPyYx54JbE
Now it’s time to switch gears, we are onto a different part of our day and
there are just too many sessions running and we need to clean up shop.
kill-server # [1]
One viable option is to nuke the whole dang thing. I actually do this more
than you might think.
tmux kill-server
save and commit your work diligently before kill-server
kill-session # [2]
A more reasonable option might be to kill a single session.
# kills the current session
tmux kill-session
# kills the session named scratch
tmux kill-session -t scratch
choose-tree # [3]
Killing sessions one by one from the command line can be a bit tedious, and
involve more keystrokes than necessary. Another option built right into tmux
is choose-tree. By default choose-tree is bound to prefix+s, that’s
pressing control+b then s. Once you are in choose-tree, you can navigate
around with your configured navigation scheme, press x to kill a session, or
pane or window then y to confirm. You can also ...
tmux has-session
https://youtu.be/XucVVgGmesM
I see you there, trying to script out your tmux layouts. Tryig to get each
project setup just perfect with a script, but you keep stumbling over yourself
with duplicate session error messages
The has-session tmux command is a handy tool to prevent this duplicate session error message when scripting your tmux layouts.
command line # [1]
The command is pretty straight forward, you simply ask tmux if the session name
you are looking for exists.
tmux has-session -t "waylonwalker_com"
How I navigate tmux in 2021 [2]
for more information on how I navigate tmux, check out this full post
Also check out the full YouTube
tmux-playlist [3]
to see all of the videos in this series.
References:
[1]: #command-line
[2]: /tmux-nav-2021/
[3]: https://www.youtube.com/playlist?list=PLTRNG6WIHETB4reAxbWza3CZeP9KL6Bkr
I’m impressed by htmx [1] from bigskysoftware [2].
</> htmx [3] - high power tools for HTML [4]
References:
[1]: https://github.com/bigskysoftware/htmx
[2]: https://github.com/bigskysoftware
[3]: /htmx/
[4]: /html/