All published posts
There are many reasons that you should be using kedro. If you are on a team of Data Scientists/Data Engineers processing DataFrames from many data sources should be considering a pipeline framework. Kedro is a great option that provides many benefits for teams to collaborate, develop, and deploy data pipelines
Kedro makes it super easy to get started with their cli that utilizes cookiecutter under the hood.
...
Just starred Second-Brain by KasperZutterman. It’s an exciting project with a lot to offer.
A curated list of awesome Public Zettelkastens 🗄️ / Second Brains 🧠 / Digital Gardens 🌱
STOP LEAVING Browser Tabs open and save them here!
https://ianthehenry.com/posts/how-to-learn-nix/python3-alpha/
...
Just starred Repo-Roster by nastyox. It’s an exciting project with a lot to offer.
Shout-out supporters in your GitHub README file.
Kedro 0.16.6 is out! Let’s take a look through the release notes
This is really exciting to see more deployment options coming from the kedro team. It really shows the power of the framework. The power of some of these orchestrations options is incredible.
Most of them hinge on a sweet combination of the kedro cli, docker image, and the pipeline knowing your nodes dependencies.
...
I started making stories as kind of a brain dump a few times per day and posting them to [LinkedIn](https://www.linkedin.com/in/waylonwalker/(https://www.linkedin.com/in/waylonwalker/). Here are the last 11 days of stories.
I store all the stories on my website with the hopes of doing something with them on my own platform eventually. For now it makes it easy to make these posts.
cd static/stories ls | xargs -I {} echo ''
Check out mmchougule and their project kedro-grpc-server.
Kedro gRPC Server is a Kedro plugin that creates a gRPC server for triggering and monitoring pipeline runs using a general-purpose RPC framework gRPC
Check out yetudada and their project kedro-user-testing.
Discovery prototypes for user testing
charmbracelet has done a fantastic job with glow. Highly recommend taking a look.
Render markdown on the CLI, with pizzazz! 💅🏻
Check out mytechnotalent and their project Python-For-Kids.
A FREE comprehensive online Python development tutorial FOR KIDS utilizing an official BBC micro:bit Development Board going step-by-step into the world of Python for microcontrollers.
I’m impressed by pycon_pybadge_2020 from nnja.
Initial code for Microsoft’s PyBadge at PyCon 2020
I was 20 commits into a hackoberfest PR when I suddenly realized they they all had my work email on them instead of my personal email 😱. This is the story of how I corrected my email address on 19 individual commits after already submitting for a PR.
stop the bleeding
Before anything else set the email correctly!
...
I released a router-like plugin for kedro back in April 2020. This was not the first design, the idea actually came from one of the QB folks who taught me kedro nearly a year before. We were assembling our pipelines with something called nodes_global. It worked fairly well but did have some issues around being set as a global variable.
But…
One thing in particular that it did not lend itself well to was being able to create a packagable pipeline that I could pip install and append into any of my existing pipelines. Something I am still trying to work out, maybe I don’t need this. I think I have it working for our internal pipelines and it seems like the way to go, but we don’t necessarily end up using it.
...
I came across python_training from AnkurDedania, and it’s packed with great features and ideas.
Intro to Python
Today I ran into an issue where we had a one-off script that just needed to work, but it was just chewing threw memory like nothing.
It started with a colleague asking me How do I clear the memory in a Jupyter notebook, these are the steps we took to debug the issue and free up some memory in their notebook.
How do I clear the memory in a Jupyter notebook?
...