Published

I am looking into a way to replace my google reader experience that I had back in 2013 before google took it from us. I am starting by learning how to parse feeds with python, and without much previous knowledge, it proved to be much easier than anticipated thanks to the library. This is how I used python to parse rss and setup my own custom feed. Install Install the feedparser library. Get the content The feed object The feed is a feedparser.FeedParserDict. For all intents and purposes this seems to just behave like a dict with the following. feed has some general information about the rss feed, but the meat of the feed is in entries. The rest of the keys weren’t all that useful for me at the moment. pulling multiple feeds I grabbed a few popular RSS feeds that I was familiar with to get started. I checked out the keys, all three had the following keys. Mine also had the full post under, this is because I added an extra for publishing to from an RSS feed. NOTE: dev.to/feed I also pull…

Inputs The input will be a yaml file containing a list of you want to stay up to date with. Inside each item will be a url, and weight. Types rss feed (primary source) youtube feed Stack Overflow tags GitHub repo activity pypi release dev.to post Twitter Search # user will need an api key Methodology Each url will be pulled in and parsed into a standard data scructure. Some items may yield special feaures, a schemaless/nosql datastructure may be best. Pipeline will decide to how to weight posts based on users weight, recent position on feed,. output Pipeline outputs will be email, json, markdown, xml, html. Each will be able to be configured by the config file (max-entries, output location). Running Users will be able to create their own reader. Here is a list of possiblilites. Users will not have the pipeline inside their repo. It will pull the pipeline from a package repo, pypi, dockerhub, GitHub. fork a template repo (might be cumbersome to update) use a GitHub action from the Marke…

I ran this post on dev.to and got a great response of great examples, check it out.!! 🤓 What's on your GitHub Profile The GitHub profile feature just went live for a subset of users. Simply creating a repo named after your username, and clicking share to Profile on the sidebar will create a custom profile that shows up just above your pinned projects. I am still trying to figure out what to put on mine, but this is what I have so far. I feel like mine is a bit big at the moment, I don’t like that my pinned repos end up blow the fold. updated I tightened mine up and took inspiration from a few others. Share a screenshot and link of yours on dev. updated again Updated with a list of latest Twitter followers, using GitHub actions.

Can someone explain how or why twitter cards render differently from device to device? I do understand that twitter cards a built from meta tags, the full list can be found in their docs Rendered on Mobile Mobile Looks fine. Not Rendered on Desktop On Desktop it is not picking up the image. Twitter Card Validator The Validator renders the card correctly. I tried the official twitter card validator, as well as heymeta.com, and metatags.io. All look good. Can Cards be updated? even with a redirect? I tried seting up a pinned tweet that uses a netlify redirect to always keep my latest post up to date. Again this one looks good in the validator, doesnt render the image on desktop, does render the image on mobile, but does not update. I have heard that you need to hit the card validator to update cards? I am not sure if this is true, but for me this is not even upating the card. 👋 Hello, ―――――― I'm Waylon Walker ―――――― I work with data using 🐍 #python and utilize #webdev to 〽visualize it. ―…

I ran a discussion on dev that collected quite a list of examples in the comment section. So many great calls to action, animations, memes, and weird tricks. My current profile social icons Upload all of your icons to the repo in a directory such as or, then link them with a attribute like below. I used html for mine, not sure if you can set the in markdown. note I did add a bit of (non-breaking-whitespace) between my icons. Without adding css this seemed like the simplest way to do it. Center Aligning things in the center of the readme is super simple. I used this trick to align my social icons in the middle. right For my latest post I floated it to the right with a little bit of action. You may need to play with where you put this in the document, and the size of elements to get things to flow right. redirects In order to keep my latest post always up to date on my readme I implemented a netlify redirect to always point to my latest post. As a digital gardener this helps me keep poin…

Python and are super useful tools, that when used properly can make you code much simpler and easier to maintain. Large manual conversions from a dataset to function arguments can be packed and unpacked into lists or dictionaries. Beware though, this power can lead to some really unreadable/unusable code if done wrong. I generally post these as a carousel on LinkedIn based on a full article. Let mw know what you think of it shown inside of a blog @_waylonwalker. See the full article here Slides

Why use kedro catalog? While using the catalog alone will not reap all of the benefits of the framework, it does get you and your project ready for the full framework eventually. For me the full benefit of the catalog comes when you combine it with the pipeline and dont even touch read/write steps at all. Taking a step into kedro by adopting the catalog first will give you a way to organize all of your data loads in one place, and stop manually writing read/write code, which can be different for each data and storage type. You just don’t need to think about it. iperitive loading style organizes your data all file locations can be quickly identified can be dropped into kedro later “can be dropped into kedro later” Let’s talk a bit more about that 2 Ways to Gracefully adopt the catalog How do I get started with the kedro catalog add with the code api load from yaml ( recommended) 1. Adding to the catalog with the code api how to use the kedro catalog code api It is possible to keep every…