Tags
Python's requests library is one of the gold standard apis, designed by Kenneth Reitz. It was designed with the user perspective in mind first and implementation second. I have heard this called readme driven development, where the interface the user will use is laid out first, then implemented. This makes the library much mor intuitive than if it were designed around how it was easiest to implement.
Install Requests
Requests is on pypi and can be installed into your virtual environtment with pip.
python -m pip install requests
Getting the content of a request
Requests makes getting content from a web url as easy as possible.
import requests r = requests.get('https://waylonwalker.com/til/htmx-get/') article = r.content
requests is not limited to html
Requests can handle any web request and is not limited to only html. Here are some examples to get a markdown file, a csv, and a png image.
htmx_get_md = requests.get('https://waylonwalker.com/til/htmx-get.md').content cars = requests.get('https://waylonwalker.com/cars.csv').content profile = requests.get('https://images.waylonwalker.com/8bitc.png').content
RTFM
There is way more to requests, this just scratches the surface while covering what you are going to need to get going. The requests docs have way more details.