When I need to cache some data between runs or share a cache accross multiple
processes my go to library in python is
diskcache. It's built on sqlite with
just enough cacheing niceties that make it very worth it.
Install diskcache into your virtual environement of choice using pip from your command line.
python -m pip install diskcache
setup the cache
There are a couple of different types of cache,
DjangoCache, you can read more about those in the
from diskcache import Cache cache = FanoutCache('.mycache', statistics=True)
Adding to the cache
Adding to the cache only needs a key and value.
cache.add('me', 'waylonwalker' )
Set the expire time
Optionally you can set the seconds before it expires. The cache invalidation tools like this is what really makes diskcache shine over using raw sqlite or any sort of static file.
cache.add('me', 'waylonwalker', expire=60)
Diskcache supports tagging entries added to the cache.
# add an item to the cache with a tag cache.add('me', 'waylonwalker', expire=60, tag='people')
This seems to let you do a few new things like getting items from the cache by both key and tag, or evict all tags from the cache.
# evict all items tagged as 'people' from the cache cache.evict(tag='people')
Reading from the cache
You can read from the cache by using the
.get method and giving it the key
you want to retrieve.
who = cache.get('me') # who == 'waylonwalker'
Cache misses will return a
None just like any dictionary
missed = cache.get('missing') # missed == None
Give Grant some love and give grantjenks/python-diskcache a ⭐.