Kedro Catalog

edit✏️

I am exploring a kedro catalog meta data hook, these are some notes about what I am thinking.

Process

Problems This Hook Should solve

implementation details

Metadata to Capture

try pandas method -> try spark -> try dict/list -> none

Database?

Is there an easy way to create a nosql database in memory from a a list of dictionaries?