Comprehensive guide to creating kedro nodes
The Kedro node is an essential part of the pipeline. It defines what catalog
entries get passed in, what function gets ran, and the catalog entry to save
the results under.
does this link work? # [1]
https://waylonwalker.com/what-is-kedro/
👆 Unsure what kedro is? Check out this post.
The node function # [2]
The node function is the most common and reccomended way to define kedro nodes.
It is a function that constructs and returns Node objects for you.
Creating your first kedro node # [3]
from kedro.pipeline import node
def identity(df):
"a function that returns itself"
return df
my_first_node = node(
func=identity,
inputs='raw_cars',
output='int_cars',
tags=['int',]
)
function # [4]
The func passed into node can be any callable that accepts the inputs yout
have specified, and returns the correct output that you specify as your output.
- any callable
- a function you write
- a function from a library
- class constructor
- lambda function
- partial function
- l...