So am I a Kedro convert? Yah, you betcha.
A glowing review of kedro!
Incremental Dataset : This support exists for reading data, but it’s lacking for writing datasets. This affected us a few times when we had a node that would take 8-10 hours to run. We lost work if the node failed part of the way through
The one issue he describes with IncrementalDataSets is a real one. To address it in the past, I’ve had to write custom datasets with their incremental-nature built in.