kedro.contrib.io.transformers.ProfileTimeTransformer¶
-
class
kedro.contrib.io.transformers.
ProfileTimeTransformer
[source]¶ Bases:
kedro.io.transformers.AbstractTransformer
A transformer that logs the runtime of data set load and save calls
Methods
ProfileTimeTransformer.load
(data_set_name, load)Wrap the loading of a dataset. ProfileTimeTransformer.save
(data_set_name, …)Wrap the saving of a dataset. -
__init__
¶ Initialize self. See help(type(self)) for accurate signature.
-
load
(data_set_name, load)[source]¶ Wrap the loading of a dataset. Call
load
to get the data from the data set / next transformer.Parameters: - data_set_name (
str
) – The name of the data set being loaded. - load (
Callable
[[],Any
]) – A callback to retrieve the data being loaded from the data set / next transformer.
Return type: Any
Returns: The loaded data.
- data_set_name (
-
save
(data_set_name, save, data)[source]¶ Wrap the saving of a dataset. Call
save
to pass the data to the data set / next transformer.Parameters: - data_set_name (
str
) – The name of the data set being saved. - save (
Callable
[[Any
],None
]) – A callback to pass the data being saved on to the data set / next transformer. - data (
Any
) – The data being saved
Return type: None
- data_set_name (
-