Unanswered
Hi. After Upgrading Clearml To Latest Version, Got This Error From My Pipeline (Windows10, Configured And Running Tensorflowod For Tf 2.3.):
Hi BattyLion34
script_a.py
generates file
test.json
in project folder
So let's assume "script_a" generates something and puts it under /tmp/my_data
Then it can create a dateset from the folder /tmp/my_data
, with Dataset.create() -> Dataset.sync -> Dataset.upload -> Dataset.finalize
See example: https://github.com/alguchg/clearml-demo/blob/main/process_dataset.py
Then "script_b" can get a copy of the dataset using "Dataset.get()", see example:
https://github.com/alguchg/clearml-demo/blob/main/sklearn_example.py
BTW:
In the gitlab links, what is "script a" and what is "script_b" ?
166 Views
0
Answers
3 years ago
one year ago