Don't call PipelineController functions after start has finished. Use a post_execute_callback instead
` from clearml import PipelineController
def some_step():
return
def upload_model_to_controller(controller, node):
print("Start uploading the model")
if name == "main":
pipe = PipelineController(name="Yolo Pipeline Controller", project="yolo_pipelines", version="1.0.0")
pipe.add_function_step(
name="some_step",
function=some_st...
I meant the code where you upload an artifact, sorry
Hi @<1643060801088524288:profile|HarebrainedOstrich43> ! The rc is now out and installable via pip install clearml==1.14.1rc0
One more question FierceHamster54 : what Python/OS/clearml version are you using?
We would appreciate a PR! Just open a GH issue, the the PR and we will review it
FierceHamster54 As long as you are not forking, you need to use Task.init such that the libraries you are using get patched in the child process. You don't need to specify the project_name , task_name or outpur_uri . You could try locally as well with a minimal example to check that everything works after calling Task.init .
Hi @<1654294828365647872:profile|GorgeousShrimp11> ! add_tags is an instance method, so you will need the controller instance to call it. To get the controller instance, you can do PipelineDecorator.get_current_pipeline() then call add_tags on the returned value. So: PipelineDecorator.get_current_pipeline().add_tags(tags=["tag1", "tag2"])
FierceHamster54initing the task before the execution of the file like in my snippet is not sufficient ?It is not because os.system spawns a whole different process then the one you initialized your task in, so no patching is done on the framework you are using. Child processes need to call Task.init because of this, unless they were forked, in which case the patching is already done.
` But the training.py has already a CLearML task created under the hood since its integratio...
Hi FierceHamster54 ! Did you call Task.init() in train.py ?
FierceHamster54 I understand. I'm not sure why this happens then 😕 . We will need to investigate this properly. Thank you for reporting this and sorry for the time wasted training your model.
DeliciousKoala34 can you upgrade to clearml==1.8.0 ? the issue should be fixed now