Hey AgitatedDove14 , so i have gotten the latest server version (as shown in the image from the bottom right of the user profile page) and still no luck with a simple test example like this using clearml-1.0.6.rc2
from clearml import Task, StorageManager, Dataset, PipelineController
# Creating the pipeline
pipe = PipelineController(target_project= "pipeline-demo", default_execution_queue='128RAMv100', add_pipeline_tags=False)
pipe.add_step(name='predict', base_task_id='17cc79f0dae0426d9354fe08d979980a')
pipe.start()
# Wait until pipeline terminates
pipe.wait()
# cleanup everything
pipe.stop()
print('pipeline completed')
I think I found something, let me see if I can reproduce it
AverageBee39 I cannot reproduce it 😞 (at least on the latest from Github)
I'm assuming the pipeline is created with target_project
, anything else I need to add?
Hmm can you test with the latest RC? or even better from the GitHub (that said the Github will break the interface, as we upgraded the pipeline 🙂 )
make sure you follow all the steps :
https://clear.ml/docs/latest/docs/deploying_clearml/upgrade_server_linux_mac
(basically make sure you get the latest docker-compose.yml and the pull itcurl
-o /opt/clearml/docker-compose.yml docker-compose -f /opt/clearml/docker-compose.yml pull docker-compose -f /opt/clearml/docker-compose.yml up -d
the latest server is 1.1.1
https://github.com/allegroai/clearml-server/releases/tag/1.1.1
The release was supposed to be out this week, got delayed by some py2 support issue, anyhow the release will be almost exactly like the latest we now have on the GitHub repo (and I'm assuming it will be out just after the weekend)
Hmm that's strange... AgitatedDove14 i'm using the 1.0.5 pypi package as well as the most recent server from this command - curl https://raw.githubusercontent.com/allegroai/trains-server/master/docker/docker-compose.yml -o docker-compose.yml (iirc it should be 1.1.1)
oh ahahah you meant the sdk right? yea i noticed some new pipeline functionalities...was gonna wait for an official release but yea sure i will try it. Thanks mate!
oh okay i assumed the new docker-compose would pull the latest image. erm i pulled the new image from docker and restarted the server. But it still seems to be sending me the same error tho
Hi AverageBee39
What's the clearml-server and clearml packge you are using ?
(I looks like some capability that is missing from the server, i.e. needs upgrade ?!)
AgitatedDove14 yup it's with target project, the code was really just...
# Creating the pipeline
pipe = PipelineController(target_project= "pipeline-demo", default_execution_queue='default', add_pipeline_tags=False)
pipe.add_step(name='model-predict', base_task_id='17cc79f0dae0426d9354ds08d979980g')
pipe.start()
# Wait until pipeline terminates
pipe.wait()
# cleanup everything
pipe.stop()
print('pipeline completed')
AgitatedDove14 i'm still getting this error in 1.0.6rc2 tho
Exception in thread Thread-1:
Traceback (most recent call last):
File "/home/aaron/.pyenv/versions/3.7.8/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/aaron/.pyenv/versions/3.7.8/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/aaron/.pyenv/versions/dev_env/lib/python3.7/site-packages/clearml/automation/controller.py", line 937, in _daemon
if self._launch_node(self._nodes[name]) and not self._nodes[name].skip_job:
File "/home/aaron/.pyenv/versions/dev_env/lib/python3.7/site-packages/clearml/automation/controller.py", line 643, in _launch_node
project_name=self._target_project)
File "/home/aaron/.pyenv/versions/dev_env/lib/python3.7/site-packages/clearml/backend_interface/util.py", line 56, in get_or_create_project
res = session.send(projects.GetAllRequest(name=exact_match_regex(project_name), only_fields=['id']))
AttributeError: 'property' object has no attribute 'send'