Reputation
Badges 1
61 × Eureka!Yes other then the link it generates it works fine
Yes I see:
"The default location for output models and other artifacts. If True is passed, the default files_server will be used for model storage. In the default location, ClearML creates a subfolder for the output. The subfolder structure is the following: <output destination name> / <project name> / <task name>.<Task ID>"
So it makes a folder in the output destination <project_name>/<task name>.<Task ID>. It is not possible to specify the full output destination right?
No problems with this example, I will try to create a reproducible example
And is there an easy way to get all the metrics associated with a project?
it is the same with rc4. Under the variables tab it keeps hanging on 'collecting data...' OS: Ubuntu 18.04, PyCharm CE 2020.3
I restarted the cleanup service. Now I get some messages like this:
2021-07-16 12:39:46,736 - clearml.storage - ERROR - Failed creating storage object file:// Reason: 'NoneType' object has no attribute 'replace'
2021-07-16 12:39:46,736 - clearml.Task - ERROR - Failed deleting None: 'NoneType' object has no attribute 'delete'
WARNING:root:Could not delete Task ID=eb11c92928af477e9e732d0cad47a57e, sequence item 0: expected str instance, NoneType found
any idea?
It is for storing the predictions a trained model makes, so two different models do create slightly different images
btw the same happens when I try this on localhost
# ClearML SDK configuration file api { # Notice: 'host' is the api server (default port 8008), not the web server. api_server:
web_server:
files_server:
# Credentials are generated using the webapp,
# Override with os environment: CLEARML_API_ACCESS_KEY / CLEARML_API_SECRET_KEY
Updated docker-compose from 1.17 to 1.24.1 and using the latest docker-compose.yml solves the issue, thanks
Is there also a method to get all the project names?
upgrading to? 2020.3.3 is the latest version? https://www.jetbrains.com/pycharm/download/other.html
Thanks ClearML team, is there an example of the metric snapshot plot in the project overview UI available in the demo dashboard?
Okay finalize works. I was looking here: https://github.com/allegroai/clearml/blob/master/docs/datasets.md
` Backend TkAgg is interactive backend. Turning interactive mode on.
Traceback (most recent call last):
File "/snap/pycharm-community/226/plugins/python-ce/helpers/pydev/_pydevd_bundle/pydevd_frame.py", line 747, in trace_dispatch
self.do_wait_suspend(thread, frame, event, arg)
File "/snap/pycharm-community/226/plugins/python-ce/helpers/pydev/_pydevd_bundle/pydevd_frame.py", line 144, in do_wait_suspend
self._args[0].do_wait_suspend(*args, **kwargs)
File "/snap/pycharm-community...
I created it with clearml-init, nothing special. It looks like
# ClearML SDK configuration file api { # Notice: 'host' is the api server (default port 8008), not the web server. api_server:
web_server:
files_server:
# Credentials are generated using the webapp,
`
# Override with os environment: CLEARML_API_ACCESS_KEY / CLEARML_API_SECRET_KEY
credentials {"access_key": "NMWOE5C3RGTX473M9D3M", "secret_key": "L@G50jO+TJ23#8Eerp1E$4y=elUt11P!BL...
Yes, I add these metrics as extra columns and then I sort them. I want to know which experiments performs best in daylight for example or which during night. Therefore I think a is not the right choice
I see, will it be possible in the future to directly write custom/not supported formats to the folder? Because we are working with very big files, having them stored at multiple locations is something we try to avoid
Okay, I am working with medical images. And when running a testing script I want to save the predictions (also big medical images of another modality). What happens when I do logger.upload_artifact(..). Then a file is copied to this folder?
This was with using one task in a multiprocessing.pool and the next one in the main process. I switched to have all tasks in a separate process via ProcessPoolExecutor and now it runs fine 👍 (version 0.17.5)
I see this indeed when I create a new project with an empty description. Is this also possible for older project created before clearml 1.0? For these projects this button is not there
Ubuntu 18.04 and python 3.6. the subprocess is done by subclassing multiprocessing.Process and then calling the .start() method