I created it with clearml-init, nothing special. It looks like

# ClearML SDK configuration file api { # Notice: 'host' is the api server (default port 8008), not the web server. api_server: web_server: files_server: # Credentials are generated using the webapp, `
# Override with os environment: CLEARML_API_ACCESS_KEY / CLEARML_API_SECRET_KEY
credentials {"access_key": "NMWOE5C3RGTX473M9D3M", "secret_key": "L@G50jO+TJ23#8Eerp1E$4y=elUt11P!BL...

Yes, now I new unique folder is created per experiment where the predictions are saved. That works. The only thing is that now there is the folder that clearml makes for an experiment and the folder that saves the resuts. So two folders with artifacts per experiment. I was wondering if there was a more efficient solution and if it could be combined.

Okay, I am working with medical images. And when running a testing script I want to save the predictions (also big medical images of another modality). What happens when I do logger.upload_artifact(..). Then a file is copied to this folder?

I dont see that option in my ~/clearml.conf?

Yes other then the link it generates it works fine

Okay, so I have to first save the generated image somewhere and then with logger.report_media it is copied to the folder?

Some of the experiments are done on a GCP instance instead of the local server on which we also run ClearML. The experiments running on GCP report to the same local clearml server, but the IP address for clearml configured on the GCP instance is different (and then forwarded). Is this the problem?

I see, will it be possible in the future to directly write custom/not supported formats to the folder? Because we are working with very big files, having them stored at multiple locations is something we try to avoid

I see task.get_output_destination() returns a url like http://localhost:8081 . Is it possible to get the folder with the artifacts/models?

This is the full log

done, see https://github.com/allegroai/clearml/issues/489

Okay finalize works. I was looking here: https://github.com/allegroai/clearml/blob/master/docs/datasets.md

I was looking for all the metric names, similar as what you get when clicking the '+ metric' in customize columns. But turns out I will implement it in a different way, not needed anymore

and None

This was with using one task in a multiprocessing.pool and the next one in the main process. I switched to have all tasks in a separate process via ProcessPoolExecutor and now it runs fine 👍 (version 0.17.5)

see None

how do I install the RC?

` Backend TkAgg is interactive backend. Turning interactive mode on.
Traceback (most recent call last):
File "/snap/pycharm-community/226/plugins/python-ce/helpers/pydev/_pydevd_bundle/pydevd_frame.py", line 747, in trace_dispatch
self.do_wait_suspend(thread, frame, event, arg)
File "/snap/pycharm-community/226/plugins/python-ce/helpers/pydev/_pydevd_bundle/pydevd_frame.py", line 144, in do_wait_suspend
self._args[0].do_wait_suspend(*args, **kwargs)
File "/snap/pycharm-community...

In the process MyProcess other processes are created via a ProcessPoolExecutor. In these processes calls to logger.report_matplotlib_figure are made, but I get the same issue when I remove these calls.

It looks like I don't have hanging issues when I use mp.set_start_method('spawn') at the top of the script.

I don't have a fully reproducilble example that I can share, sorry for that

self-hosted

nice, will give it a try

Yes, I add these metrics as extra columns and then I sort them. I want to know which experiments performs best in daylight for example or which during night. Therefore I think a is not the right choice

Thanks, that was it

With a name of 98 characters errors like 'munmap_chunk(): invalid pointer',
'double free or corruption (!prev)' or 'free(): invalid next size (normal) occur later in my script. But maybe this is not related to clearml but to the filesystem. Just wondering if there was a maximum length from the clearml side

yep

Yes, it did I think that makes sense

Thanks !

Is there a way to test this? It seems my git user and token are correct. I can do git clone https://<NAME_TOKEN >:<ACCESSTOKEN> gitlab.com/mycompany/repo.git

However when starting the service it fails with:

cloning: git@gitlab.com:mycompany/repo.git
Using user/pass credentials - replacing ssh url

:mycompany/repo.git' with https url '

'
2021-01-18 20:04:08
User aborted: stopping task (3)

Any idea when this will be fixed?

👍