Hi @<1577468626967990272:profile|PerplexedDolphin99> , I don't think there is such direct API call
Because I think you need to map out the pip cache folder to the docker
Hi @<1726047624538099712:profile|WorriedSwan6> , ideally the pipeline controller would be running on the services agent which is part of the server deployment and does not require GPU resources at all
Yes, you'll need to connect them via code
Hi BroadSeaturtle49 , what versions of clearml-agent
& clearml
are you using? What OS is this?
MagnificentWorm7 , I'm taking a look if it's possible š
As a workaround - I think you could split the dataset into different versions and then use Dataset.squash
to merge into a single dataset
https://clear.ml/docs/latest/docs/references/sdk/dataset#datasetsquash
Looks like a permissions issue:nested: IOException[failed to test writes in data directory [/usr/share/elasticsearch/data/nodes/0/indices/mQ-x_DoZQ-iZ7OfIWGZ72g/_state] write permission is required]; nested
Hi YummyFish22 , how did you arrive at this error message?
Please do. You can download the entire log from the UI š
I'm afraid I don't have anything like that š
I think it is supported only through the API š
So just rescaling the graph to see 0-1 is what you're looking for?
GiganticTurtle0 , does it pose some sort of problem? What version are you using?
PanickyMoth78 , if I'm not mistaken that should be the mechanism. I'll look into that š
Does it give you any error while deleting the experiments?
Can you try upgrading to the latest agent version? pip install -U clearml-agent
Hi @<1544853721739956224:profile|QuizzicalFox36> ,
You can use StorageManager.download_file()
to easily fetch files.
None
I think as specified here:
https://github.com/allegroai/clearml-server/blob/master/docker/docker-compose.yml#L125
It can take some time if the file is very large or if the folder is very large. This can also depend on the connectivity. If the folder is very large please consider the fact that zipping it also can be resource demanding.
How long has it been hanging and how large is it the folder?
ScaryLeopard77 , Hi! Is there a specific reason to the aversion from pipelines? What is the use case?
"continue with this already created pipeline and add the currently run task to it"
I'm not sure I understand, can you please elaborate? (I'm pretty sure it's a pipelines feature)
I think I've encountered something related to this. Let me take a look at the docs
Hi @<1670964701451784192:profile|SteepSquid49> , that sounds like the correct setup š
What were you thinking of improving or do you have some pain points in your current setup?
Hi, what version of clearml-agent are you using? Does this always happen? Can you add your clearml.conf
file here(Make sure to remove any credentials/personal data)?
Hi @<1523701601770934272:profile|GiganticMole91> , I think you can delete those indices
Do you have a custom certificate for SSL by chance? If this is the case please see the following:
https://github.com/allegroai/clearml/issues/7
The solution would be changing the following to false:
https://github.com/allegroai/clearml/blob/9624f2c715df933ff17ed5ae9bf3c0a0b5fd5a0e/docs/clearml.conf#L16
Only news ones after you use SDK 1.6.0 š