Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
What Is The Current State Of Deleting Debug Samples? I Use S3/Minio As My Fileserver. If I Delete Tasks From The Ui, Are Debug Samples Deleted On S3? If I Run The Cleanup Service Script, Does It Debug Samples On S3?

What is the current state of deleting debug samples? I use s3/minio as my fileserver. If I delete tasks from the UI, are debug samples deleted on S3? If I run the Cleanup Service script, does it debug samples on S3?

  
  
Posted one year ago
Votes Newest

Answers 8


Hi @<1523701868901961728:profile|ReassuredTiger98> , how exactly do you override the values in storage_credentials file? Do you prepare a new docker image with the changed file or map this file from outside with the volume mapping in the docker compose or through the env variables? What is also important is that you do this override for the async_delete service. It is the service that actually uses the storage credentials. Not the apiserver itself

  
  
Posted one year ago

@<1523701994743664640:profile|AppetizingMouse58> Thank you very much. I forgot the volume mapping.
So can I just add the config to the async_delete container and mirror the directory structure from github?

volumes:
    - /opt/clearml/config:/opt/clearml/config
    - /opt/clearml/logs:/var/log/clearml
  
  
Posted one year ago

Hi @<1523701087100473344:profile|SuccessfulKoala55> Thank you very much.
Is there some way to verify the server uses the correct configuration files? (E.g. see it in the logs/web ui). I Just tried it does not work.
At least I can see the async_delete service complains about a missing secret, so I can start debugging there. I am using the same config as for my agents, but somehow for async_delete it does not work...

  
  
Posted one year ago

Hi @<1523701868901961728:profile|ReassuredTiger98> , deleting debug images is supported when using the SDK to delete experiments, and can also be supported on the server side (e.g. when delete requests are sent from the UI) - for the latter you'll need to make sure the server has the correct credentials configured under the storage_credentials section in the services.conf server configuration file which you can add un the clearml server configuration folder. See here for more details.

  
  
Posted one year ago

And the files that I see on github are the default configuration of the server, even if I do not have these files in my installation, right?

Correct

  
  
Posted one year ago

It works! Thank you very much 🙂

  
  
Posted one year ago

I just wanna avoid that ClearML leaves files lingering around. Btw: a better default behavior in my opinion would be to delete tasks only after files have been deleted. And only with the force option to delete the task anyways!

  
  
Posted one year ago

And the files that I see on github are the default configuration of the server, even if I do not have these files in my installation, right?

  
  
Posted one year ago
1K Views
8 Answers
one year ago
one year ago
Tags
Similar posts