Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone! I'M Using Minios3 As A File Server And As Default Output Uri. I'Ve Faced The Following Problem. When I Delete Tasks From Web Ui (And Also From Archive) Their Artifacts Didn'T Get Deleted From S3. I'M Using Self Hosted Clearml==1.11. What Shou

Hi everyone! I'm using minioS3 as a file server and as default output uri. I've faced the following problem. When I delete tasks from web ui (and also from archive) their artifacts didn't get deleted from s3. I'm using self hosted clearml==1.11. What should I do to delete task and it's s3 artifacts simultaneously?
image
image
image

  
  
Posted 9 months ago
Votes Newest

Answers 13


Hi @<1585078752969232384:profile|FantasticDuck7> , there is an apiserver configuration file apiserver->config->default->services->storage_credentials.conf
It contains the parameters for accessing files on the external storages like s3, google or azure. Please provide the same minio server access parameters as you do for the SDK configuration.
The actual deletion is performed by the async_delete service. You can inspect its logs with "sudo docker logs async_delete" command. Before configuring the access params it is likely that you will see the errors in the logs about missing s3 credentials. After configuring the logs and restarting the server you should see successful deletions of the requested files. It will not handle the files that failed prior to the change but the new deletions should work

  
  
Posted 9 months ago

@<1585078752969232384:profile|FantasticDuck7> The best would be to copy this file to the host, edit it and map this file into the container instead of the original one. The single file mapping in the docker-compose file should look like this:

    volumes:
      - type: bind
        source: <the path to the config file on the host>
        target: /opt/clearml/apiserver/config/default/services/storage_credentials.conf

You should do it for the async_delete service. Not for the apiserver

  
  
Posted 9 months ago

@<1523701994743664640:profile|AppetizingMouse58> Hi! Thank you for a quick response! Should I edit the configuration file directly in apiserver container like in screenshot? Is there a better, more consistent way to do that (I don't want to edit this config again if I recreate container for some reason) ?
image

  
  
Posted 9 months ago

@<1585078752969232384:profile|FantasticDuck7> best thing would be to put that in the /opt/clearml/config free which is already mapped into the server configuration. Easiest would be to put that in a services.conf file and add a top key there named storage_credentials under which you can put the same configuration

  
  
Posted 9 months ago

@<1523701994743664640:profile|AppetizingMouse58> Thanks a lot! That worked ☺

  
  
Posted 9 months ago

🙂

  
  
Posted 9 months ago

@<1585078752969232384:profile|FantasticDuck7> What volume mappings do you have for the async_delete service in the docker-compose.yaml file?

  
  
Posted 9 months ago

@<1523701994743664640:profile|AppetizingMouse58>
image

  
  
Posted 9 months ago

Hi! Try excluding “http/https” from the uri in the config. Have you configured your client correctly?Try adding “output_uri” (or smth like that) when initializing your Task.

  
  
Posted 7 months ago

Hello @<1585078752969232384:profile|FantasticDuck7> , can you explain step by step for minio setup. I tried that too, but i got error when uploading object like in this thread: None .

  
  
Posted 7 months ago

@<1523701087100473344:profile|SuccessfulKoala55> Thank you! I think I've done something wrong (It doesn't delete now). Correct me please

  • I've created file on clearml host machine /opt/clearml/config/services.conf with content as in the pic
  • Restarted container with docker restart async-delete
    image
  
  
Posted 9 months ago

Ok, so there is no mapping for the whole config folder or specific config file that you changed. That's why async_delete does not get your updated configuration. You can do one of the following: either add here mapping for the specific file like you did earlier or map the whole config folder like apiserver service does:

  • /opt/clearml/config:/opt/clearml/config
    The second way is probably more flexible
  
  
Posted 9 months ago

@<1523701994743664640:profile|AppetizingMouse58> @<1523701087100473344:profile|SuccessfulKoala55> It worked as intended! Thank you once again :hugging_face:

  
  
Posted 9 months ago
534 Views
13 Answers
9 months ago
7 months ago
Tags