Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Is There A Way To Retrieve The Debug Samples Logged By Clearml (Or At Least Retrieve Their S3 Links) Via The Python Api?

Is there a way to retrieve the debug samples logged by ClearML (or at least retrieve their s3 links) via the python API?

  
  
Posted 2 years ago
Votes Newest

Answers 12


that works šŸ™‚

  
  
Posted 2 years ago

RattyLouse61 , the API will retrieve the URLs for the debug samples. You can then download them manually. If you want these debug samples accessible by other tasks via SDK you might need to save them as artifacts, however you won't have visibility via the UI for those (like playing audio in debug samples section)

  
  
Posted 2 years ago

thanks CostlyOstrich36

  
  
Posted 2 years ago

is https://clear.ml/docs/latest/docs/faq/#clearml-api the only place to see how to use the backend_api?

  
  
Posted 2 years ago

hi RattyLouse61
here is a code example, i hope it will help you to understand better the backend_api.

` from clearml import Task, Logger
from clearml.backend_api import Session
from clearml.backend_api.services import events

task = Task.get_task('xxxxx', 'xxxx')
session = Session()
res = session.send(events.GetDebugImageSampleRequest(
task=task.id,
metric=title,
variant=series)
)
print(res.response_data) `

  
  
Posted 2 years ago

thank you so much SweetBadger76

  
  
Posted 2 years ago

however, Iā€™m not able to get the audio excerpts uploaded as debug samples. Your suggestion above requires to use REST api via clearml.backend_api but Iā€™m not very much familiar with it

  
  
Posted 2 years ago

hope it will help. keep me informed šŸ™‚

  
  
Posted 2 years ago

I think this is the API you're looking for šŸ™‚
https://clear.ml/docs/latest/docs/references/api/events#post-eventsdebug_images
This should return what you're looking for. You can see a usage example in the developer tools when viewing debug samples in the UI

  
  
Posted 2 years ago

RattyLouse61 , from what I can find - Yes. I've seen some examples shared on the community as well. Is there something specific you're looking for?

  
  
Posted 2 years ago

some actions can be done using clearml.Task , for instance get a local copy of a model, pull down the scalars etc.

  
  
Posted 2 years ago

Iā€™d like to programmatically (e.g. jupyter notebook) retrieve files/info related to a task from the server

  
  
Posted 2 years ago
1K Views
12 Answers
2 years ago
one year ago
Tags