Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Logger = Logger.Current_Logger() Logger.Report_Media( Title="Test", Series="Audio", Local_Path="/Path/To/File.Wav", Iteration=1, Max_History=-1 )

logger = Logger.current_logger() logger.report_media( title="test", series="audio", local_path="/path/to/file.wav", iteration=1, max_history=-1 )Hello ๐Ÿ™‚ Iโ€™m doing this, but the file isnโ€™t uploaded to the S3 bucket as Iโ€™d expect. It is uploaded to the ClearML server instead.
In the main python file I do Task.init(โ€ฆ, output_uri=" s3://mybucket ")
Is this a bug or am I doing something wrong? thank you

  
  
Posted 2 years ago
Votes Newest

Answers 9


Hi RattyLouse61 , what do you see in the log of the run?

I think that by default debug samples are usually saved on the fileserver. The following configuration should force the debug samples to upload to s3.
In clearml.conf change:
api.files_server: s3://your_bucket

  
  
Posted 2 years ago

I canโ€™t see any useful line in the log. Iโ€™ll try the function. Thanks

  
  
Posted 2 years ago

RattyLouse61 , SuccessfulKoala55 , I think your solution is better ๐Ÿ™‚

  
  
Posted 2 years ago

maybe I need to call this:

My thoughts exactly ๐Ÿ™‚

  
  
Posted 2 years ago

Your suggestion CostlyOstrich36 works: Iโ€™ve added the line in the clearml.conf file.

However, now when I go in the Results -> Debug Samples tab, the s3 credential window pops up. Every time that I refresh the page ๐Ÿ˜ž

  
  
Posted 2 years ago

However, now when I go in the Results -> Debug Samples tab, the s3 credential window pops up. Every time that I refresh the page

RattyLouse61 , What version of ClearML are you running, I think this issue was solved in 1.3.0 release

  
  
Posted 2 years ago

I was on 1.2.0
Upgrading to 1.3.0 resolved the issue with S3 credentials request ๐Ÿ™‚
thank you

  
  
Posted 2 years ago

Iโ€™m getting this error:
2022-04-01 16:23:47,578 - clearml.storage - ERROR - Failed testing access to bucket xxx: incorrect region specified for bucket xxxx (detected region eu-west-1)but the server knows how to do the upload because I can do task.upload_artifact without problems ๐Ÿค”

  
  
Posted 2 years ago
618 Views
9 Answers
2 years ago
one year ago
Tags