Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Unanswered
Is This A Bug? Clearml Version 1.26.4 Im Passing A List Of S3 Urls To Add_External_Files The List Is About 1K Of Files, But Only 7 Are Uploaded (Only Unique File Basenames) Here Is An Example: External_Files = [ '

Is this a bug? Clearml version 1.26.4

im passing a list of S3 urls to add_external_files
The list is about 1K of files, but only 7 are uploaded (only unique file basenames)

Here is an example:
external_files =
[
' s3://s3.our-host.com:443/bucket/data/ a /layout_with_depth.jpg ',
' s3://s3.our-host.com:443/bucket/data/ b /layout_with_depth.jpg ',
' s3://s3.our-host.com:443/bucket/data/ c /layout_with_depth.jpg ',
' s3://s3.our-host.com:443/bucket/data/ a /file.jpg ',
' s3://s3.our-host.com:443/bucket/data/ b /file.jpg ',
' s3://s3.our-host.com:443/bucket/data/ c /file.jpg ',
]

clearml_dataset.add_external_files(
external_files
)

It only uploads:
' s3://s3.our-host.com:443/bucket/data/ a /layout_with_depth.jpg '
' s3://s3.our-host.com:443/bucket/data/ a /file.jpg '

We traced the issue to dataset.py (see attached image)
image

  
  
Posted 6 months ago
Votes Newest

Answers

462 Views
0 Answers
6 months ago
6 months ago
Tags