Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UpsetCrow72
Moderator
2 Questions, 2 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

2 × Eureka!
0 Votes
5 Answers
646 Views
0 Votes 5 Answers 646 Views
Hi
Hi 👋 I'm trying to remove a few files from a dataset, which has been finalized already with .finalize() . Both with $ clearml-data sync and with $clearml-da...
one year ago
0 Votes
1 Answers
577 Views
0 Votes 1 Answers 577 Views
Hey, Is There Some Way / Workaround To Speed Up Working With Datasets With Large Number Of Files? Getting A Local Copy Of One Of Our Dataset With 70K Files Already Takes Longer Than Expected, But Working With A Dataset Of Around 100K Files That Has Multip
Hey, is there some way / workaround to speed up working with datasets with large number of files? Getting a local copy of one of our dataset with 70k files a...
one year ago
0 Hi

hi CostlyOstrich36 , sorry, let me make it a bit more clear.

I simply upload a bunch of files as a new dataset using the Python API. Then using the CLI I get a local copy where I remove a few of the files. At this step, I tried both simply removing them from the file-system and then using $ clearml-data sync , and also using $ clearml-data remove . I get an error, invalid status, but the result is the same as I described above: file count was updated, but when I get a new local...

one year ago
0 Hi

I'm getting it by $ clearml-data get --id <id> --copy <local_path> and then this is the log output of $ clearml-data remove --id <id> --files <files>

` clearml-data - Dataset Management & Versioning CLI
Removing files/folder from dataset id 2a0eb9ab619c442abc204775f217d0b9
2022-09-19 13:44:12,964 - clearml.Task - ERROR - Action failed <400/110: tasks.add_or_update_artifacts/v2.10 (Invalid task status: expected=created, status=completed)> (task=2a0eb9ab619c442abc204775f217d0b9, ar...

one year ago