Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
FrustratingSeagull27
Moderator
1 Question, 7 Answers
  Active since 08 December 2023
  Last activity 11 months ago

Reputation

0

Badges 1

7 × Eureka!
0 Votes
8 Answers
623 Views
0 Votes 8 Answers 623 Views
Hi everyone I am experiencing issues with delete_artifacts method. When I remove artifacts with default flag delete_from_storage=True the file actually disap...
11 months ago
0 Hi Everyone I Am Experiencing Issues With

PPS. My artifacts are folders with bunch of files that are getting archived. These doesn't happen when logging/removing pure Model objects

11 months ago
0 Hi Everyone I Am Experiencing Issues With

After task completion I still can see these two files:

11 months ago
0 Hi Everyone I Am Experiencing Issues With

I have found an ugly workaround to finally remove artifacts but I doubt that things should work like this:

# simulate training process
for epoch in range(NUM_EPOCHS):

    # task.mark_started(force=True)

    artifact_name = f'artifact_epoch_{epoch}'

    # upload
    task.upload_artifact(
        name=artifact_name,
        artifact_object=PATH_TO_ARTIFACT,
        wait_on_upload=True
    )

    # remove
    task.delete_artifacts(artifact_names=[artifact_name])

    # remove for sure
 ...
11 months ago
0 Hi Everyone I Am Experiencing Issues With

BTW, super weird that only two of them. I expect to have all of them removed or remain but actually only the last one was removed completely. And as I said before actual files were deleted so trying to download them will result in 404 error.

11 months ago
0 Hi Everyone I Am Experiencing Issues With

Besides, when I monitor manually the process I can see that artifacts also temporarily disappear in UI but then appear again. Looks like they are somehow automatically restored from cache or so. Can this be true and if yes how to disable such behaviour? Thanks again

11 months ago
0 Hi Everyone I Am Experiencing Issues With

Hi. Thanks for your response. Here is a snippet:

import os

from clearml import Task

# basic parameters
PATH_TO_ARTIFACT = '/app/artifact'
PROJECT_NAME = 'my_awesome_project'
TASK_NAME = 'my_awesome_task'
OUTPUT_URI = '
'
NUM_EPOCHS = 3


# create something to log in ClearML
if not os.path.exists(PATH_TO_ARTIFACT):
    os.makedirs(PATH_TO_ARTIFACT)

with open(os.path.join(PATH_TO_ARTIFACT, 'test.txt'), 'w') as f:
    f.write('very important data')


# create new task
task =...
11 months ago