Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
FrustratingSeagull27
Moderator
1 Question, 7 Answers
  Active since 08 December 2023
  Last activity one year ago

Reputation

0

Badges 1

7 × Eureka!
0 Votes
8 Answers
672 Views
0 Votes 8 Answers 672 Views
Hi everyone I am experiencing issues with delete_artifacts method. When I remove artifacts with default flag delete_from_storage=True the file actually disap...
one year ago
0 Hi Everyone I Am Experiencing Issues With

Hi. Thanks for your response. Here is a snippet:

import os

from clearml import Task

# basic parameters
PATH_TO_ARTIFACT = '/app/artifact'
PROJECT_NAME = 'my_awesome_project'
TASK_NAME = 'my_awesome_task'
OUTPUT_URI = '
'
NUM_EPOCHS = 3


# create something to log in ClearML
if not os.path.exists(PATH_TO_ARTIFACT):
    os.makedirs(PATH_TO_ARTIFACT)

with open(os.path.join(PATH_TO_ARTIFACT, 'test.txt'), 'w') as f:
    f.write('very important data')


# create new task
task =...
one year ago
0 Hi Everyone I Am Experiencing Issues With

I have found an ugly workaround to finally remove artifacts but I doubt that things should work like this:

# simulate training process
for epoch in range(NUM_EPOCHS):

    # task.mark_started(force=True)

    artifact_name = f'artifact_epoch_{epoch}'

    # upload
    task.upload_artifact(
        name=artifact_name,
        artifact_object=PATH_TO_ARTIFACT,
        wait_on_upload=True
    )

    # remove
    task.delete_artifacts(artifact_names=[artifact_name])

    # remove for sure
 ...
one year ago
0 Hi Everyone I Am Experiencing Issues With

BTW, super weird that only two of them. I expect to have all of them removed or remain but actually only the last one was removed completely. And as I said before actual files were deleted so trying to download them will result in 404 error.

one year ago
0 Hi Everyone I Am Experiencing Issues With

After task completion I still can see these two files:

one year ago
0 Hi Everyone I Am Experiencing Issues With

PPS. My artifacts are folders with bunch of files that are getting archived. These doesn't happen when logging/removing pure Model objects

one year ago
0 Hi Everyone I Am Experiencing Issues With

Besides, when I monitor manually the process I can see that artifacts also temporarily disappear in UI but then appear again. Looks like they are somehow automatically restored from cache or so. Can this be true and if yes how to disable such behaviour? Thanks again

one year ago