Are you running it with docker?

Could you elaborate on S3 checkpoint name?
I'm assuming it's a filename?
Possibly post those few lines of code?

We checked in the UI and if the model description is edited with double spaces, they remain, so the problem is likely somewhere in the SDK.

Could you test the following:
Without reusing the virtual environment you made manually:
Can you run a task twice and see if the second run is at least reusing the virtual environment of the first run?

And in the logs?

Is this after you've started the clearML server that you can't find the experiments?

If you're looking for what docker volumes were used, that's in the docker compose file:
https://github.com/allegroai/clearml-server/blob/master/docker/docker-compose.yml

Just checking, are you just trying to use a different docker image in a task? Because then you might want to use this: https://clear.ml/docs/latest/docs/apps/clearml_task/#docker
https://clear.ml/docs/latest/docs/clearml_agent#docker-mode

Can you try: '${pipeline.docker_image}' ?

You can use https://clear.ml/docs/latest/docs/references/sdk/task/#taskget_project_id to get the id of the last updated project with that name

So could you just setup your virtual environment with a task?

PricklyRaven28 I think then you're looking for: ZipFile.ZIP_STORED

I know zip and tar.gz are supported for auto extraction. But you're looking for a setting to have artifacts compressed with tar instead of zip?

For pipelines there's currently no way to use different compressions. You can still use it when explicitly uploading https://clear.ml/docs/latest/docs/references/sdk/dataset/#upload

you can pass use the compression parameter in dataset.upload . The supported values are:
ZipFile.ZIP_STORED (no compression) ZipFile.ZIP_DEFLATED (requires zlib) ZipFile.ZIP_BZIP2 (requires bz2) ZipFile.ZIP_LZMA (requires lzma)Note that you need to import ZipFile beforehand: from zipfile import ZipFile
You're probably looking for ZIP_BZIP2 , but I'm not sure about that.

Could you upload the log so I can have a look?

That's pretty weird. I don't see any clear indications something is wrong, it simply doesn't execute the rest it would seem. Did it successfully run the first time before cloning it?

ZanyPig66 maybe this example can help?
https://github.com/allegroai/clearml/blob/master/examples/frameworks/pytorch/tensorboard_toy_pytorch.py

You could also try to upload an image or directory:
https://clear.ml/docs/latest/docs/guides/reporting/artifacts/#image-files

Can you elaborate on question #2?
Do you want to reuse a task or something else?

You can use the same project name and the same Taskname if that helps?

I don't think it's possible to set a custom ID if it doesn't exist yet. But I'll double check!

In this particular case using a naming convention is probably the best answer.
If you already have a naming convention for projects, you could just reuse that to prevent confusion :)

I'm not sure if you can delete it when using pipelines but I would say try it on a new project?

It looks like there is this option under Settings->Configuration->Show Hidden Projects

You can set where to store it via this config file: https://clear.ml/docs/latest/docs/fundamentals/artifacts/#setting-upload-destination

Can you elaborate on the hidden project? Is this part of a task you created and something is not showing up?

I also learned :p

Do you mean in the WebUI or via the API?

There seems to be a discrepancy in the docs I'm trying to figure out and solve.
Most of the statuses are more explained here: https://clear.ml/docs/latest/docs/fundamentals/task/#task-states

Closed isn't yet.
Close is normally for manually closing a task: https://clear.ml/docs/latest/docs/references/sdk/task#close
You'll find more info here: https://clear.ml/docs/latest/docs/clearml_sdk/task_sdk/ and here: https://clear.ml/docs/latest/docs/guides/advanced/multiple_tasks_single_process

ScaryBluewhale66 you shouldn't call mark_* on the main task, we're adding this as a notice and in documentation in the next release: https://github.com/allegroai/clearml/issues/830

Could you test again with
https://clear.ml/docs/latest/docs/references/sdk/task/#mark_completed ?

ExasperatedCrab78 do you know how this could be?