This ^
If you're not getting any errors, it should work just fine 🙂

In https://github.com/thepycoder/urbansounds8k/blob/main/preprocessing.py i'm seeing dataset_task.get_logger().report_image , dataset_task.get_logger().report_table , dataset_task.get_logger().report_histogram and dataset_task.get_logger().report_media which are all manual loggings. Hence, why the author probably didn't use any automatic logging.

Could you test again with
https://clear.ml/docs/latest/docs/references/sdk/task/#mark_completed ?

Does this help? https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server#what-is-clearml-server

ScaryBluewhale66 you shouldn't call mark_* on the main task, we're adding this as a notice and in documentation in the next release: https://github.com/allegroai/clearml/issues/830

Could you elaborate on S3 checkpoint name?
I'm assuming it's a filename?
Possibly post those few lines of code?

We checked in the UI and if the model description is edited with double spaces, they remain, so the problem is likely somewhere in the SDK.

Happy to help :)

Do you mean in the WebUI or via the API?

I'm not sure about the preview part but after uploading I think you might find the images with list and --filter
https://clear.ml/docs/latest/docs/clearml_data/clearml_data_cli#list
I'm not sure if that helps?

you can pass use the compression parameter in dataset.upload . The supported values are:
ZipFile.ZIP_STORED (no compression) ZipFile.ZIP_DEFLATED (requires zlib) ZipFile.ZIP_BZIP2 (requires bz2) ZipFile.ZIP_LZMA (requires lzma)Note that you need to import ZipFile beforehand: from zipfile import ZipFile
You're probably looking for ZIP_BZIP2 , but I'm not sure about that.

There seems to be a discrepancy in the docs I'm trying to figure out and solve.
Most of the statuses are more explained here: https://clear.ml/docs/latest/docs/fundamentals/task/#task-states

Closed isn't yet.
Close is normally for manually closing a task: https://clear.ml/docs/latest/docs/references/sdk/task#close
You'll find more info here: https://clear.ml/docs/latest/docs/clearml_sdk/task_sdk/ and here: https://clear.ml/docs/latest/docs/guides/advanced/multiple_tasks_single_process

Have you tried --verbose ?

You can disable it if you want to. Sometimes it's useful to retrace your steps but it works without :)

https://clear.ml/docs/latest/docs/webapp/webapp_exp_track_visual/#installed-packages

I know zip and tar.gz are supported for auto extraction. But you're looking for a setting to have artifacts compressed with tar instead of zip?

Do you mean what's visible in the UI, projects -> Execution: Installed Packages?

If I'm 'ot mistaken closed status should only appear when you've used Close ()

That doesn't seem normal, let me ask around and get back to you

PricklyRaven28 I think then you're looking for: ZipFile.ZIP_STORED

You can find more info here: https://clear.ml/docs/latest/docs/references/sdk/task#taskforce_requirements_env_freeze

Could it be multiple metrics that were combined into a single metric later on? Before the optimizer?

Can you elaborate on question #2?
Do you want to reuse a task or something else?

Well seems like you have a solution for now?

If you still want to run it as a notebook, the following should make pip install the required packages:

import sys !{sys.executable} -m pip install -r requirements.txt
I'll check if this something we need to update in our documentation or if it's a bug.

It should, or you might need to nest the objects.
Edit: I asked, it won't there's a difference in configs I mixed up.

ReassuredTiger98 you can set different parameters per task:
https://clear.ml/docs/latest/docs/clearml_sdk/task_sdk#configuration

If you're just looking to reuse virtual environments, have a look here: https://clear.ml/docs/latest/docs/clearml_agent/#environment-caching

That's interesting, I don't know enough to answer though. :/ AnxiousSeal95 do you happen to know if this is expected behavior? Or how to have the desired outcome?

no this should work with this one. I'll double check if I'm remembering it correctly but I thought you should be able to start a task after loading your own configuration object, where can set the agent.package_manager.system_site_packages = true .

You can fix this by using a requirements.txt or the --packages parameter
https://clear.ml/docs/latest/docs/apps/clearml_task/#package-dependencies

Is this after you've started the clearML server that you can't find the experiments?

To use a specific binary you can set in in the config: https://clear.ml/docs/latest/docs/configs/clearml_conf/#:~:text=python%20version%20(default)-,agent.python_binary,-(string)

But if you're trying to cache virtual environments you might be more interested in: https://clear.ml/docs/latest/docs/clearml_agent#environment-caching