It looks like there is this option under Settings->Configuration->Show Hidden Projects

You can set where to store it via this config file: https://clear.ml/docs/latest/docs/fundamentals/artifacts/#setting-upload-destination

I also learned :p

Or you can just load a config file or object: https://clear.ml/docs/latest/docs/references/sdk/task/#connect_configuration

Could you upload the log so I can have a look?

AnxiousSeal95 Do you know this one?

Could it be multiple metrics that were combined into a single metric later on? Before the optimizer?

Just checking, are you just trying to use a different docker image in a task? Because then you might want to use this: https://clear.ml/docs/latest/docs/apps/clearml_task/#docker
https://clear.ml/docs/latest/docs/clearml_agent#docker-mode

Could you try to see if it does work when you log those manually?
https://clear.ml/docs/latest/docs/clearml_sdk/model_sdk#manually-logging-models

You can configure what to log and what not in the task init: https://clear.ml/docs/latest/docs/clearml_sdk/task_sdk/#automatic-logging

You can turn it all off by setting auto_connect_frameworks to false but you can do a finer grained control of logged frameworks with framework-boolean pairs

I think if you use explicit logging it only logs things you've selected but I'm not entirely sure
https://clear.ml/docs/latest/docs/guides/reporting/clearml_logging_example/

You can definitely turn off logging partially or completely: https://clear.ml/docs/latest/docs/clearml_sdk/task_sdk#automatic-logging

I'm not aware of changing this during the execution of the task (you'll have to set this in task.init) but you can manually log what you need after you (partially) turned off logging.

That's pretty weird. I don't see any clear indications something is wrong, it simply doesn't execute the rest it would seem. Did it successfully run the first time before cloning it?

PIP can install from git repositories!
So you can point to your own repository or even a specific commit hash.

https://pip.pypa.io/en/stable/topics/vcs-support/

That doesn't seem normal, let me ask around and get back to you

no this should work with this one. I'll double check if I'm remembering it correctly but I thought you should be able to start a task after loading your own configuration object, where can set the agent.package_manager.system_site_packages = true .

And this is also remotely?

And pandas is in your requirements.txt?

You can fix this by using a requirements.txt or the --packages parameter
https://clear.ml/docs/latest/docs/apps/clearml_task/#package-dependencies

I don't think there is a direct way but if you use a docker container with a different python version inside, that works.

Can you try: '${pipeline.docker_image}' ?

If you're just looking to reuse virtual environments, have a look here: https://clear.ml/docs/latest/docs/clearml_agent/#environment-caching

You've got it all working now?

ScaryBluewhale66 you shouldn't call mark_* on the main task, we're adding this as a notice and in documentation in the next release: https://github.com/allegroai/clearml/issues/830

Could you test again with
https://clear.ml/docs/latest/docs/references/sdk/task/#mark_completed ?

you can pass use the compression parameter in dataset.upload . The supported values are:
ZipFile.ZIP_STORED (no compression) ZipFile.ZIP_DEFLATED (requires zlib) ZipFile.ZIP_BZIP2 (requires bz2) ZipFile.ZIP_LZMA (requires lzma)Note that you need to import ZipFile beforehand: from zipfile import ZipFile
You're probably looking for ZIP_BZIP2 , but I'm not sure about that.

Both server and agent can be configured with different ports. Which is it you`re looking for?

Well you could let ClearML create the config file with: https://clear.ml/docs/latest/docs/references/sdk/task#taskset_credentials
store_conf_file=True

And then go edit the file.

But it's probably easier in your case to use https://clear.ml/docs/latest/docs/references/sdk/task#connect_configuration
and pass it your full configuration?

Did you use --git-credentials ?
https://clear.ml/docs/latest/docs/apps/clearml_session#accessing-a-git-repository

You can add them in env files:
https://clear.ml/docs/latest/docs/clearml_serving/clearml_serving_setup/#advanced-setup---s3gsazure-access-optional