Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
ReassuredTiger98
Moderator
95 Questions, 639 Answers
  Active since 10 January 2023
  Last activity 8 months ago

Reputation

0

Badges 1

606 × Eureka!
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Quick question about the Results --> Scalars ` view. In tensorboard when using autoscale it will ignore some values for scaling (e.g. very early super high l...
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Are "delete" calls to the API Server blocking, i.e. does the server answer instantly or only after the delete has been completed? I am asking this because my...
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Also is there a way to just run a Dockerfile? So for example my project includes a Dockerfile in the top-level dir. When sending to the agent I would like it...
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
How is the first plot in the first image on this site generated? https://clear.ml/docs/latest/docs/fundamentals/logger/ It seems like the standard deviation ...
3 years ago
0 Votes
2 Answers
960 Views
0 Votes 2 Answers 960 Views
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
How many people are actually working at AllegroAI/on ClearML?
3 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Hi everyone, is there any difference between the service agent that comes with the server and the normal clearml-agent in --services-mode ?
2 years ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
2 years ago
0 Votes
19 Answers
1K Views
0 Votes 19 Answers 1K Views
Any idea why only a single instance of mujoco can be run with clearml-agent? I run 2 clearm-agents, one per GPU on my workstation. However, the second task f...
3 years ago
0 Votes
3 Answers
629 Views
0 Votes 3 Answers 629 Views
Hi quick question about clearml-data: It seems like it is only using a single thread for compression. Is there a way to use multi-threading? For big datasets...
8 months ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
Hello everyone, I have a question about clearml-agent + ssh. I have valid ssh credentials in ~/.ssh but no .ssh/known_hosts yet. My clearml-agent fails to ex...
3 years ago
0 Votes
16 Answers
1K Views
0 Votes 16 Answers 1K Views
3 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
Hey everyone, is it possible to set the fileservers in the auto-generated credentials of the users? I use MinIO fileservers and want to provide the url with ...
2 years ago
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
3 years ago
0 Votes
17 Answers
1K Views
0 Votes 17 Answers 1K Views
Hey everyone, I have another question: Is it possible to change agent config for each task? E.g. agent.package_manager.system_site_packages = true should be ...
2 years ago
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
I have a questions about queue priorities with clearml-agent. I have two queues, A and B . Some of my agents support queue A and B with higher priority for B...
3 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
It seems like ClearML Agent does not support arparse subparsers, right? https://docs.python.org/3/library/argparse.html#argparse.ArgumentParser.add_subparser...
3 years ago
0 Votes
17 Answers
1K Views
0 Votes 17 Answers 1K Views
I am trying PyTorch Nightly again with Python 3.10. Works fine locally, but fails on clearml-agent in docker mode. ERROR: Ignored the following versions that...
one year ago
0 Votes
26 Answers
1K Views
0 Votes 26 Answers 1K Views
Hi everyone, is it possible to show the upload progress of artificats? E.g. I use torch.save to store some very large model, so it hangs forever when it uplo...
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hello! 🙂 I have my own minio setup and everything seems to work fine, however in clearml when I press to download an artifact with an url starting with s3:/...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi again, from the API-Server logs Serving Flask app 'server' (lazy loading) * Environment: production WARNING: This is a development server. Do not use it i...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Another question: How can I make clearml-agent use pre-installed version from the nvidia/pytorch ( https://docs.nvidia.com/deeplearning/frameworks/pytorch-re...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
3 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
Hi again 🙂 Is there some documentation on what is actually "secured" via authentication in the self-hosted version? The fileservers for example seems to be ...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Can someone point me whether/how the services-agent the starts with the clearml-server mounts the .ssh directory for accessing a private git repository from ...
3 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
Currently, to provide SSH access to the docker images for a task, .ssh is mounted into the docker. Wouldn't a solution like this https://gist.github.com/d11w...
3 years ago
0 Votes
2 Answers
851 Views
0 Votes 2 Answers 851 Views
Hey guys 🙂 I am wondering what is the best way to make a clearml-server deployment robust? E.g. let's say my server may become unavailable because of a hard...
one year ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
What does agent.package_manager.type actually do? I am wondering what happens, if my project uses a package that is only available either on pip or with cond...
3 years ago
Show more results questions
0 It Seems Like Clearml Agent Does Not Support Arparse Subparsers, Right?

Args is similar to what is shown in print(args) when executed remotely.

3 years ago
0 It Seems Like Clearml Agent Does Not Support Arparse Subparsers, Right?

With remote_execution it is command="[...]" , but on local it is command='train' like it is supposed to be.

3 years ago
0 It Seems Like Clearml Agent Does Not Support Arparse Subparsers, Right?

That seems to be the case. After parsing the args I run task = Task.init(...) and then task.execute_remotely(queue_name=args.enqueue, clone=False, exit_process=True) .

3 years ago
0 It Seems Like Clearml Agent Does Not Support Arparse Subparsers, Right?

What I get for args when I print it locally is not the same as what ClearML extracts from args .

3 years ago
0 Hello! Since Today I Get

For now I can tell you that with conda_freeze: true it fails, but with conda_freeze: false it works!

3 years ago
0 It Seems Like Clearml Agent Does Not Support Arparse Subparsers, Right?

So missing args that are not specified are not None like intended, but just do not exists in args . And command is a list instead of a single str.

3 years ago
0 It Seems Like Clearml Agent Does Not Support Arparse Subparsers, Right?

Ah, it actually is also a string with remote_execution, but still not what it should be.

3 years ago
0 Hello! Since Today I Get

And this works fine.

3 years ago
0 It Seems Like Clearml Agent Does Not Support Arparse Subparsers, Right?

And in the WebUI I can see arguments similar to the second print statement's.

3 years ago
0 Anyone Else Experiencing That Tasks That Fail Are Not Shown As "Failed", But Instead Keep On Running And Hogging The Clearml-Agent?

Latest version for everything. I will message you again, if I encounter this problem again.

3 years ago
0 Another Quick Question About Fileservers And Clearml-Agent: Clearml-Agent Seems To Ignore The Output Destination Set In The Task Config

I think in the paid version there is this configuration vault, so that the user can pass their own credentials securely to the agent.

one year ago
0 Another Quick Question About Fileservers And Clearml-Agent: Clearml-Agent Seems To Ignore The Output Destination Set In The Task Config

Thanks a lot, now I think I understand.

Debug samples can only be controlled via api.file_server (or programatically)

Could you guide me how to approach this programmatically? Can I implement my own storage adapter for debug samples with ClearML interfaces or am I on my own?

one year ago
0 Hello! Since Today I Get
conda env update -p .clearml/venvs-builds/3.8 ./environment.yml

with environment.yml

name: clearml
channels:
  - pytorch
  - anaconda
  - conda-forge
  - defaults
dependencies:
  - pytorch==1.8.0
3 years ago
0 Here Are Two More Questions:

clearml does everything for me 😄

3 years ago
0 Hello! Since Today I Get

ok, thanks!

3 years ago
0 Hi Everyone, Quick Question Regarding Minio And Logging:

Setting the api.files_server: s3://myhost:9000/clearml in clearml.conf works!

2 years ago
0 Hello! Since Today I Get
Thu Mar 11 17:52:45 2021       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 460.56       Driver Version: 460.56       CUDA Version: 11.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |   ...
3 years ago
0 Hello! Since Today I Get

Perfect, will try it. fyi: The conda_channels that I used are from clearml-agent init

3 years ago
0 Another Quick Question About Fileservers And Clearml-Agent: Clearml-Agent Seems To Ignore The Output Destination Set In The Task Config

Makes sense, but this means that we are not able to tell clearml-agent where to save on a per-task basis? I see the output_destination set correctly in clearml web interface, but as you say, clearml-agent always uses its api.fileserver ?

one year ago
0 Another Quick Question About Fileservers And Clearml-Agent: Clearml-Agent Seems To Ignore The Output Destination Set In The Task Config

Or maybe a different question: What is not

Artifacts and Models. debug samples (or anything else the Logger class creates)

?

Also it is not possible to use multiple files server? E.g. log tasks on different S3 buckets without changing clearml.conf

one year ago
0 Here Are Two More Questions:

But this seems like something that is not related to clearml 🙂 Anyways, thanks again for the explanations!

3 years ago
0 Here Are Two More Questions:

Yea, I don't do anything manually.

3 years ago
0 Here Are Two More Questions:

Thank you. I am not trying to use this option to speed up the setup. I have some package (carla simulator PythonAPI) that has no pip support (only easy_install). So I am thinking about just installing this manually on the worker, so that tasks can assume, that carla is provided by the system

3 years ago
0 Here Are Two More Questions:

Yea, I am still trying to get docker to work with clearml. I do not have much experience with docker besides creating Dockerfiles and it seems like the ~/.ssh/config ownership seems broken when mounted into the container on my workstations.

3 years ago
0 Hello! Since Today I Get

Quick question: Where again does clearml place the venv? I wanna take a look into it after the task has failed

3 years ago
0 Hello! Since Today I Get

I tried to run the task with detect_with_conda_freeze: false instead of true and got

Executing Conda: /home/tim/miniconda3/condabin/conda install -p /home/tim/.clearml/venvs-builds/3.8 -c defaults -c conda-forge -c pytorch 'pip<20.2' --quiet --json
Pass
Conda: Trying to install requirements:
['pytorch~=1.8.0']
Executing Conda: /home/tim/miniconda3/condabin/conda env update -p /home/tim/.clearml/venvs-builds/3.8 --file /tmp/conda_envh7rq4qmc.yml --quiet --json
Conda error: Unsati...
3 years ago
0 Here Are Two More Questions:

And then also use priority_optional_packages: ["carla"]

3 years ago
0 Hello! Since Today I Get
==> 2021-03-11 13:54:59 <==
# cmd: /home/tim/miniconda3/condabin/conda create --yes --mkdir --prefix /home/tim/.clearml/venvs-builds/3.8 python=3.8
# conda version: 4.9.2
+defaults/linux-64::_libgcc_mutex-0.1-main
+defaults/linux-64::ca-certificates-2021.1.19-h06a4308_1
+defaults/linux-64::certifi-2020.12.5-py38h06a4308_0
+defaults/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7
+defaults/linux-64::libedit-3.1.20191231-h14c3975_1
+defaults/linux-64::libffi-3.3-he6710b0_2
+defaults/linux-64...
3 years ago
Show more results compactanswers