Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
CrookedWalrus33
Moderator
14 Questions, 62 Answers
  Active since 10 January 2023
  Last activity 7 months ago

Reputation

0

Badges 1

61 × Eureka!
0 Votes
5 Answers
377 Views
0 Votes 5 Answers 377 Views
Hi everybody, Am I the only one having issues with logging into https://app.clear.ml/ ?
one year ago
0 Votes
3 Answers
414 Views
0 Votes 3 Answers 414 Views
Hi, What if I need to create a task which requires a private package that is only available as a wheel (in a private git repo)? Any ideas of how to do that?
one year ago
0 Votes
10 Answers
341 Views
0 Votes 10 Answers 341 Views
Hi Everyone, I have a task that installs a python requirement from bitbucket over ssh. The requirement are defined in a requirements.txt file. In the agent, ...
7 months ago
0 Votes
16 Answers
381 Views
0 Votes 16 Answers 381 Views
Hi all, I'm looking for a hint on how to configure a local network drive (nas) as a file server for clearml, that will be cross platform (we have windows, li...
one year ago
0 Votes
17 Answers
420 Views
0 Votes 17 Answers 420 Views
2 years ago
0 Votes
11 Answers
385 Views
0 Votes 11 Answers 385 Views
Hi everybody. When I want to force the agent to not reproduce my local pip environment, I add Task.force_requirements_env_freeze(force=False, requirements_fi...
one year ago
0 Votes
2 Answers
425 Views
0 Votes 2 Answers 425 Views
Hi all, Should be any problem deploying a clearml server on a raspberrypi? (i.e. arm64).
one year ago
0 Votes
1 Answers
417 Views
0 Votes 1 Answers 417 Views
Hi all, Is there any way to list/query all the Metric events that are associated with a particular task? I did some experiments with APIClient class, but no ...
8 months ago
0 Votes
26 Answers
452 Views
0 Votes 26 Answers 452 Views
Hi everybody, I’m getting errors with automatic model logging on pytorch (running on a dockered agent). 2022-07-14 10:24:06,334 - clearml.storage - INFO - St...
one year ago
0 Votes
9 Answers
377 Views
0 Votes 9 Answers 377 Views
Does anyone know why I keep getting that error? clearml_agent: ERROR: ERROR: package manager "conda" selected, but 'conda' executable could not be located I ...
2 years ago
0 Votes
2 Answers
372 Views
0 Votes 2 Answers 372 Views
Hi all. I have a general question regarding the logging mechanism. Using https://github.com/allegroai/clearml/blob/master/examples/frameworks/tensorflow/tens...
one year ago
0 Votes
5 Answers
399 Views
0 Votes 5 Answers 399 Views
8 months ago
0 Votes
8 Answers
434 Views
0 Votes 8 Answers 434 Views
2 years ago
0 Votes
11 Answers
380 Views
0 Votes 11 Answers 380 Views
Hi everybody, I'm running experiments inside a docker which includes multiple python instances, some of them are inside conda environments. How can I specify...
one year ago
0 Hi Everybody, I’M Getting Errors With Automatic Model Logging On Pytorch (Running On A Dockered Agent).

can you provide some mode details please ? Do you intend to store your artefacts locally or remotely ?
Does the manual reporting also fails ?

If you could also give your clearml packages versions it could help

I store the artifacts on a minio server (in my LAN).
If I run the python script locally (i.e. no execute remotely() it works fine).
I use the latest clearml 1.6.2

Did you by any chance save the checkpoint without any file extention? Or with a weird name containing sl...

one year ago
0 Hi Everybody, I’M Getting Errors With Automatic Model Logging On Pytorch (Running On A Dockered Agent).

can you test what happens if you pass the credentials in the global scope as well, i.e. here:

That didn’t help

one year ago
0 Hi Everybody, I’M Getting Errors With Automatic Model Logging On Pytorch (Running On A Dockered Agent).

AgitatedDove14 ,
From the experiment’s console log:
` - boto3==1.16.2

  • botocore==1.19.2 `
one year ago
0 Hi Everybody, I’M Getting Errors With Automatic Model Logging On Pytorch (Running On A Dockered Agent).

Oh wow AgitatedDove14 . Appreciate it!
Are you sure it’s just a matter of the python version?
The same experiment script, was working on the exact docker image in the past (with older clearml versions though…).
For example this experiment log:

one year ago
0 Hi Everybody, I’M Getting Errors With Automatic Model Logging On Pytorch (Running On A Dockered Agent).

AgitatedDove14 its running inside a docker based worker.
Are you interested in the full pip freeze of that docker?

one year ago
0 Hi Everybody, I’M Getting Errors With Automatic Model Logging On Pytorch (Running On A Dockered Agent).

Thanks AgitatedDove14 !
I’ll use clearml 1.4.1 until the fix is out.

one year ago
0 Hi Everybody, Am I The Only One Having Issues With Logging Into

Im afraid there's something with my account, since it won't login on other browser as well, but logging with a different email works

one year ago
0 Hi Everybody, Am I The Only One Having Issues With Logging Into

After signing with google, the login page is stuck at this

one year ago
0 Hi Everybody, I’M Getting Errors With Automatic Model Logging On Pytorch (Running On A Dockered Agent).

SweetBadger76
It’s not a credential issue, because I do upload artifacts manually with tsk.upload_artifact(...)
I’ll try changing the extension, but I have to admit that in the past (I havn’t used clearml for a while and updated it recently to the latest verion) it did got this file extension right

one year ago
0 Hi Everybody, I’M Getting Errors With Automatic Model Logging On Pytorch (Running On A Dockered Agent).

what does that actually mean?
2022-07-17 07:59:40,339 - clearml.storage - ERROR - Failed uploading: Parameter validation failed: Invalid type for parameter ContentType, value: None, type: <class 'NoneType'>, valid types: <class 'str'>

one year ago
one year ago
0 Hi All, Should Be Any Problem Deploying A Clearml Server On A Raspberrypi? (I.E. Arm64).

CostlyOstrich36
I do get errors - failing to launch the clearml images.
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested standard_init_linux.go:228: exec user process caused: exec format errorWell, after diving into this, it seems like the clearml images were built usin amd64 (on top of amd64 base images...)

one year ago
0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

Yes.

Its kwcoco

This is my conda env export :
name: clearml
channels:

  • defaults
    dependencies:
  • ca-certificates=2021.10.26=hecd8cb5_2
  • certifi=2021.10.8=py39hecd8cb5_0
  • libcxx=12.0.0=h2f01273_0
  • libffi=3.3=hb1e8313_2
  • ncurses=6.3=hca72f7f_2
  • openssl=1.1.1l=h9ed2024_0
  • pip=21.2.4=py39hecd8cb5_0
  • python=3.9.7=h88f2d9e_1
  • readline=8.1=h9ed2024_0
  • setuptools=58.0.4=py39hecd8cb5_0
  • sqlite=3.36.0=hce871da_0
  • tk=8.6.11=h7bc2e8c_0
  • tzdata=2021e=hda174b...
2 years ago
0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

Thank for the great explanation! Now it makes much more sense.
You are right about the issue that 'kwcoco' isn't being detected, and Im actually running this as a single script, and the kwcoco not imported directly (but from within another package).
Ill try running it from a repo and see how it works.

2 years ago
0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

Maybe I should understand better how this actually works.
It's not a rare use case to use conda environments, but install some packages using pip (when they're not available at any conda channel). Will that use case be supported on clearml?

2 years ago
0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

No. But this isn't the only package that was installd using pip inside a conda env.
Compare it with Pandas as an example - was installed using pip nad it's actually instaled inside the worker as well (using pip).

2 years ago
0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

So I run the same script as part of a git repo - but unfortunately the package is still missing.
I'm not sure if it matters but 'kwcoco' is being imported inside one of the repo's functions and not on the script's header.

2 years ago
0 Hi Everybody, I'M Running Experiments Inside A Docker Which Includes Multiple Python Instances, Some Of Them Are Inside Conda Environments. How Can I Specify The Agent To Use A Specific Conda Environment Inside The Docker?

AgitatedDove14
I'm not sure.
In my case I'm not trying to reproduce a local environment in the agent, but to run a script inside a docker which already has the environment built in.
The environment is conda based.

one year ago
0 Hi Everybody, I'M Running Experiments Inside A Docker Which Includes Multiple Python Instances, Some Of Them Are Inside Conda Environments. How Can I Specify The Agent To Use A Specific Conda Environment Inside The Docker?

AgitatedDove14
Yes, I'd like to point to a specific binary, which is in a conda environment.
(b.t.w how can I specify the python version on the Task?)

one year ago
0 Hi Everybody, I'M Running Experiments Inside A Docker Which Includes Multiple Python Instances, Some Of Them Are Inside Conda Environments. How Can I Specify The Agent To Use A Specific Conda Environment Inside The Docker?

It didn't work either. Still same error.
conda command was already in PATH and the conda activate is executed properly, but it prompts to run conda init (i.e conda wasn't configures at that shell):
` You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
To initialize your shell, run
$ conda init <SHELL_NAME>
Currently supported shells are:

  • ba...
one year ago
0 Hi Everybody, I'M Running Experiments Inside A Docker Which Includes Multiple Python Instances, Some Of Them Are Inside Conda Environments. How Can I Specify The Agent To Use A Specific Conda Environment Inside The Docker?

AgitatedDove14
It's still failing.
I updated clearml-agent to 1.2.0rc7 and also:
docker_setup_bash_script= [ "export PATH=""/workspace/miniconda/bin:$PATH", "export LOCAL_PYTHON=/workspace/miniconda/bin/python3", "conda activate"])But the conda activate (base env) returns:
CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.

I noticed that conda ...

one year ago
0 Hi Everybody, I'M Running Experiments Inside A Docker Which Includes Multiple Python Instances, Some Of Them Are Inside Conda Environments. How Can I Specify The Agent To Use A Specific Conda Environment Inside The Docker?

Anyway, when I add the binary's path to PATH, it still won't work.
I call
task.set_base_docker(docker_image='my/docker/image', docker_setup_bash_script= ["export PATH=""/workspace/miniconda/bin:$PATH"])just after Task.init.
On execution, the agent installs all pip requirements with python binary at /usr/bin/python3.6
but eventually the task fails with, /workspace/miniconda/bin/python3: No module named clearml_agent

one year ago
0 Hi Everybody, I'M Running Experiments Inside A Docker Which Includes Multiple Python Instances, Some Of Them Are Inside Conda Environments. How Can I Specify The Agent To Use A Specific Conda Environment Inside The Docker?

AgitatedDove14 .
Note that the actual error is /workspace/miniconda/bin/python3: No module named clearml_agent since all the packages (including clearml_agent) were already installed by the agent on the default (non conda) python binary.

one year ago
0 What Is The Recommended Way To Stop The Execution Of A Specific Agent? This Command Doesn'T Allow Me To Specify The Agent Ip I Want To Stop:

That would be a very useful feature.
What is the status of that issue? I havn't found it on github.

one year ago
Show more results compactanswers