Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
CrookedWalrus33
Moderator
16 Questions, 65 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

64 × Eureka!
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
Hi all, Is there any way to list/query all the Metric events that are associated with a particular task? I did some experiments with APIClient class, but no ...
2 years ago
0 Votes
10 Answers
2K Views
0 Votes 10 Answers 2K Views
Hi Everyone, I have a task that installs a python requirement from bitbucket over ssh. The requirement are defined in a requirements.txt file. In the agent, ...
2 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Hi all. I have a general question regarding the logging mechanism. Using https://github.com/allegroai/clearml/blob/master/examples/frameworks/tensorflow/tens...
3 years ago
0 Votes
8 Answers
2K Views
0 Votes 8 Answers 2K Views
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hello everyone, When performing hyperparameter optimization, is there a way to set an objective_metric as the value logged using logger.report_single_value m...
one year ago
0 Votes
17 Answers
2K Views
0 Votes 17 Answers 2K Views
3 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Hi, What if I need to create a task which requires a private package that is only available as a wheel (in a private git repo)? Any ideas of how to do that?
3 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Hi all, Should be any problem deploying a clearml server on a raspberrypi? (i.e. arm64).
3 years ago
0 Votes
9 Answers
2K Views
0 Votes 9 Answers 2K Views
Does anyone know why I keep getting that error? clearml_agent: ERROR: ERROR: package manager "conda" selected, but 'conda' executable could not be located I ...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
Hi everybody, Am I the only one having issues with logging into https://app.clear.ml/ ?
3 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
Hi everybody, I'm running experiments inside a docker which includes multiple python instances, some of them are inside conda environments. How can I specify...
3 years ago
0 Votes
16 Answers
2K Views
0 Votes 16 Answers 2K Views
Hi all, I'm looking for a hint on how to configure a local network drive (nas) as a file server for clearml, that will be cross platform (we have windows, li...
3 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi community, I might have a misunderstanding of the use of task.connect method. It seems like the object I connect is immutable, while it should be mutable....
one year ago
0 Votes
26 Answers
2K Views
0 Votes 26 Answers 2K Views
Hi everybody, I’m getting errors with automatic model logging on pytorch (running on a dockered agent). 2022-07-14 10:24:06,334 - clearml.storage - INFO - St...
3 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
Hi everybody. When I want to force the agent to not reproduce my local pip environment, I add Task.force_requirements_env_freeze(force=False, requirements_fi...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
2 years ago
0 Hi All, I'M Looking For A Hint On How To Configure A Local Network Drive (Nas) As A File Server For Clearml, That Will Be Cross Platform (We Have Windows, Linux And Macos Users...) The Easy Part Is To Modify The Conf File

/mnt/clearml_storage is the mount point of the NAS on one linux machine.
On macos it would be /Volumes/clearml_storage,
On windows - //NAS/clearml_storage

3 years ago
0 Hi Everybody, I’M Getting Errors With Automatic Model Logging On Pytorch (Running On A Dockered Agent).

AgitatedDove14 its running inside a docker based worker.
Are you interested in the full pip freeze of that docker?

3 years ago
0 Hi Everybody, I’M Getting Errors With Automatic Model Logging On Pytorch (Running On A Dockered Agent).

Thanks AgitatedDove14 !
I’ll use clearml 1.4.1 until the fix is out.

3 years ago
0 Hi Everybody, Am I The Only One Having Issues With Logging Into

Im afraid there's something with my account, since it won't login on other browser as well, but logging with a different email works

3 years ago
0 Hi Everybody, I'M Running Experiments Inside A Docker Which Includes Multiple Python Instances, Some Of Them Are Inside Conda Environments. How Can I Specify The Agent To Use A Specific Conda Environment Inside The Docker?

Anyway, when I add the binary's path to PATH, it still won't work.
I call
task.set_base_docker(docker_image='my/docker/image', docker_setup_bash_script= ["export PATH=""/workspace/miniconda/bin:$PATH"])just after Task.init.
On execution, the agent installs all pip requirements with python binary at /usr/bin/python3.6
but eventually the task fails with, /workspace/miniconda/bin/python3: No module named clearml_agent

3 years ago
3 years ago
0 Hello Everybody, I'M Seeking For A Clarification On The 'Metrics' Quote For The Saas Platform. My Workspace Only Uses Self S3 Storage As The File Server To Store Artifacts, Datasets And Models. For Some Reason, My 'Metrics' Quota Is Blown Up By > 30Gb Of

I did found this:

from clearml.backend_api.session.client import APIClient
client = APIClient()
client.events.get_task_metrics(tasks=['some_task_id'], event_type='log')

but it returns an empty 'metrics' object

2 years ago
3 years ago
0 Hi All, Should Be Any Problem Deploying A Clearml Server On A Raspberrypi? (I.E. Arm64).

CostlyOstrich36
I do get errors - failing to launch the clearml images.
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested standard_init_linux.go:228: exec user process caused: exec format errorWell, after diving into this, it seems like the clearml images were built usin amd64 (on top of amd64 base images...)

3 years ago
0 Hi Community, I Might Have A Misunderstanding Of The Use Of Task.Connect Method. It Seems Like The Object I Connect Is Immutable, While It Should Be Mutable.

Hi @<1523701070390366208:profile|CostlyOstrich36> ,
The idea is indeed to control the object via API, but in that particular case, if I don't want the seed to be specified by the API but just set it to be current timestamp.
Could you think of a better use?

one year ago
0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

Thank for the great explanation! Now it makes much more sense.
You are right about the issue that 'kwcoco' isn't being detected, and Im actually running this as a single script, and the kwcoco not imported directly (but from within another package).
Ill try running it from a repo and see how it works.

3 years ago
0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

No. But this isn't the only package that was installd using pip inside a conda env.
Compare it with Pandas as an example - was installed using pip nad it's actually instaled inside the worker as well (using pip).

3 years ago
0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

Maybe I should understand better how this actually works.
It's not a rare use case to use conda environments, but install some packages using pip (when they're not available at any conda channel). Will that use case be supported on clearml?

3 years ago
0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

So I run the same script as part of a git repo - but unfortunately the package is still missing.
I'm not sure if it matters but 'kwcoco' is being imported inside one of the repo's functions and not on the script's header.

3 years ago
0 Whet Is The Method For Packages Exploration When Using Conda? Agent Is Set To 'Conda' Mode. We Upload A Task From A Local Conda Env That (Obviously) Has Some Pip Packages As Well. When We Enqueue The Task To Run Remotely, Not All Conda Packages Are Instal

Yes.

Its kwcoco

This is my conda env export :
name: clearml
channels:

  • defaults
    dependencies:
  • ca-certificates=2021.10.26=hecd8cb5_2
  • certifi=2021.10.8=py39hecd8cb5_0
  • libcxx=12.0.0=h2f01273_0
  • libffi=3.3=hb1e8313_2
  • ncurses=6.3=hca72f7f_2
  • openssl=1.1.1l=h9ed2024_0
  • pip=21.2.4=py39hecd8cb5_0
  • python=3.9.7=h88f2d9e_1
  • readline=8.1=h9ed2024_0
  • setuptools=58.0.4=py39hecd8cb5_0
  • sqlite=3.36.0=hce871da_0
  • tk=8.6.11=h7bc2e8c_0
  • tzdata=2021e=hda174b...
3 years ago
0 Hello Everyone, When Performing Hyperparameter Optimization, Is There A Way To Set An

@<1523701070390366208:profile|CostlyOstrich36> am I doing anything wrong here?

one year ago
0 Hi Everybody, I'M Running Experiments Inside A Docker Which Includes Multiple Python Instances, Some Of Them Are Inside Conda Environments. How Can I Specify The Agent To Use A Specific Conda Environment Inside The Docker?

It didn't work either. Still same error.
conda command was already in PATH and the conda activate is executed properly, but it prompts to run conda init (i.e conda wasn't configures at that shell):
` You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
To initialize your shell, run
$ conda init <SHELL_NAME>
Currently supported shells are:

  • ba...
3 years ago
0 Hi All, I'M Looking For A Hint On How To Configure A Local Network Drive (Nas) As A File Server For Clearml, That Will Be Cross Platform (We Have Windows, Linux And Macos Users...) The Easy Part Is To Modify The Conf File

SuccessfulKoala55
we are using the fileserver which is configured at clearml.conf to a path on a network drive (i.e the NAS) -
files_server: file:///mnt/clearml_storage

3 years ago
0 Hello Everyone, When Performing Hyperparameter Optimization, Is There A Way To Set An

@<1523701070390366208:profile|CostlyOstrich36>

from clearml import Task
from clearml.automation import HyperParameterOptimizer, UniformIntegerParameterRange, DiscreteParameterRange


task = Task.init(
       project_name="examples",
       task_name="HP optimizer",
       task_type=Task.TaskTypes.optimizer,
       reuse_last_task_id=False,
   )

task.execute_remotely(queue_name="services")

an_optimizer = HyperParameterOptimizer(
    base_task_id="c7618e30ff5c4955b4942971b410f72d",
   ...
one year ago
0 Hi Everybody. When I Want To Force The Agent To Not Reproduce My Local Pip Environment, I Add

This is actually in runtime (i.e. when running the code),

My script looks like that
` import clearml
clearml.Task.force_requirements_env_freeze(force=False, requirements_file="requirements.txt")
task = clearml.Task.init(...)
task.set_script(working_dir=dir, entry_point="my_script.py")
task.execute_remotely(queue_name='default')

rest of script goes here.... `When you refer to runtime, do you mean when the script is executed remotely, or when I run my_script.py locally (in order to ...

3 years ago
Show more results compactanswers