Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
WittyOwl57
Moderator
11 Questions, 70 Answers
  Active since 10 January 2023
  Last activity 3 months ago

Reputation

0

Badges 1

53 × Eureka!
0 Votes
5 Answers
673 Views
0 Votes 5 Answers 673 Views
It might be the case that Hide identical fields functionality (under Compare Experiments / Details ) is not really working.
2 years ago
0 Votes
6 Answers
754 Views
0 Votes 6 Answers 754 Views
What determines the value of user? (see screenshot) Right now all my teammates' experiments show up under my own user name. Thanks
2 years ago
0 Votes
9 Answers
674 Views
0 Votes 9 Answers 674 Views
More stuff I think people would find useful for when comparing experiments: comparing repo information (branch, sha, uncommitted changes) package information...
2 years ago
0 Votes
12 Answers
719 Views
0 Votes 12 Answers 719 Views
Hi all. I've been mistakenly using connect_configuration instead of set_parameters on the Task object, and, as I found out, I cannot use any of the configura...
2 years ago
0 Votes
5 Answers
832 Views
0 Votes 5 Answers 832 Views
one year ago
0 Votes
11 Answers
834 Views
0 Votes 11 Answers 834 Views
I'm trying to set up clearml server on a new vm but the elasticsearch container is erroring with the following: Attaching to clearml-elastic clearml-elastic ...
one year ago
0 Votes
7 Answers
705 Views
0 Votes 7 Answers 705 Views
I'm using pytorch_lightning.loggers.Tensorboard.experiment.add_histogram . However, the plot is displayed under plots as a 3d plots (instead of a 2d histogra...
2 years ago
0 Votes
5 Answers
765 Views
0 Votes 5 Answers 765 Views
2 years ago
0 Votes
14 Answers
731 Views
0 Votes 14 Answers 731 Views
Hi, I'm on a machine that normally connects to storage using azure.identity.ManagedIdentityCredential . However, clearml seems to expect an account key. Is t...
2 years ago
0 Votes
7 Answers
795 Views
0 Votes 7 Answers 795 Views
I'm running a simple experiment (one training task, nothing else) and I'm getting a puzzling message. Any help deciphering that is appreciated. I'm pasting p...
2 years ago
0 Votes
31 Answers
10K Views
0 Votes 31 Answers 10K Views
Different question about warnings: I'm getting (infrequently) this warning, followed by my script hanging 2021-09-14 14:23:29,809 - clearml.Task - INFO - Wai...
2 years ago
0 I'M Trying To Set Up Clearml Server On A New Vm But The Elasticsearch Container Is Erroring With The Following:

Hi SuccessfulKoala55 ,yes, I am running as sudo. It's not my first time setting this up either. Just that on this vm (which is a particularly large instance) I get this issue which has me stumped.

one year ago
0 More Stuff I Think People Would Find Useful For When Comparing Experiments: Comparing

True, the Hyperparameters tab does show the environment (sorry, my bad). The repo information, or the uncommitted changes don't show up for me 😞 . What version did you use?

2 years ago
0 What Determines The Value Of User? (See Screenshot) Right Now All My Teammates' Experiments Show Up Under My Own User Name. Thanks

Thanks Natan, I was pretty much expecting that. Is there any way to change the value of user without generating new credentials? I'm guessing no 🙂 .

2 years ago
0 Hi! I Was Wondering Regarding This Issue:

That works fine:
1631895370729 vm-aimbrain-01 info ClearML Task: created new task id=cfed3ea8512d4d9f858d085bd79e62e8 2021-09-17 16:16:10,744 - clearml.Task - INFO - No repository found, storing script code instead ClearML results page: `
1631895370892 vm-aimbrain-01 info start
1631895370896 vm-aimbrain-01 error 0%| | 0/100 [00:00<?, ?it/s]
1631895471026 vm-aimbrain-01 error 100%|████...

2 years ago
0 I'M Trying To Set Up Clearml Server On A New Vm But The Elasticsearch Container Is Erroring With The Following:

I didn't add that to the script since the effect is persistent (i.e. it only needs to be done once, right?) In any case, I checked that multiple times and it was as expected.

one year ago
0 Hi! I Was Wondering Regarding This Issue:

Interesting, I don't get newlines in any of my consoles:
ClearML Task: overwriting (reusing) task id=38cc10401fcc43cfa432b7ceed7df0cc 2021-10-08 14:57:53,704 - clearml.Task - INFO - No repository found, storing script code instead ClearML results page: `
...

2 years ago
0 Hi! I Was Wondering Regarding This Issue:

In case anyone is interested, the minimum effort workaround I found is to edit pytorch_lightning/callbacks/progress.py and change all occurrences of dynamic_ncols=True to dynamic_ncols=False in the calls to tqdm . One could of course implement a custom callback inheriting from their ProgressBar class.

2 years ago
0 Hi! I Was Wondering Regarding This Issue:

This is adapted from one of the methods in their ProgressBar class
from tqdm import tqdm bar = tqdm( desc="Training", initial=1, position=1, disable=False, leave=False, dynamic_ncols=True, file=sys.stderr, smoothing=0) with bar: for i in range(10): time.sleep(0.1) bar.update() print('done')In the console this works as expected, but in a jupyter notebook this produces a scrolling log (because of the position=1 argument, which happens whenever the bar is not th...

2 years ago
0 I'M Trying To Set Up Clearml Server On A New Vm But The Elasticsearch Container Is Erroring With The Following:

Thanks AppetizingMouse58 . I managed to fix it by removing docker completely and reinstalling it.

one year ago
0 What Determines The Value Of User? (See Screenshot) Right Now All My Teammates' Experiments Show Up Under My Own User Name. Thanks

I forgot to say I've set up a local server - we are still testing phase. I've created credentials for them because they couldn't generate them for themselves (they did clearml-init, and have eacha clearml.conf file but the ADD CRENDENTIALS part didn't show up for them).

2 years ago
0 Hi Jake & John, I Was Having The Same Question As Lindsay, And Have Been Sifting Both Through Slack & Github. I Did Get Some Useful Pointers (Such As The Correct Path Structure For Azure), But I'M Far From A Resolution. I'D Like To Ask Some Question, To

This is how the links to the artifacts looks like (the part I blurred out is is the last part of the secret, which is working fine since the task was able to upload those correctly to storage, I can check that):

one year ago
0 Hi Jake & John, I Was Having The Same Question As Lindsay, And Have Been Sifting Both Through Slack & Github. I Did Get Some Useful Pointers (Such As The Correct Path Structure For Azure), But I'M Far From A Resolution. I'D Like To Ask Some Question, To

Sorry to ping you @<1523701087100473344:profile|SuccessfulKoala55> , can you offer any ideas to the two questions from my reply (about the correct web app cloud access and the correct way to specify a blob storage in the clearml.conf file? Thanks 🙏

one year ago
0 Hi, I'M On A Machine That Normally Connects To Storage Using

If we decide go forward with clearml we'll probably do just that 🙂

2 years ago
2 years ago
0 Hi, I'M On A Machine That Normally Connects To Storage Using

Hi Martin, to expand on my previous comments: the template for _Driver already exists; I'm suggesting to make it public. Consequently, StorageHelper should accept a driver parameter to __init__ , defaulting to None . Only when its value is not provided by the user should the library go out of its way to do the right thing and check all the known storage providers, fetch credentials, what not - stuff that will not work for most users, most of the time (even if you ...

2 years ago
0 Hi, I'M On A Machine That Normally Connects To Storage Using

Hi again. After looking into the matter a little bit, I realise I'd have liked having the option of using a StoreManager ABC which I would implement myself using whatever storage provider I happen to use and whatever package versions happened to support it. To put it differently, instead of you implementing managers for gcs, azure, aws, etc, it would be a much nicer alternative (for me, and I suspect eventually for you too) for clearml's store manager to wrap whatever object the user pr...

2 years ago
0 Hi, I'M On A Machine That Normally Connects To Storage Using

Hi Jake, thanks for the reply. I've tried the account key method, works fine - but unfortunately clearml expects an old version of azure-storage-blob (<2.1), which is incompatible with the recent versions (^12.). Any clues of how we could work around this one? Thanks again.

2 years ago
0 Hi! I Was Wondering Regarding This Issue:

The UI shows the log as is (and as pasted above). In the console I'm getting correct output (a single tqdm progress line):
` [2021-09-17 13:29:51,860][pytorch_lightning.utilities.distributed][INFO] - GPU available: True, used: True
[2021-09-17 13:29:51,862][pytorch_lightning.utilities.distributed][INFO] - TPU available: False, using: 0 TPU cores
[2021-09-17 13:29:51,862][pytorch_lightning.utilities.distributed][INFO] - IPU available: False, using: 0 IPUs
[2021-09-17 13:29:51,866][pytorch_ligh...

2 years ago
0 Hi Jake & John, I Was Having The Same Question As Lindsay, And Have Been Sifting Both Through Slack & Github. I Did Get Some Useful Pointers (Such As The Correct Path Structure For Azure), But I'M Far From A Resolution. I'D Like To Ask Some Question, To

Hi @<1523701087100473344:profile|SuccessfulKoala55> ,
thanks for the pointers.

I didn't know that the plot data is stored in elasticsearch. Good to know. It relates to the rest of my questions in that I want to understand where everything is saved, all the parts of my experiments. The plots are actually the most important part, since I have direct access to the artifacts I save (like, say, models) but not to the plot data which helps me compare and rank experiments. I mention tensorboard be...

one year ago
0 I'M Using

Well, of course, that would be ideal, provided someone implements the ridgeline 😊

2 years ago
0 Hi All. I'Ve Been Mistakenly Using

Hi SweetBadger76 , thanks, I think I've made it work. The main point of confusion was between dealing with different type of Task objects (i.e. clearml.backend_api.services.v2_13.tasks.Task returned by get_all , which don't have any of those methods).
Interestingly, set_parameters didn't just work as expected, I had to flatten the dicts myself (which clearml apparently does on its own when I call set_parameters on a new task.
Thank you all. 🙏

2 years ago
0 More Stuff I Think People Would Find Useful For When Comparing Experiments: Comparing

OK I can confirm that those display ok for me too. My problem is, they don't for my experiments, which is I care about..

2 years ago
0 I'M Trying To Set Up Clearml Server On A New Vm But The Elasticsearch Container Is Erroring With The Following:

I actually put all the commands in a script. The failure mode is exactly the same. I have no idea what to do next.
` #!/bin/bash

clearml_root=$1

if [[ $# -gt 0 ]]; then
echo Using "$1" as root
else
echo No root argument was provided, using /datadrive1
clearml_root=/datadrive1
fi

clearml="$clearml_root/clearml"

rm -R "$clearml"

mkdir -p "$clearml"/data/elastic_7
mkdir -p "$clearml"/data/mongo_4/db
mkdir -p "$clearml"/data/mongo_4/configdb
mkdir -p "$clearml"/data/redis
mkdir -p "$cl...

one year ago
Show more results compactanswers