AgitatedDove14 , agree \ disagree?

AgitatedDove14 , by the way, can you take a look at https://clearml.slack.com/archives/CTK20V944/p1625558368001600
maybe you'll have other ideas? at the moment it seems like a dead end

AgitatedDove14 it ended up not solving our problem.. it was a false observation.. there is some bottleneck that kills the UI responsiveness that we can't identify

AgitatedDove14 , seem to work significantly better! thanks!

AgitatedDove14 I am actually curious now, why is the default like this? maybe more people are facing similar bottlenecks?

we see this:
$ ps ax | grep python
10589 ? S 0:05 python3 fileserver.py
10808 ? Sl 18:07 python3 -m apiserver.server
30047 pts/0 S+ 0:00 grep --color=auto python

AgitatedDove14 if we look at the host machine we can see a single python process that is actually busy

SuccessfulKoala55 can you refer me to how to increase the number of API server processes?

AgitatedDove14 thanks, at peak usage we have 6-8 gb of free RAM

How can we increase the number of API server processes?

after poking the setup in multiple ways we came to a conclusion that the API server is being clogged by calls from multiple HPOptimziners, and it utilizes a single core so it seems like we are not able to scale it up properly... any ideas?

mostly the second case

CostlyOstrich36 , I am not sure what you mean, but if you refer to the name of the category in the configuration, it doesn't matter.. the names are arbitrary for this example..

It would be very very useful for my use case, and I believe a relatively popular use case in general for example when using regular expression configurations

(value, "")->(value, "\")

AgitatedDove14 , when I test using the yaml python package:
I see the following:
import yaml yaml.dump({'\.': ('a', '\.')}) [In]: '\\.: !!python/tuple\n- a\n- \\.\n'YAML treats both strings in tuples and outside the same, however this is not the behavior you get in clearml task.connect

I am actually not sure specifically about \b myself, but even when replacing with . I am getting \. double backslash instead of the single backslash ( for the tuple case ). which in the case of a regexp expression changes the meaning of the expression. the expected behavior would be registering it as single backslash

well, kind of, I linked the other topic, but it was completely unrelated
this topic is about the issue with reporting a configuration with a string inside a tuple that has backslash

does my explanation makes sense?

AgitatedDove14 , in my use case, the strings are regular expressions. If the reported regular expression string changes when reported, it messes up my run.
I can't define the "legal regular expression space", off the top of my head. The expected behavior is reported_string == original_string..

I understand that to report any value should be presented as string, how does the "inverse casting" work when I pull some value from the config?

for sure.. and more then the eye-candy aspect it can actually be super useful visualizations

and the path it shows is correct..

in the same queue I have about 60 pending, and I want the bottom 30 to be the top 30

I wasn't familiar with 4. that's great!

ohh actually I think I remember, when you connect a dictionary, the local dtype is used for the casting of the remote matching key (probably more nuanced)

there seem to be an additional logic to:
str_value = str(value)str('.') -> '\.'
however in the configuration I see: '.' for non nested strings

AgitatedDove14 , I see, someone must have faced the issue of dumping regular expression strings in tuple before?
I'll have a think and a look too, unfortunately not today

do you happen to have some reference snippet to create such a callback? I am only familiar with:
from clearml.binding.frameworks import WeightsFileHandler

I was hoping for something that I can scale