AgitatedDove14 if we look at the host machine we can see a single python process that is actually busy

the above represent my case

SuccessfulKoala55 .. so no ideas how to proceed?

ohh actually I think I remember, when you connect a dictionary, the local dtype is used for the casting of the remote matching key (probably more nuanced)

AgitatedDove14 , TimelyPenguin76 , a small blast from the past
Unfortunately it seems like this is not working for backslash escape character
https://demoapp.demo.clear.ml/projects/7eaa1749475d4ad4bd21a5456fd2e157/experiments/3efe981238e543c8b6ad682dd13c72bc/output/hyper-params/hyper-param/General
https://colab.research.google.com/drive/1w5lQGxsblnLGlhJEDH_b0aIiUvjGeLjy?usp=sharing

TimelyPenguin76 , I generate it manually , clone some task -> adjust config -> enqueue
then when the agent pulls it I get the following behavior
remote_dict = task.connect(local_dict) # matching keys are overridden from remote configwhich I can't reproduce as I described above

Thanks Martin! I'll test it in the following days, I'll keep you updated!

thanks AgitatedDove14 ! this is what I was looking for

nice, saved some electrons from running 🙂

you can see the behavior here:

it works.. but I am actually trying to access the status not the stats, is that an option?

AgitatedDove14 I am actually curious now, why is the default like this? maybe more people are facing similar bottlenecks?

AgitatedDove14 , well.. having the demo server by default lowers the effort threshold for trying ClearML and getting convinced it can deliver what it promises, and maybe test some simple custom use cases. I don't know what are the behind the scenes considerations in terms of costs of keeping the demo server running, but even having a leaner version where you limit the duration in which the experiment records are deleted after a week or few days sounds useful to me

Hi AgitatedDove14 , can you please point me to the source code where the Jupyter save hook is defined? I am considering some custom workaround

worked like a charm

FrothyDog40 , is submitting an issue still relevant?

not really.. did my previous comment made sense to you?

AgitatedDove14 , I see, someone must have faced the issue of dumping regular expression strings in tuple before?
I'll have a think and a look too, unfortunately not today

well when returning None it works as expected, no model uploads

AgitatedDove14 , seem to work significantly better! thanks!

this is what I get with curl

there seem to be an additional logic to:
str_value = str(value)str('.') -> '\.'
however in the configuration I see: '.' for non nested strings

is there an available reference for how I can use the API calls with the python API? it is not clear to me from what you shared

we have 8 core 16 gb ram, API server uses uses 1 core 100% and everything else seem to be in low utilization. it is a standard installation. how can we change the number of internal API server handler processes??

thoughts?

AgitatedDove14 Thanks, I am aware of the auto_connect_frameworks and it makes sense for torch.save (and probably other stuff) however if it is called about 10 times during model initialization it seem excessive and I would be happy to avoid this behavior during model initialization if possible. do you know what is actually triggering the uploads?

for keys that are present in both the remote and local configuration the expected behavior is that the remote overrides the local, that what happens in my agent runs

well, kind of, I linked the other topic, but it was completely unrelated
this topic is about the issue with reporting a configuration with a string inside a tuple that has backslash

let me try to explain myself again

thanks, I'll try this. Is there an efficient way to get the IDs first?