SuccessfulKoala55 , yes, that part is 100% correct

in the same queue I have about 60 pending, and I want the bottom 30 to be the top 30

for my specific use case I don't mind if they keep the order, I just want them to be at the top

but I don't get the same when I try to reproduce it for debug as described above (with task.connect)

in 4. I am using the task.connect

sounds great, is it part of the release? or latest repo?

AnxiousSeal95 , the roaming people, how can I find them actually?

Thanks Martin! I'll test it in the following days, I'll keep you updated!

SuccessfulKoala55 can you refer me to how to increase the number of API server processes?

I was hoping for something that I can scale

it is still relevant if you have any ideas

it doesn't even need to be a sub process at this point.. it can be serial execution

Lets say I inherit from the Optimizer (you mean HyperParameterOptimizer class? or SearchStrategy?), implement a custom logic for experiment creation logic,
what does it actually exposes? creating an experiment means defining a task, enqueue it and then? I am trying to think what you meant I can put in the logic such that I get the desired effect

The "notebook preview" link doesn't pop-up the s3 credentials, however the "notebook" artifact when clicking on the download button does show this pop up
they actually seem to be different in the way that the UI server is showing them.. one is a link (the html) and has no pop up, the other one (.ipynb) is a text with a download button in the end of the string which does show the mentioned pop up

do you happen to have some reference snippet to create such a callback? I am only familiar with:
from clearml.binding.frameworks import WeightsFileHandler

that was never a problem.. before the new copy wasn't uploaded.. I'm still not sure what you referring to

sounds like a cool option.. I'll give it a try. thanks

AgitatedDove14 , as a temporary workaround, I was wondering how hard would it be to actually use the callback mechanism and manually register the notebook html with something like
Logger.current_logger().report_media("html", "url_html", iteration=iteration, url=" ")?

Hi AgitatedDove14 , can you please point me to the source code where the Jupyter save hook is defined? I am considering some custom workaround

Thanks AgitatedDove14 , we have no issue with "html stuck in cache" I'm not sure what are you referring to..

in order to have an automatically updating preview

that would be great, thanks a lot!

so actually in our case we have an S3 link, but when downloading it, it seems correct.. there is probably some way to make an S3 path open up in the browser by default

so if I wait a few minutes I will be able to get the latest version?

Hi TimelyPenguin76 , I'm not getting the behavior mentioned above.. I am doing the following:
I clone some "baseline" config from a task I run I edit the OmegConf Configuration Object and adjust one of the values in the yaml enqueue the run, however I'm getting the same config as before... without the changes..what am I missing?

SuccessfulKoala55 , thanks I was looking for a way to do it programatically.. solved now, thanks
request = url+ '/v2.14/debug.ping' r = requests.post(request) serverIsResponsive = r.json()['meta']['result_code'] == 200

AgitatedDove14 , agree \ disagree?

AgitatedDove14 after a small test run we done, we get some issues with the proposed approach
I think it works as far as what you mentioned is concerned, there is a dynamic link in the debug samples that downloads the html file when we try to view it, and it is updated according to the notebook
However we access our server from a limited networking machine that can only access AWS ips, and the HTML file is not a standalone and has some dependencies that require networking.. so can only be vi...

or should it be assigned somewhere

I found a super weird fix for this error.. no idea why it works but maybe it can help with debugging it..
try: task = Task.init(project_name="examples", task_name="hydra configuration", reuse_last_task_id=False) except: task = Task.init(project_name="examples", task_name="hydra configuration", reuse_last_task_id=True)