Reputation
Badges 1
195 × Eureka!CumbersomeCormorant74 displaying a 3D Field varying in time, or anything varying in time really
Thanks it can be super cool, I hope it will happen
TimelyPenguin76 , I generate it manually , clone some task -> adjust config -> enqueue
then when the agent pulls it I get the following behaviorremote_dict = task.connect(local_dict) # matching keys are overridden from remote config
which I can't reproduce as I described above
is there an available reference for how I can use the API calls with the python API? it is not clear to me from what you shared
How can we increase the number of API server processes?
if I can't "pull", execute, report tasks from the same persistent python script it doesn't solve the problem of avoiding rerunning some heavy setup for a lightweight trial
it works.. but I am actually trying to access the status not the stats, is that an option?
parameters = { 'float': 2.2, 'string': 'my string', }
for example.. can be anything really, some dictionary
it is still relevant if you have any ideas
SuccessfulKoala55 .. so no ideas how to proceed?
some arbitrary job.. can be executed in parallel to a running job on the same agent.
directly from the UI from the services queue?
It does, I am familiar with it I used it many times
let me try to explain myself again
kind of on the same topic, it would be very useful if some kind of verbosity will be enabled.. some kind of progress bar for get_top_experiments()
AgitatedDove14 no it has an offset of the value that it started with, so for example you stopped at n, then when you are running the n+1 epoch you get the 2*n+1 reported
the report media workaround I suggested was referring to having the preview directly in the debug_samples of the given task
AgitatedDove14 after a small test run we done, we get some issues with the proposed approach
I think it works as far as what you mentioned is concerned, there is a dynamic link in the debug samples that downloads the html file when we try to view it, and it is updated according to the notebook
However we access our server from a limited networking machine that can only access AWS ips, and the HTML file is not a standalone and has some dependencies that require networking.. so can only be vi...
AgitatedDove14 seem to work in terms of updating the file which is great! the notebook HTML preview seem not to work though.. I guess you are aware of it because the displayed text is saying something like click the link to view the file
Thanks AgitatedDove14 , we have no issue with "html stuck in cache" I'm not sure what are you referring to..
Hi AgitatedDove14 , so it looks something like this:
` Task.init
trainer.fit(model) # clearml logging starts from 0 and logs all summaries correctly according to real count
triggered fit stopping at epoch=n
something
trainer.fit(model) # clearml logging starts from n+n (thats how it seems) for non explicit scalar summaries (debug samples, scalar resources monitoring, and also global iteration count)
triggered fit stopping
... `I am at the moment diverging from this implementation to s...
AgitatedDove14 , definitely so, this is very generic and very useful
In many cases the objective is just one of multiple metrics of interest, so for me almost always I would want to combine it with the rest of the scalar metrics
The "notebook preview" link doesn't pop-up the s3 credentials, however the "notebook" artifact when clicking on the download button does show this pop up
they actually seem to be different in the way that the UI server is showing them.. one is a link (the html) and has no pop up, the other one (.ipynb) is a text with a download button in the end of the string which does show the mentioned pop up
we just found it out ourselves , https://github.com/jupyter/nbconvert/issues/754
AnxiousSeal95 , the roaming people, how can I find them actually?
AgitatedDove14 should be, I'll try to create a small example later today or tomorrow
so actually in our case we have an S3 link, but when downloading it, it seems correct.. there is probably some way to make an S3 path open up in the browser by default
AgitatedDove14 , as a temporary workaround, I was wondering how hard would it be to actually use the callback mechanism and manually register the notebook html with something likeLogger.current_logger().report_media("html", "url_html", iteration=iteration, url="
")
?
or actually the local html, I believe it should work for a mounted s3
so if I wait a few minutes I will be able to get the latest version?