
Reputation
Badges 1
33 × Eureka!AgitatedDove14 Thanks again.
I'm not using a clearml-agent as far as I know (I just run task.init(...) on the AWS machine.
Is there a way to connect to the task without initiating a new one without overriding the execution?
Thanks for the quick reply,
I have a task I run, that have access to the git repo.
Then it initiate a run on aws, which I want it to use the same task-id.
I tried:reuse_last_task_id=a_task_id_string
But it write-over the execution tab in the gui
Whenever I restart the task, I can see images for a while, then after few iteration, I can't anymore
I have a local server not reachable from the internet.
We need the automagic... 🙂
This is one of the great benefits of using clearml 🙂
If I right click and do copy image address - I get:
http://10.156.91.102:8081/semantics_net%252Ftraining/db_lms_preds_as_inputtest.86df109a78e94a21ae000bdd4e4cae97/metrics/Images/binary%20preds/Images_binary%20preds_00000041.jpeg?X-Amz-Date=1634799860337
Not Found The requested URL was not found on the server. If you entered the URL manually please check your spelling and try again.
tf.summary.image('binary preds', plt_c1, max_outputs=5, step=self.get_step(),
description="Left to right: inputs | sigmoid prediction | labels (blue label, white ignore)") `plt_c1 is a tf tensor .
CostlyOstrich36 Page Not Found
CostlyOstrich36
When I just started seeing this issue I could see images from previous iteration. Now some time passed and in the viewer I can't go back to the very first iterations.
CostlyOstrich36 , The issue does come back, after I kill, restart, and wait a few cycles.
Any luck to reproduce it?
SuccessfulKoala55 No logs from clearml in the console, anywhere else I can look?
The project name is:"semantics_net/training"
AgitatedDove14 Regarding the agent - No particular reason. Can you point me on how to do it?
at some point the button of "Older Images" become grey
I killed and restarted the task (it created a new task, with same name, but different id) - and now I can see images again
My question was is can I see the ~/clearml.conf
in the web view. If I run two experiments with different config, where can I see it? It is less important now, I didn't see any changes since it didn't get to the test phase yet.
Regarding the scalar visualization - If you have other solution, it will be nice to try
Run them manually, but it is not that important
CostlyOstrich36 It splits the data not in the way I intended.
It have the 4 metrics of train in the same graph,
and the 4 metrics of test in the same graph.
Can I see the clearml.conf in the server view?
I think I changed it in the right place, but I don't see it in the graph.
CostlyOstrich36 - I don't want to change the TB behavior.
How can I check what is the "title" I guess I have multiple "/" separating "tf.name_scope", "metric.name", and something like summary_name.
TB knows to put all graphs from the same scope in the same section, in that section it has a graph for each "metric.name", and in the graph it have a series for each summary_name.
I guess I can change the scope name to be the metric name, and abandon all the scoping. But it is very useful to me t...
Regarding 2.
Again - can a task id be changed after it was created?