Reputation
Badges 1
75 × Eureka!ok, I will do a simple workaround for this (use an additional parameter that I can update using parameter_override and then check if it exists and update the configuration in python myself)
it is a configuration object (line of my code:config_path = task.connect_configuration(config_path)
which is probably why it does not work for me, right?
I did something similar to what you suggests and it worked, the key insight was that connect and connect_configuration work differently in terms of overrides, thanks!
maybe not at the top but in the Task.init
description
ok, I solved the problem,agent.force_git_ssh_protocol = true
did the trick
just put ssh config with the proper key marked
I did not configure user/pass for git
but seriously, I am very thankful you were willing to spend so much time helping me, I am super impressed by your response time and helpfulness!
I see the text on my screen
but perhaps it is worth adding to the docs page a hint to avoid using the CLEARML_TASK_ID env variable, perhaps I am not the only one to ever try it
I could have been more inventive as well 😄
yes, I don't know whether you have access to the backend, but just in case my experiment is this one:
ClearML results page: https://app.clear.ml/projects/45557a1ee1464631a9a18b0dcda4f682/experiments/01b77a220869442d80af42efce82c617/output/log
the situation is:
I can report a scalar by calling clearml_task.logger.report_scalar
and it becomes immediately visible in the web ui
no, I set the env variable CLEARML_TASK_ID myself
I can hardcode it into program if you want
Just to let you know, it now works (obviously) in the k8s setting as well.
now it stopped working locally as well
console output:ClearML results page:
01b77a220869442d80af42efce82c617 some text 2022-03-21 22:47:16,660 - clearml.Task - INFO - Waiting to finish uploads 2022-03-21 22:47:28,217 - clearml.Task - INFO - Finished uploading
I can't make anything appear in the console part of the ui
report_scalar works, report_text does not, this is very weird
task status is running in the webui
my code snippet
` from clearml import Task
import os
clearml_task_id = os.environ['CLEARML_TASK_ID']
Task.debug_simulate_remote_task(clearml_task_id)
clearml_task = Task.init(auto_connect_arg_parser=False, auto_resource_monitoring=False)
print(clearml_task.id)
clearml_task.logger.report_scalar(series='s', value='123', iteration=2, title='title')
clearml_task.logger.report_text("some text") `
yes, I am calling Task.init
where is the endpoint located? I can't find it, were only able to find this:
https://github.com/allegroai/clearml/blob/ccc8e83c58336928424ed14b176306b149258512/examples/services/monitoring/slack_alerts.py#L55
and in the future I do want to have an Agent on the k8s cluster, but then this should not be a problem I guess as the user is set during Task.init
, right?
I subscribe to the problem of having large metrics without a tool for proper inspection what is it coming from.
ok, but do you know why did it try to reuse in the first place?
I circumvented the problem by putting timestamp in task name, but I don't think this is necessary.