Reputation
Badges 1
75 × Eureka!traceback:
` Traceback (most recent call last):
File "/home/marek/nomagic/monomagic/ml/tiresias/calibrate_and_test.py", line 57, in <module>
Task.add_requirements('requirements.txt')
File "/home/marek/.virtualenvs/tiresias-3.9/lib/python3.9/site-packages/clearml/backend_interface/task/task.py", line 1976, in add_requirements
for req in pkg_resources.parse_requirements(requirements_txt):
File "/home/marek/.virtualenvs/tiresias-3.9/lib/python3.9/site-packages/pkg_resources/_init...
this is part of repository
@<1523701435869433856:profile|SmugDolphin23> it did not help, shall I create smallest example when it does not work and paste it here?
AgitatedDove14 do you have two sets of documentations: for the free tier and paid? (our team is on the pro plan, but I might have been using the documentation of the open sourced version, so want to double check)
AgitatedDove14 np
FrothyDog40 thanks!
@<1523701087100473344:profile|SuccessfulKoala55> I am using it as follows:
after calling clearml.Task.init()
I create an object:
cache = Cache('/scidata/marek/diskcache')
and then in the loading function I do:
if cache_arg in load_and_crop.cache:
return load_and_crop.cache[cache_arg] ...
@<1523701435869433856:profile|SmugDolphin23> I have checked that when setting auto_connect_frameworks=False it works, but disabling just joblib is not enough.
maybe another warning here? https://clear.ml/docs/latest/docs/references/sdk/task/
Just to let you know, it now works (obviously) in the k8s setting as well.
now it stopped working locally as well
my code snippet
` from clearml import Task
import os
clearml_task_id = os.environ['CLEARML_TASK_ID']
Task.debug_simulate_remote_task(clearml_task_id)
clearml_task = Task.init(auto_connect_arg_parser=False, auto_resource_monitoring=False)
print(clearml_task.id)
clearml_task.logger.report_scalar(series='s', value='123', iteration=2, title='title')
clearml_task.logger.report_text("some text") `
I could have been more inventive as well 😄
task status is running in the webui
but seriously, I am very thankful you were willing to spend so much time helping me, I am super impressed by your response time and helpfulness!
maybe not at the top but in the Task.init
description
yes, I don't know whether you have access to the backend, but just in case my experiment is this one:
ClearML results page: https://app.clear.ml/projects/45557a1ee1464631a9a18b0dcda4f682/experiments/01b77a220869442d80af42efce82c617/output/log
console output:ClearML results page:
01b77a220869442d80af42efce82c617 some text 2022-03-21 22:47:16,660 - clearml.Task - INFO - Waiting to finish uploads 2022-03-21 22:47:28,217 - clearml.Task - INFO - Finished uploading
the situation is:
I can report a scalar by calling clearml_task.logger.report_scalar
and it becomes immediately visible in the web ui
report_scalar works, report_text does not, this is very weird
I can't make anything appear in the console part of the ui
no, I set the env variable CLEARML_TASK_ID myself
I am only getting one user for some reason, even though 4 are in the system
I don't see such a method in the docs, but it seems so natural that decided to ask.
SuccessfulKoala55 that worked, thanks a lot!
just put ssh config with the proper key marked
I did not configure user/pass for git
ok, I will do a simple workaround for this (use an additional parameter that I can update using parameter_override and then check if it exists and update the configuration in python myself)