
Reputation
Badges 1
109 × Eureka!is there a way to prevent from creating a new setup in my worker each time?
if I write:
in tl2 conf : default_
output_uri
: "/home/tglema/clearml"
in GCP it saves in that same dir
ok, ran the script, and had the same issue..I detected another bug I think..going to put it outside the thread
not sure, I'm using GCS not S3. Is download_folder
doing something different than downloading all files inside the folder?
My setting is the following:
-run script in tl2 (local server)
-clone task and enque it, run it in GCP
Ideally I would like to:
if the script in run in tl2 it should save to local filesystem if the script is run in GCP it should save to GS
Hi! I was going to ask about this, but I didn't understand the solution...currently logs are >100MB because of this..is there a way to save the line only once the epoch is done? AgitatedDove14
btw, I think this should be the output of report_confusion_matrix
...what do you think?
I don't see anything in the CONFIGURATION section:
but it still saves using the output_uri from the server that created the task
it does! thanks! I thought I had to modify the scripts, but now I see that it does it with the parameter_override
what could be wrong?
Python 3.7.3 (default, Dec 20 2019, 18:57:59) [GCC 8.3.0]
absl_py == 0.10.0
azure_storage_blob == 12.7.1
clearml == 0.17.4
google_cloud_storage == 1.35.0
Detailed import analysis
**************************
IMPORT PACKAGE absl_py
generate_tfrecord_pipeline.py: 3
IMPORT PACKAGE azure_storage_blob
clearml.storage: 0
IMPORT PACKAGE clearml
generate_tfrecord_pipeline.py: 1
IMPORT PACKAGE google_cloud_storage
clearml.storage: 0
and then it works
sure, but I don't know if this doesn't break something else
This is only with Detect API ?
I only tested it with the Detect API
great, let me know if I can help you in any way. Thanks!
I don't understand what I'm doing wrong..how are you supposed to call the remove_files
function?
are you planning on changing to f-strings incrementally?
so with these two configurations, and no output_uri in the task creation in the script:
I get model saved model in tl2 and in GCP (when run as agent):
/home/tglema/git_repo/~/clearml/