is there a way to prevent from creating a new setup in my worker each time?

do I create an issue for this as well? SuccessfulKoala55 ?

I've included a requirements.txt file

did you do a git init?

if I write:
in tl2 conf : default_ output_uri : "/home/tglema/clearml"
in GCP it saves in that same dir

ok, ran the script, and had the same issue..I detected another bug I think..going to put it outside the thread

not sure, I'm using GCS not S3. Is download_folder doing something different than downloading all files inside the folder?

this is the one in tl2

My setting is the following:
-run script in tl2 (local server)
-clone task and enque it, run it in GCP
Ideally I would like to:
if the script in run in tl2 it should save to local filesystem if the script is run in GCP it should save to GS

Hi! I was going to ask about this, but I didn't understand the solution...currently logs are >100MB because of this..is there a way to save the line only once the epoch is done? AgitatedDove14

btw, I think this should be the output of report_confusion_matrix ...what do you think?

is that clearer?

sure

I don't see anything in the CONFIGURATION section:

but it still saves using the output_uri from the server that created the task

oh I see..good luck!

it does! thanks! I thought I had to modify the scripts, but now I see that it does it with the parameter_override

what could be wrong?

Python 3.7.3 (default, Dec 20 2019, 18:57:59) [GCC 8.3.0]

absl_py == 0.10.0
azure_storage_blob == 12.7.1
clearml == 0.17.4
google_cloud_storage == 1.35.0

Detailed import analysis

**************************

IMPORT PACKAGE absl_py

generate_tfrecord_pipeline.py: 3

IMPORT PACKAGE azure_storage_blob

clearml.storage: 0

IMPORT PACKAGE clearml

generate_tfrecord_pipeline.py: 1

IMPORT PACKAGE google_cloud_storage

clearml.storage: 0

and then it works

sure, but I don't know if this doesn't break something else

is this ok?

This is only with Detect API ?

I only tested it with the Detect API

even though I have set the default_output_uri in GCPs conf file

great, let me know if I can help you in any way. Thanks!

this is the one in GCP

I don't understand what I'm doing wrong..how are you supposed to call the remove_files function?

are you planning on changing to f-strings incrementally?

so with these two configurations, and no output_uri in the task creation in the script:
I get model saved model in tl2 and in GCP (when run as agent):
/home/tglema/git_repo/~/clearml/

ping AgitatedDove14 ... 😄