well let me try excecute one of your samples

your example with absl package worked

I commented the upload_artifact at the end of the code and it finishes correctly now

I understand that it uses time in seconds when there is no report being logged..but, it has already logged three times..

just this one...it marks as completed when executed locally

ah, I see..so I do it in master or in 0.17.5rc3?

so how do I make a PR? 😅
I don't have write access..

it's my first PR to an opensource project 😁

I don't understand what I'm doing wrong..how are you supposed to call the remove_files function?

awesome! will you do the PR or should I?

great, thanks!

Thanks!

and is this image just a VM with a docker?

if I change line 217 in dataset.py :
fnmatch(k, '*/'+ wildcard)for
fnmatch(k, wildcard)then it works :-)

File "aicalibration/generate_tfrecord_pipeline.py", line 30, in <module>
  task.upload_artifact('train_tfrecord', artifact_object=fn_train)
 File "/home/usr_341317_ulta_com/.clearml/venvs-builds/3.7/lib/python3.7/site-packages/clearml/task.py", line 1484, in upload_artifact
  auto_pickle=auto_pickle, preview=preview, wait_on_upload=wait_on_upload)
 File "/home/usr_341317_ulta_com/.clearml/venvs-builds/3.7/lib/python3.7/site-packages/clearml/binding/artifacts.py", line 560, in upload_artifa...

I had to mask some parts 😁

so I need to run a sed command to replace some lines in one of the tensorflow files..do you know if I can do this as part of the setup.py install?

https://github.com/GoogleCloudPlatform/python-docs-samples/blob/master/compute/api/create_instance.py I think this is a nice place to start

so in my main file I have:

from my_package import dummy_module

dummy_module.func(args)

I've never created an image before..is it normal to take this long? 15 minutes?

so it's not running docker under the hood?

clearml == 0.17.5rc5
google_cloud_storage == 1.36.1
joblib == 1.0.1
matplotlib == 3.3.4
numpy == 1.20.0
object_detection == 0.1
opencv_python_headless == 4.5.1.48
pandas == 1.2.3
scikit_learn == 0.24.1
tensorflow == 2.4.0

very possible yes..but doesn't it fallback to iteration =epoch then after?

following this: https://allegro.ai/clearml/docs/docs/deploying_clearml/clearml_server_gcp.html

not sure, I'm using GCS not S3. Is download_folder doing something different than downloading all files inside the folder?

I had to downgrade tensorflow 2.4 to 2.2 though..any idea why?

Hi AgitatedDove14 ! Were you able to reproduce this?

I don't think so..I had a problem before 0.17.5

Hi AgitatedDove14 , can you please give me some directions on how to follow this?

let me know if you need any help/ have issues trying to reproduce...thanks!