I added folder with images, and then the pickle file with the descriptions: dataset.add_files('pickle_file.pkl')

I had to mask some parts 😁

it is ok?
Task init
params setup
task.execute_remotely()
real_code here

if I have 2.4 or 2.2 in both there is no issue

and is this image just a VM with a docker?

thanks! that was the script I used..but for same reason making two sbs was a bit more complicated than just stacking two..
but I was finally able to do it:

File "aicalibration/generate_tfrecord_pipeline.py", line 30, in <module>
  task.upload_artifact('train_tfrecord', artifact_object=fn_train)
 File "/home/usr_341317_ulta_com/.clearml/venvs-builds/3.7/lib/python3.7/site-packages/clearml/task.py", line 1484, in upload_artifact
  auto_pickle=auto_pickle, preview=preview, wait_on_upload=wait_on_upload)
 File "/home/usr_341317_ulta_com/.clearml/venvs-builds/3.7/lib/python3.7/site-packages/clearml/binding/artifacts.py", line 560, in upload_artifa...

no, to the current task

so it's not running docker under the hood?

following this: https://allegro.ai/clearml/docs/docs/deploying_clearml/clearml_server_gcp.html

awesome! will you do the PR or should I?

it does! thanks! I thought I had to modify the scripts, but now I see that it does it with the parameter_override

thanks!

great, thanks!

so in my main file I have:

from my_package import dummy_module

dummy_module.func(args)

oh I see..good luck!

great, thanks!

but I like f-strings better

I understand that it uses time in seconds when there is no report being logged..but, it has already logged three times..

ah, I see..so I do it in master or in 0.17.5rc3?

not sure, I'm using GCS not S3. Is download_folder doing something different than downloading all files inside the folder?

I don't understand what I'm doing wrong..how are you supposed to call the remove_files function?

ahh, I see cool 🙂

I see, thanks!

the issue is with StorageManager.download_folder

all is good 🙂

If I download each file in the folder using StorageManager.get_local_copy(remote_url=gs_url) , it works OK

Hi! I'm tryin to find a workaround for this: can't do pip install <name_of_package>
I executed the task, and it created a cache venv.
But when running the code, it couldn't import the package because it wasn't listed.
I then sourced the venv, and manually installed the package
so if I do python -c 'import object_detection' if works

How would you like me to share it?
So far I have this:
tensorflow_object_detection_autoinstall.sh
Before running:
You need to set your venv
install numpy
export TF_DIR=$HOME/tensorflow mkdir $TF_DIR cd $TF_DIR echopwdwget unzip protoc-3.14.0-linux-x86_64.zip -d protoc export PATH=$PATH:pwd`/protoc/bin

git clone
cd models
git checkout 8a06433
cd $TF_DIR/models/research
protoc object_detection/protos/*.proto --python_out=.

git clone
cd cocoapi/PythonAPI
make
cp -r py...

this creates the whl package that I then use in my requirements.txt file directly