So far I have taken one mnist image, and done the following:
` from PIL import Image
import numpy as np
def preprocess(img, format, dtype, h, w, scaling):
sample_img = img.convert('L')
resized_img = sample_img.resize((1, w*h), Image.BILINEAR)
resized = np.array(resized_img)
resized = resized.astype(dtype)
return resized
png img file
img = Image.open('./7.png')
preprocessed img, FP32 formated numpy array
img = preprocess(img, format, "float32", 28, 28, None)
...
right, and why can't a particular version be found? how it does it try to find python versions?
logger.report_media( title=name_title, series="Nan", iteration=0, local_path=fig_nan, delete_after_upload=delete_after_upload, ) clearml_task.upload_artifact( name=name_title, artifact_object=fig_nan, wait_on_upload=True, )
clearml-agent 1.2.3
i expected to see 2 tasks running, and then when completed the remaining 2 could start. Is this not the expected behavior?
in particular, I ran the agent with clearml-agent daemon --queue test-concurrency --create-queue --services-mode 2 --docker "ubuntu:20.04" --detached
and enqueued 4 tasks to it that sleep 15 minutes.
I can see all 4 tasks running, see
But where do you manually set the name of each task in this code? the .component
has a name
argument you can provide
i'm guessing the cleanup_period_in_days can only actually run every day or whatever if the script is enqueued to services
Not sure why it tries to establish some http connection, or why it's /
...
I am tagging AgitatedDove14 since I sort of need an answer asap...!
ah.. agent was on a different machine..
if i enqueue the script to the services
queue but run_as_service
is false, what happens?
hiya Jake, how do I inject this with the extra_docker_shell_script
setting?
it's from the github issue you sent me but i don't know what the "application" part is or the "NV-InferRequest:...."
I am curious about the updates on version 1.0.0, where can I see some info regarding this?
Passing state information from pre to postprocessing and the dynamic preprocessing code thing, for example
Right, I used --services-mode 2
and it still runs more than 2 tasks simultaneously
SuccessfulKoala55 I can't get it to work... I tried using the pip conf locally and it works, but the agent doesn't seem to be able to install the package
tagging @<1523701205467926528:profile|AgitatedDove14> here just in case 😅
Same thing SuccessfulKoala55 😞
Hi SuccessfulKoala55 I am having some issues with this. I have put a concurrency limit of 2 and I can see 3 workers running
The package on my index is called data-service-client
, see the log below:Looking in indexes:
,
`
WARNING: The repository located at unicorn is not a trusted or secure host and is being ignored. If this repository is available via HTTPS we recommend you use HTTPS instead, otherwise you may silence this warning and allow it anyway with '--trusted-host unicorn'.
ERROR: Could not find a version that satisfies the requirement data-service-client==1.0.0 (from -r /tmp/cached-reqs1...
i'm not sure how to double check this is the case when it happens... usually we have all requirements specified with git repo
i'm also not sure what this is-H "Content-Type: application/octet-stream" -H' NV-InferRequest:batch_size: 1 input { name: "dense_input" dims: [-1, 784] } output { name: "activation_2" cls { count: 1 } }'
I see, ok!
I will try that out.
Another thing I noticed: none of my pipeline tasks are reporting these graphs, regardless of runtime. I guess this line would also fix that?