Reputation
Badges 1
46 × Eureka!Nope sorry I don't have that, but this was our discussion about it: https://clearml.slack.com/archives/CTK20V944/p1665477602050259
Thanks for trying to help me out! Here's some code that should reproduce the error (at least, it did for me): https://github.com/allegroai/clearml-agent/issues/111
If you have any ideas as to what could go wrong, I'd be happy to look at it. But since my venv is rebuilt at each new agent run, I'm really struggling to debug it
This is from the console by the way
Apparently, the issue is that it will always pass None if there's no default value
So this seems like it could work as a work-around:
` Python 3.10.6 (main, Aug 10 2022, 11:40:04) [GCC 11.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
import numpy as np
a = np.ones((100, 100, 3))
a.take(range(40), 0).take(range(40), 1).shape
(40, 40, 3)replaces a[0:40, 0:40] `
Just dropping this here but I've had some funky compressions with very small datasets! It's not a big issue though, since it's still small and doesn't really affect anything
From what I've seen, another fix would be to pass a default value to your parameters, for example: def executing_pipeline(start_date=0, end_date=0):
If I refresh, the project is still there 😕
But this works strangely:
` @PipelineDecorator.component(cache=False, execution_queue="default")
def get_param():
return 'hello'
@PipelineDecorator.component(cache=False, execution_queue="default")
def get_best_model(task_ids):
import ...
print('task_ids:', task_ids, type(task_ids)) # task_ids: None <class 'NoneType'>
...
@PipelineDecorator.pipeline(
name='...',
project='...',
version='0.1'
)
def pipeline_entry(task_ids: List[str], ...):
print(task_ids, typ...
Yeah I had the same issue: https://clearml.slack.com/archives/CTK20V944/p1664887550256279
This is what I've found, and there's no error that seem to come up
Yes sure CostlyOstrich36 , I'm just trying to pass some arguments from my __main__ to my pipeline_entry() to my component get_best_model() . But for some reason, I'm getting None into get_best_model instead of what I've given it in pipeline_entry
CostlyOstrich36 Here's what I get:
` ERROR TypeError: Unexpected type 'undefined' in select operator, expected 'string' or 'function'
rn ngrx-store.mjs:550
select ngrx-store.mjs:507
deleteEntitiesEffect base-delete-dialog.effects.ts:134
RxJS 13
stateSubscription ngrx-store.mjs:472
RxJS 24
next ngrx-store.mjs:206
dispatch ngrx-store.mjs:515
delete common-delete-dialog.component.ts:112
O common-delete-dialog.component.html:36
Angular 11
core.mjs:7640...
I had the same issue, they fixed it in 1.7.2rc1 I think. You can try pip install clearml==1.7.2rc1
Alright! I'll take a look at it. It's also nice to know that pipelines will take care of it. Thanks!
This crashes with:File "/tmp/tmpa5l_cvuv.py", line 8 crop = image[(0:50, 0:50)] ^ SyntaxError: invalid syntax
Yeah me too, I had no idea what was happening 😅
But I've got /opt/clearml/data/fileserver/examples/.pipelines/custom pipeline logic which has a bunch of folders of old tasks
Yes sure, I will do that
I wasn't able to reproduce it with a simple piece of code, I'll try to see later if I can. But what I've seen is that I was logging too many images and it was somehow missing my last reports. With fewer image logs it seems like it's working normally
I can make an issue in GitHub if that helps keep track of it
WebApp: 1.7.0-232 • Server: 1.7.0-232 • API: 2.21
It's a bit strange, my pipeline is called "custom pipeline logic" (which I renamed to "blop" later). This api_client.projects.get_all(name=exact_match_regex("pipeline_project/.pipelines/blop"), search_hidden=True) returns nothing and this api_client.projects.get_all(name=exact_match_regex("pipeline_project/.pipelines/custom pipeline logic"), search_hidden=True) returns nothing either
Here are the versions: WebApp: 1.7.0-232 • Server: 1.7.0-232 • API: 2.21
I'm still in 1.7.0 because of the None arguments thing for now, but I'll test with the latest version if I ever find any other issue
From what I could see, generating SHA2:
i7-10700K: ~ 10 - 15 minutes Xeon E3-1240: 4 - 5 hours!Then in both cases I still have about an 1h30 to upload the images to the fileserver. Which I also find quite a bit slow, but the ClearML fileserver is on my old Xeon. I plan to upgrade my server and to test it again
Alright, thanks! I can confirm that it works in 1.7.1