
Reputation
Badges 1
46 × Eureka!So this seems like it could work as a work-around:
` Python 3.10.6 (main, Aug 10 2022, 11:40:04) [GCC 11.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
import numpy as np
a = np.ones((100, 100, 3))
a.take(range(40), 0).take(range(40), 1).shape
(40, 40, 3)replaces a[0:40, 0:40] `
I'm going to try deleting it using the APIClient
This however works fine:
` Python 3.10.6 (main, Aug 10 2022, 11:40:04) [GCC 11.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
import numpy as np
a = np.ones((100, 100, 3))
a[0:50, 0:50].shape
(50, 50, 3)
`
Yeah I had the same issue: https://clearml.slack.com/archives/CTK20V944/p1664887550256279
This crashes with:File "/tmp/tmpa5l_cvuv.py", line 8 crop = image[(0:50, 0:50)] ^ SyntaxError: invalid syntax
This is what I've found, and there's no error that seem to come up
But I've got /opt/clearml/data/fileserver/examples/.pipelines/custom pipeline logic
which has a bunch of folders of old tasks
Nothing strange in dmesg
at least 😕
It's a bit strange, my pipeline is called "custom pipeline logic" (which I renamed to "blop" later). This api_client.projects.get_all(name=exact_match_regex("pipeline_project/.pipelines/blop"), search_hidden=True)
returns nothing and this api_client.projects.get_all(name=exact_match_regex("pipeline_project/.pipelines/custom pipeline logic"), search_hidden=True)
returns nothing either
I'm not sure how I broke it 😅
Do you know where I can find the logs for that?
This is from the console by the way
But this works strangely:
` @PipelineDecorator.component(cache=False, execution_queue="default")
def get_param():
return 'hello'
@PipelineDecorator.component(cache=False, execution_queue="default")
def get_best_model(task_ids):
import ...
print('task_ids:', task_ids, type(task_ids)) # task_ids: None <class 'NoneType'>
...
@PipelineDecorator.pipeline(
name='...',
project='...',
version='0.1'
)
def pipeline_entry(task_ids: List[str], ...):
print(task_ids, typ...
Here are the versions: WebApp: 1.7.0-232 • Server: 1.7.0-232 • API: 2.21
If I refresh, the project is still there 😕
Yep I'm dumb, it worked. However I've launch a couple of tasks with name
='custom pipeline logic',
project
='examples'
and I have to delete them manually. When I try through the UI it just waits forever
WebApp: 1.7.0-232 • Server: 1.7.0-232 • API: 2.21
Weeell it seems to work with version 1.7.0 and not with 1.7.1
Yes sure CostlyOstrich36 , I'm just trying to pass some arguments from my __main__
to my pipeline_entry()
to my component get_best_model()
. But for some reason, I'm getting None
into get_best_model
instead of what I've given it in pipeline_entry
From what I've seen, another fix would be to pass a default value to your parameters, for example: def executing_pipeline(start_date=0, end_date=0):
Nope sorry I don't have that, but this was our discussion about it: https://clearml.slack.com/archives/CTK20V944/p1665477602050259
I had the same issue, they fixed it in 1.7.2rc1 I think. You can try pip install clearml==1.7.2rc1
Yeah me too, I had no idea what was happening 😅
CostlyOstrich36 This looks like a bug? Here's a simpler version of it and what I'm getting:
` from clearml.automation.controller import PipelineDecorator
@PipelineDecorator.component(cache=False)
def step_one(my_arg):
print('step_one/my_arg:', my_arg) # step_one/my_arg: None
# I should not get None here! At least that's what I'm expecting
@PipelineDecorator.pipeline(name='custom pipeline logic', project='examples', version='0.0.5')
def executing_pipeline(my_arg):
print('my_ar...
Sooo for the SHA2 generation, I've tested 2 very different CPUs, and it makes a HUGE difference 😅 I probably have to upgrade my server