Thanks for trying to help me out! Here's some code that should reproduce the error (at least, it did for me): https://github.com/allegroai/clearml-agent/issues/111

From what I could see, generating SHA2:
i7-10700K: ~ 10 - 15 minutes Xeon E3-1240: 4 - 5 hours!Then in both cases I still have about an 1h30 to upload the images to the fileserver. Which I also find quite a bit slow, but the ClearML fileserver is on my old Xeon. I plan to upgrade my server and to test it again

I wasn't able to reproduce it with a simple piece of code, I'll try to see later if I can. But what I've seen is that I was logging too many images and it was somehow missing my last reports. With fewer image logs it seems like it's working normally

But I've got /opt/clearml/data/fileserver/examples/.pipelines/custom pipeline logic which has a bunch of folders of old tasks

With default settings, to upload 2 datasets of 120 GB and 70 Gb it took more than 6 hours! And this is to upload the dataset on the server itself, the upload pipeline is done on the same computer as clearml

If I refresh, the project is still there 😕

Yes sure, I will do that

Yep I'm dumb, it worked. However I've launch a couple of tasks with name ='custom pipeline logic', project ='examples' and I have to delete them manually. When I try through the UI it just waits forever

From what I've seen, another fix would be to pass a default value to your parameters, for example: def executing_pipeline(start_date=0, end_date=0):

I had the same issue, they fixed it in 1.7.2rc1 I think. You can try pip install clearml==1.7.2rc1

Just dropping this here but I've had some funky compressions with very small datasets! It's not a big issue though, since it's still small and doesn't really affect anything

I'm not sure how I broke it 😅

This is what I've found, and there's no error that seem to come up

Alright! I'll take a look at it. It's also nice to know that pipelines will take care of it. Thanks!

I can make an issue in GitHub if that helps keep track of it

Apparently, the issue is that it will always pass None if there's no default value

WebApp: 1.7.0-232 • Server: 1.7.0-232 • API: 2.21

Alright, thanks! I can confirm that it works in 1.7.1

Yep, everything works now, thanks!

I'm going to try deleting it using the APIClient

If you have any ideas as to what could go wrong, I'd be happy to look at it. But since my venv is rebuilt at each new agent run, I'm really struggling to debug it

CostlyOstrich36 Here's what I get:
` ERROR TypeError: Unexpected type 'undefined' in select operator, expected 'string' or 'function'
rn ngrx-store.mjs:550
select ngrx-store.mjs:507
deleteEntitiesEffect base-delete-dialog.effects.ts:134
RxJS 13
stateSubscription ngrx-store.mjs:472
RxJS 24
next ngrx-store.mjs:206
dispatch ngrx-store.mjs:515
delete common-delete-dialog.component.ts:112
O common-delete-dialog.component.html:36
Angular 11
core.mjs:7640...

Nope sorry I don't have that, but this was our discussion about it: https://clearml.slack.com/archives/CTK20V944/p1665477602050259

Thank you very much!

Yes

This is from the console by the way

Thanks for the response, I don't have any specific reason. I just wanted to have a something cleaner. We don't have much projects yet, so we just get these examples in the way. But it's not bad, I was just wondering. I'll remember to check for the environment variables for our next ClearML install. Thanks anyways, I won't take the trouble of removing them then

Found it!

Yeah, I understand that it's a bit confusing what I'm asking. Here's a sample code:
` from clearml.automation.controller import PipelineDecorator

@PipelineDecorator.component(cache=True)
def step_one():
import numpy as np

image = np.ones((100, 100, 3))
crop = image[0:50, 0:50]
print("here's my crop of shape:", crop.shape)

@PipelineDecorator.pipeline(name='custom pipeline logic', project='examples', version='0.0.5')
def executing_pipeline():
step_one()

if name ==...

Nothing strange in dmesg at least 😕