Reputation
Badges 1
46 × Eureka!Yeah, I understand that it's a bit confusing what I'm asking. Here's a sample code:
` from clearml.automation.controller import PipelineDecorator
@PipelineDecorator.component(cache=True)
def step_one():
import numpy as np
image = np.ones((100, 100, 3))
crop = image[0:50, 0:50]
print("here's my crop of shape:", crop.shape)
@PipelineDecorator.pipeline(name='custom pipeline logic', project='examples', version='0.0.5')
def executing_pipeline():
step_one()
if name ==...
So this seems like it could work as a work-around:
` Python 3.10.6 (main, Aug 10 2022, 11:40:04) [GCC 11.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
import numpy as np
a = np.ones((100, 100, 3))
a.take(range(40), 0).take(range(40), 1).shape
(40, 40, 3)replaces a[0:40, 0:40] `
Not really, it's an Ubuntu desktop machine that I'm just updating times to times. I've also got a few pipelines running during my trainings. Do you know any tools that I could use to analyze network errors?
We've updated everything now, launched a new experiment and we're tracking the logs. I'll tell you if I find anything
Yes sure, I will do that
This crashes with:File "/tmp/tmpa5l_cvuv.py", line 8 crop = image[(0:50, 0:50)] ^ SyntaxError: invalid syntax
Yeah I had the same issue: https://clearml.slack.com/archives/CTK20V944/p1664887550256279
With default settings, to upload 2 datasets of 120 GB and 70 Gb it took more than 6 hours! And this is to upload the dataset on the server itself, the upload pipeline is done on the same computer as clearml
Alright! I'll take a look at it. It's also nice to know that pipelines will take care of it. Thanks!
I can make an issue in GitHub if that helps keep track of it
Thanks for the response, I don't have any specific reason. I just wanted to have a something cleaner. We don't have much projects yet, so we just get these examples in the way. But it's not bad, I was just wondering. I'll remember to check for the environment variables for our next ClearML install. Thanks anyways, I won't take the trouble of removing them then
My computer just did an automatic suspend, as simple as that
WebApp: 1.7.0-232 • Server: 1.7.0-232 • API: 2.21
From what I've seen, another fix would be to pass a default value to your parameters, for example: def executing_pipeline(start_date=0, end_date=0):
Nothing strange in dmesg
at least 😕
CostlyOstrich36 Here's what I get:
` ERROR TypeError: Unexpected type 'undefined' in select operator, expected 'string' or 'function'
rn ngrx-store.mjs:550
select ngrx-store.mjs:507
deleteEntitiesEffect base-delete-dialog.effects.ts:134
RxJS 13
stateSubscription ngrx-store.mjs:472
RxJS 24
next ngrx-store.mjs:206
dispatch ngrx-store.mjs:515
delete common-delete-dialog.component.ts:112
O common-delete-dialog.component.html:36
Angular 11
core.mjs:7640...
I had the same issue, they fixed it in 1.7.2rc1 I think. You can try pip install clearml==1.7.2rc1
I wasn't able to reproduce it with a simple piece of code, I'll try to see later if I can. But what I've seen is that I was logging too many images and it was somehow missing my last reports. With fewer image logs it seems like it's working normally
Yeah me too, I had no idea what was happening 😅
If you have any ideas as to what could go wrong, I'd be happy to look at it. But since my venv is rebuilt at each new agent run, I'm really struggling to debug it
Thanks for trying to help me out! Here's some code that should reproduce the error (at least, it did for me): https://github.com/allegroai/clearml-agent/issues/111