Maybe they shouldn't be placed under /tmp if they're mission critical, but rather the clearml cache folder? 🤔

@<1523701205467926528:profile|AgitatedDove14> this

Looks great, looking forward to the all the new treats 😉
Happy new year! 🎉

I think -

• Creating a pipeline from tasks is useful when you already ran some of these tasks in a given format, and you want to replicate the exact behaviour (ignoring any new code changes for example), while potentially changing some parameters.
• From decorators - when the pipeline logic is very straightforward and you'd like to mostly leverage pipelines for parallel execution of computation graphs
• From functions - as I described earlier :)

I see that the GUI AutoScaler is only in the paid version, wonder why the GCP driver is not open source?

SweetBadger76 TimelyPenguin76
We're finally tackling this (since it has kept us back at 1.3.2 even though 1.6.2 is out...), and noticed that now the bucket name is also part of the folder?

So following up from David's latest example:
StorageManager.download_folder(remote_url='s3://****-bucket/david/', local_folder='./')Actually creates a new folder ./****-bucket/david/ and puts it contents there.

EDIT: This is with us using internal MinIO, so I believe ClearML parses that end...

Yes, thanks AgitatedDove14 ! It's just that the configuration object passed onwards was a bit confusing.
Is there a planned documentation overhaul? 🤔

Any updates on this? We can't do anything with our K8s since this 404...

I see, okay that already clarifies some stuff, I'll dig a bit more into this then! Thanks!

@<1523704157695905792:profile|VivaciousBadger56> It seems like whatever you pickled in the zip file relies on some additional files that are not pickled.

I can also do this via Mongo directly, but I was hoping to skip the K8S interaction there.

I'm also getting the following warning, I guess it's some ClearML dependency?
IPython could not be loaded!

Where do I import this APIClient from AgitatedDove14 ? I meanwhile edited it directly in mongo, but editing a db directly on a Friday is a big nono

An internal project I've accidentally made with a hidden tag while playing around with the ClearML internal code.

I'd like to remove the hidden system tag from a project

Hm. Is there a simple way to test tasks, one at a time?

We can change the project name’s of course, if there’s a suggestion/guide that will make them see past the namespace…

Thanks SuccessfulKoala55 ! Is this listed anywhere in the documentation?
Could I set an environment variable there and then refer to it internally in the config with the ${...} notation?

I see https://github.com/allegroai/clearml-agent/blob/d2f3614ab06be763ca145bd6e4ba50d4799a1bb2/clearml_agent/backend_config/utils.py#L23 but not where it's called 🤔

I'm aware, but it would be much cleaner to define them in the worker's clearml.conf and let ClearML expose them locally to running tasks.

EDIT: Also the above is specifically about serving, which is not the target here 🤔 At least not yet 😄

nevermind! Found and answered (solution in the issue linked above)

And agent too, I hope..?

I'd be happy to join a #releases channel just for these!

Just randomly decided to check and saw there's a server 1.4 ready 🎉

PricklyRaven28 That would be my fallback, it would make development much slower (having to build containers with every small change)

I'm saying it's a bug

QuaintPelican38 did you have a workaround for this then? Some cleanup service or similar?

SuccessfulKoala55 This is due to the pip update in clearml-agent

I just set the git credentials in the clearml.conf and it works out of the box

🤔

Latest (1.5.1 I believe?), full log incoming, but it's like I've posted elsewhere already 🤔
It just sets up the environment and immediately crashes when trying to run the code.
The setup itself is done correctly.

It's a bit hard to read when they'll all clustered together:

Yeps