@<1523701070390366208:profile|CostlyOstrich36> I added None btw

Would it also be loaded on e.g. Task.running_locally() ?

I can't seem to manage the first way around. If I select tasks in different projects, I don't get the bottom bar offering to compare between them

(in the current version, that is, we’d very much like to use them obviously :D)

Yeah I will probably end up archiving them for the time being (or deleting if possible?).

Otherwise (regarding the code question), I think it’s better if we continue the original thread, as it has a sample code snippet to illustrate what I’m trying to do.

Perfect, thanks for the answers Valeriano. These small stuff are missing from the documentation, but I now feel much more confident in setting this up.

Let me double check, one moment

Yes; I tried running it both outside venv and inside a venv. No idea why it uses 2.7?

Looks good! Why is it using an OutputModel and an InputModel?

We do not CostlyFox64 , but this is useful for the future 🙂 Thanks!
TimelyPenguin76 I'll have a look, one moment.

AgitatedDove14 The keys are there, and there is no specifically defined user in .gitmodules :
[submodule "xxx"] path = xxx url =I believe this has to do with how ClearML sets up the git credentials perhaps?

It is. Let me see what else I have set up for MinIO in configs, one moment

Am I making sense ?

No, not really. I don't see how task.connect_configuration interacts with our existing CLI? Additionally, the documentation for task.connect_configuration say the second argument is the name of a file, not the path to it? So something is off

We’re using karpenter (more magic keywords for me), so my understanding is that that will manage the scaling part.

Generally the StorageManager seems a bit slow, even a simple StorageManager.list(...) on a local path seems to take a long time

I guess it's mixed. If #340 is resolved, then this initializer task will be a no-op: detach, and init-close new tasks as needed.

It's a bit hard to read when they'll all clustered together:

Let me verify a hypothesis...

So maybe summarizing (sorry for the spam):

• Pipelines:- Pros: Automatic upload and serialization of input arguments
• Cons: Clutter, does not support classes, cannot inject code, does not recognize environment when run from e.g. IPython- Tasks:- Pros: Tidier and matches original idea, recognizes environment even when run from IPython
• Cons: Does not support classes, cannot inject code, does not automatically upload input arguments

Either? 🙂

Worked like a charm

Unfortunately I can't take a photo of not being able to compare tasks by navigating around the WebUI...

Does that clarify the issue CostlyOstrich36 ?

~ is a bit weird since it's not part of the package (might as well let the user go through clearml-init ), but using ${PWD} works! 👍 👍

(Though I still had to add the CLEARML_API_HOST and CLEARML_WEB_HOST ofc, or define them in the clearml.conf)

Yes 😅 I want ClearML to load and parse the config before that. But now I'm not even sure those settings in the config are even exposed as environment variables?

Exactly, it should have auto-detected the package.

Or well, because it's not geared for tests, I'm just encountering weird shit. Just calling task.close() takes a long time

SmugDolphin23 we've been working with this for 2 weeks now, and it creates a lot of junk in our UI. Is there anyway to have better control over this?

Thanks SuccessfulKoala55 ! Is this listed anywhere in the documentation?
Could I set an environment variable there and then refer to it internally in the config with the ${...} notation?

I see https://github.com/allegroai/clearml-agent/blob/d2f3614ab06be763ca145bd6e4ba50d4799a1bb2/clearml_agent/backend_config/utils.py#L23 but not where it's called 🤔

I think now there's the following:
Resource type Queue (name) defines resource + max instancesAnd I'm looking for:
Resource type "pool" of resources (type + max instances) A pool can be shared among queues

Ah it is.