I can see the task in the UI, it is not archived, and that's pretty much the snippet, but in full I do e.g.

No I don't this at all

Thanks for the reply @<1523701827080556544:profile|JuicyFox94> ! I'll debug more and let you know

Not sure if @<1523701087100473344:profile|SuccessfulKoala55> or @<1523701827080556544:profile|JuicyFox94> maybe knows?

Scaling to zero, copying the mongodb data, and scaling back up worked like a charm.

Thanks @<1523701827080556544:profile|JuicyFox94> !

Ah, the API server /users.get_all , I see!

True, and we plan to migrate to pipelines once we have some time for it :) but anyway that condition is flawed I believe

https://github.com/allegroai/clearml/pull/533 🙂

The logs are on the bucket, yes.
The default file server is also set to s3://ip:9000/clearml

proj_suffix = "" i = 2 while Task.get_project_id(f"{proj_name}{proj_suffix}") is not None: tasks = Task.get_tasks(project_name=f"{proj_name}{proj_suffix}") if not [task for task in tasks if not task.get_archived()]: # Empty project, we can use this one... break proj_suffix = f"_{i}" i += 1

Yes

1.8.3; what about when calling task.close() ? We suddenly have a need to setup our logging after every task.close() call

Can I subscribe to updates? 😁

The api.files_server is set to the MinIO endpoint s3://ip:9000/clearml (both locally and remotely) The sdk.development.default_output_uri is set to the MinIO endpoint (both locally and remotely) When we call Task.init I do not set the output_uri at all I get the logger directly with task.get_logger()

Don't even need to specify json=... 😉 Thanks!

clearml.backend_api.session.defs.ENV_HOST.get() did not work unfortunately 🤔

On it! Should I include the additional user filters described above?

I narrowed the bug down to the "fix" in 1.8.1, see my other post

After setting the sdk.development.default_output_uri in the configs, my code kinda looks like:
` task = Task.init(project_name=..., task_name=..., tags=...)
logger = task.get_logger()

report with logger freely `

But it is strictly that if condition in Task.init, see the issue I opened about it

I couldn't find it directly in the SDK at least (in the APIClient)... 🤔

Let me try that real quick

Actually, it appears some elements (scalars, plots, etc) have no migrated by moving mongodb data.
Where are these stored? Any idea @<1523701827080556544:profile|JuicyFox94> ?

Yeah that works fine 😄 I just fetch it once to map argparse users to their IDs for later filtering.

The Slack Monitoring example should be updated btw, as they now use slack_sdk instead of slack (in the import statements)

~20

Kinda, yes, and this has changed with 1.8.1.
The thing is that afaik currently ClearML does not officially support a remotely executed task to spawn more tasks, so we also have a small hack that marks the remote "master process" as a local task prior to anything else.

Thanks!

It is. Let me see what else I have set up for MinIO in configs, one moment

I'll reply there 👌

Hm, I'm not sure I follow 🤔 How does the API server config relate to the file server?