Hi PleasantGiraffe85 - welcome to ClearML 😄
The ElasticSearch is used to index various aspects of the experiment and devops process, e.g. index experiment-specific metrics and events, execution agents performance reports etc.

How about curl http://localhost:8008 ?

Hi @<1570220858075516928:profile|SlipperySheep79> , are you by any chance uploading large debug images?

EcstaticBaldeagle77 If you look at the installation instructions, you'll you're using incorrect folder names for some of the folders you've created (see https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server_linux_mac ) - specifically, elastic should be elastic_7 and mongo should be mongo_4

@<1533982060639686656:profile|AdorableSeaurchin58> I see no problem in those logs. I can only assume perhaps an upgrade was performed and the new docker-compose.yml file uses a different data folder as the mount point for the ES data folder?

Well, let me check 🙂

latest version? only the clearml chart?

MammothGoat53 just realized I simply omitted the https part 😆

If so, perhaps this is a hint? https://stackoverflow.com/questions/65566850/what-permissions-are-needed-to-delete-an-object-from-a-specific-bucket-in-s3

All three 🙂

auth.user

What is the use-case to control it? What are you trying to achieve?

You can just use task.logger.report_scalar() and report_image() for that 🙂

@<1533257407419912192:profile|DilapidatedDucks58> I would assume the docker container is just not starting up correctly for some reason - but the do let logs are essential to understand the issue ..

ClearML agent will delete all datasets

I'm not sure I understood how you've ran the agent...

Indeed. Same address with port 8081

Yeah, that's what I was looking for 🙂

You should adjust the tensorflow version to match the image... Edit the task requirements for that

Well, ClearML currently supports a single repository. If you code needs more, it can clone them explicitly...

Hi @<1523701868901961728:profile|ReassuredTiger98> , this is actually an issue with ES resources being exahusted. Does it only happen when you delete? Is this a self hosted server?

Can you try to upgrade your referencing/attrs version?

Hi @<1535069219354316800:profile|PerplexedRaccoon19> , what you're missing is all the ElasticSearch data

Well, installing t manually would require a lot of work, including building the angular app, and installing various requirements for the different servers (apiserver, fileserver etc.) - without docker, each should be run in it's own virtual python environment

Hi CrookedMonkey33 , I'm not sure I understand your meaning, how exactly?

did you add the fileserver to your configuration file?

It doesn't have to be on the same hardware, but if you're using docker-compose, that's the default

Sorry for the delay 🙏 - how do you import your packages and where do you initialize ClearML relative to the rest of the code?

Remapping 8080 will probably mean the web-app won't be able to locate the apiserver on port 8008 since currently it uses substitution to do that, but as you said, this doesn't seem to be related to the error you've sent. The seems to be related to the fact the apiserver can't communicate with the Elastic instance

The priority is simply the queues location in the list. If you need to change the order, shut down the Trains Agents and start them again with a different queues list (a different order representing your priorities)

The Trains Server Elastic instance has gone into read-only mode due to insufficient disk space