yes those have all been created

I added this to each of the containers

    logging:
      options:
	    max-file: 5
        max-size: 10m

also, is there a list anywhere with the mount points that are needed?

yep, in most of them:

/opt/clearml/config
apiserver.conf
clearml.conf

/opt/clearml/data/elastic_7
/nodes

/opt/clearml/data/fileserver
<empty>

/opt/clearml/data/mongo/configdb
<empty>

/opt/clearml/data/mongo/db
collection/index files, /diagnostic.data, /journal etc

/opt/clearml/data/redis 
dump.rdb

/opt/clearml/logs
apiserver.log.x, filserver.log (0 bytes)

back up and running again, thanks for your help

not yet, going to try and fix it today.

if I do a df I see this, which is concerning:

Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        3.9G     0  3.9G   0% /dev
tmpfs           3.9G     0  3.9G   0% /dev/shm
tmpfs           3.9G  928K  3.9G   1% /run
tmpfs           3.9G     0  3.9G   0% /sys/fs/cgroup
/dev/nvme0n1p1   20G  7.9G   13G  40% /
tmpfs           790M     0  790M   0% /run/user/1000

so it looks like the mount points are not created. When do these g...

not entirely sure on this as we used the custom AMI solution, is there any documentation on it?

Thanks. Although it's AWS related, the context was with an error we see within clearml "ValueError: Insufficient permissions for None "

that should be the case, we have default_output_uri: set to an s3 bucket

Thank you very much 🙂 I don't think our Data team ever use this container so I will stop it for now and comment it from the compose file

• What are the credentials that are referred to in the logs? Where do I get these?
• How do I ensure this container is run automatically if it keeps restarting using the docker-compose file?
• If I run sudo docker run -it allegroai/clearml-agent-services:latest manually, do I need to put this in a crontab? My knowledge of running docker containers is a bit limited.
• Does this service need to run if I already have a clearml-agent running on a separate instance?

Is there a way you can allow our account to make a copy of the AMI and store it privately?

Hi @<1523701205467926528:profile|AgitatedDove14>
Yes the clearml-server AMI - we want to be able to back it up and encrypt it on our account