Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
RoundCat60
Moderator
8 Questions, 43 Answers
  Active since 07 April 2024
  Last activity one year ago

Reputation

0

Badges 1

38 × Eureka!
0 Votes
24 Answers
1K Views
0 Votes 24 Answers 1K Views
Hi all, are there any alternatives to storing user credentials in /opt/trains/config/apiserver.conf ? We don't like that the credentials are stored in plaint...
4 years ago
0 Votes
2 Answers
954 Views
0 Votes 2 Answers 954 Views
Hi, is there a document anywhere that lists the S3 bucket permissions required in an IAM policy to read and write to S3?
4 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hey, I've started up a new instance of the clearml server using one of the community AMIs, I copied over the data and config from an older version (Version: ...
3 years ago
0 Votes
12 Answers
986 Views
0 Votes 12 Answers 986 Views
Hi, is there any documentation for setting up and using SSL certs with the clearml server and agent?
4 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi, we would like to make a copy of the base public AMI ami-0a4224787c2f50fe9 as we noticed the owner of these AMIs only keeps the last 2 versions. When I tr...
4 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hey, we have an issue after migrating to v1.0.2 from 0.17. clearml-agent-services kept restarting (ran sudo docker ps ). We used the AMI ( ami-0a4224787c2f50...
4 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
Hi, I would like to configure clearml-server to connect to an S3 bucket in order to store artefacts - i've taken a look on this page None and it mentions 'Th...
4 years ago
0 Votes
43 Answers
118K Views
0 Votes 43 Answers 118K Views
Hey, so we noticed the /var/lib/docker/overlay2 directory on the clearml-server is growing a lot in size, we added more disk space but we want to put somethi...
4 years ago
0 Hey, So We Noticed The

yep, in most of them:

/opt/clearml/config
apiserver.conf
clearml.conf

/opt/clearml/data/elastic_7
/nodes

/opt/clearml/data/fileserver
<empty>

/opt/clearml/data/mongo/configdb
<empty>

/opt/clearml/data/mongo/db
collection/index files, /diagnostic.data, /journal etc

/opt/clearml/data/redis 
dump.rdb

/opt/clearml/logs
apiserver.log.x, filserver.log (0 bytes)
4 years ago
0 Hey, So We Noticed The

🤔 i'll add the logging max_size now and monitor over the next week

4 years ago
0 Hey, So We Noticed The

also, is there a list anywhere with the mount points that are needed?

4 years ago
0 Hey, So We Noticed The

no, they are still rebooting. i've looked in /opt/clearml/logs/apiserver.log no errors

4 years ago
0 Hey, So We Noticed The

think I found the issue, a typo in apiserver.conf

4 years ago
0 Hi, I Would Like To Configure Clearml-Server To Connect To An S3 Bucket In Order To Store Artefacts - I'Ve Taken A Look On This Page

or have I got this wrong, and it's the clearml-agent that needs to read/write to S3?

4 years ago
0 Hey, So We Noticed The

incidentally we turn off the server every evening as it's not used overnight, we've not faced issues with it starting up in the morning or noticed any data loss

4 years ago
0 Hey, So We Noticed The

not yet, going to try and fix it today.

if I do a df I see this, which is concerning:

Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        3.9G     0  3.9G   0% /dev
tmpfs           3.9G     0  3.9G   0% /dev/shm
tmpfs           3.9G  928K  3.9G   1% /run
tmpfs           3.9G     0  3.9G   0% /sys/fs/cgroup
/dev/nvme0n1p1   20G  7.9G   13G  40% /
tmpfs           790M     0  790M   0% /run/user/1000

so it looks like the mount points are not created. When do these g...

4 years ago
0 Hi, We Would Like To Make A Copy Of The Base Public Ami

Hi @<1523701205467926528:profile|AgitatedDove14>
Yes the clearml-server AMI - we want to be able to back it up and encrypt it on our account

4 years ago
0 Hey, So We Noticed The

thanks @<1523715084633772032:profile|AlertBlackbird30> this is really informative. Nothing seems to be particularly out of the ordinary though

3.7G	/var/lib/
3.7G	/var/lib/docker
3.0G	/var/lib/docker/overlay2

followed by a whole load of files that are a few hundred KBs in size, nothing huge though

4 years ago
0 Hey, So We Noticed The

it looks like clearml-apiserver and clearml-fileserver are continually restarting

4 years ago
0 Hi, We Would Like To Make A Copy Of The Base Public Ami

Is there a way you can allow our account to make a copy of the AMI and store it privately?

4 years ago
0 Hey, So We Noticed The

I added this to each of the containers

    logging:
      options:
	    max-file: 5
        max-size: 10m
4 years ago
0 Hey, So We Noticed The

back up and running again, thanks for your help

4 years ago
0 Any Ideas Why This Is Happening? It Was Fine Yesterday

that should be the case, we have default_output_uri: set to an s3 bucket

4 years ago
0 Hey, So We Noticed The

Morning, we got to 100% used which is what triggered this investigation. When we initially looked at overlay2 it was using 8GB, so now seems to be acceptable.

4 years ago
0 Hi, Is There Any Documentation For Setting Up And Using Ssl Certs With The Clearml Server And Agent?

Hi @<1523701205467926528:profile|AgitatedDove14> I tried this out, but I keep getting connection timeouts in the browser getting to the ELB. The instance is showing as inservice and passing the healthcheck. Is there any other configuration I need to do in the clearml.conf to make this work?

4 years ago
0 Hi, I Would Like To Configure Clearml-Server To Connect To An S3 Bucket In Order To Store Artefacts - I'Ve Taken A Look On This Page

Is it possible to use an IAM role rather than user credentials in the clearml.conf file?

4 years ago
0 Hi, I Would Like To Configure Clearml-Server To Connect To An S3 Bucket In Order To Store Artefacts - I'Ve Taken A Look On This Page

yep still referring to the S3 credentials, somewhat familiar with boto and IAM roles

4 years ago
0 Hey, So We Noticed The

yes those have all been created

4 years ago
0 Hey, So We Noticed The

After making the change yesterday to the docker-compose file, the server is completely unusable - this is all I see for the /dashboard screen
image

4 years ago
4 years ago
0 Hey All. I Need Some Help Debugging Some Errors. I Keep Getting An Error About Failing To Clone The Repository On The Remote Instance. What Could Be The Reason Of This? Are There Any Common Errors Related To This? I Suspect Permissions, But Not Entirely

Just by chance I set the SSH deploy keys to write access and now we're able to clone the repo. Why would the SSH key need write access to the repo to be able to clone?

4 years ago
Show more results compactanswers