Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi! I’Ve Been Using Clearml For Some Time In My Previous Company, But I Have A New Job Now, And Naturally I Want To Continue Using It And Hopefully Convince My Team Mates! But I Couldn’T Set The Clearml-Server Docker. We Are Discouraged From Using

Hi! I’ve been using ClearML for some time in my previous company, but I have a new job now, and naturally I want to continue using it and hopefully convince my team mates! But I couldn’t set the clearml-server docker. We are discouraged from using sudo , so I’m supposed to be able to use it locally. Is it possible? Currently it is the clearml-elastic that is returning some error:
ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes]; Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:398) at java.base/java.nio.file.Files.createDirectory(Files.java:700) at java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807) at java.base/java.nio.file.Files.createDirectories(Files.java:793) at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300) at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224) at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298) at org.elasticsearch.node.Node.<init>(Node.java:427) at org.elasticsearch.node.Node.<init>(Node.java:309) at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) at org.elasticsearch.cli.Command.main(Command.java:77) at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) For complete error details, refer to the log at /usr/share/elasticsearch/logs/clearml.logI went ahead and run it in sudo mode, but had the same issue

  
  
Posted one year ago
pic
More
AbruptCow41
0 × 1
Report
Votes Newest

Answers 14

oh but docker-ps shows me 8081 ports for webserver, apiserver and fileserver containers
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 0b3f563d04af allegroai/clearml:latest "/opt/clearml/wrappe…" 7 minutes ago Up 7 minutes 8008/tcp, 8080-8081/tcp, 0.0.0.0:8080->80/tcp, :::8080->80/tcp clearml-webserver 176177d7571e allegroai/clearml:latest "/opt/clearml/wrappe…" 7 minutes ago Up 5 minutes 0.0.0.0:8008->8008/tcp, :::8008->8008/tcp, 8080-8081/tcp clearml-apiserver 48173c3aa1b1 docker.elastic.co/elasticsearch/elasticsearch:7.16.2 "/bin/tini -- /usr/l…" 7 minutes ago Up 5 minutes 9200/tcp, 9300/tcp clearml-elastic e82cf1dc7202 mongo:3.6.23 "docker-entrypoint.s…" 7 minutes ago Up 5 minutes 27017/tcp clearml-mongo 779296b2b5ba allegroai/clearml:latest "/opt/clearml/wrappe…" 7 minutes ago Up 7 minutes 8008/tcp, 8080-8081/tcp, 0.0.0.0:8085->8085/tcp, :::8085->8085/tcp clearml-fileserver e19f0423d39b redis:5.0 "docker-entrypoint.s…" 7 minutes ago Up 7 minutes 6379/tcp clearml-redis

  
  
Posted one year ago
pic
More
AbruptCow41
0 × 1
Report

I also changed the permissions of /usr/share/elasticsearch according to this post: https://techoverflow.net/2020/04/18/how-to-fix-elasticsearch-docker-accessdeniedexception-usr-share-elasticsearch-data-nodes/ , but I’m getting the same error

  
  
Posted one year ago
pic
More
AbruptCow41
0 × 1
Report

Maybe those are internal ports for the docker since I can see the following for one of the dockers ports section
8008/tcp, 8080-8081/tcp, 0.0.0.0:8085->8085/tcp, :::8085->8085/tcp

  
  
Posted one year ago
pic
More
CostlyOstrich36
0
Report

so I can run the experiments, I can see them, but no plots are saved because there is an upload problem when uploading to localhost:8085

  
  
Posted one year ago
pic
More
AbruptCow41
0 × 1
Report

That's weird. Did you do docker-compose down and up properly?

  
  
Posted one year ago
pic
More
CostlyOstrich36
0
Report

I got it working now 🙂

  
  
Posted one year ago
pic
More
AbruptCow41
0 × 1
Report

Is the web UI accessible?

  
  
Posted one year ago
pic
More
CostlyOstrich36
0
Report

Hi! Good to see another ClearML user that carries it with them between companies ^^

Also, did you make sure to give the required permissions to the clearml folders in /opt/clearml/ ?

  
  
Posted one year ago
pic
More
CostlyOstrich36
0
Report

there is no /usr/share/elasticsearch/logs/clearml.log file (neither inside the container nor in my server)

  
  
Posted one year ago
pic
More
AbruptCow41
0 × 1
Report

another thing: I had to change 8081 to 8085 since it was already used

  
  
Posted one year ago
pic
More
AbruptCow41
0 × 1
Report

Did you make all the required changes in the docker compose?

  
  
Posted one year ago
pic
More
CostlyOstrich36
0
Report

Currently I’m changing /opt/ for my home folder

  
  
Posted one year ago
pic
More
AbruptCow41
0 × 1
Report

this is how it looks now

  
  
Posted one year ago
pic
More
AbruptCow41
0 × 1
Report

ok, I entered the container, replaced all 8081 to 8085 in every file, commited the container and changed the docker-compose.yml to use that image instead of the allegroai/clearml:latest and now it works 🙂

  
  
Posted one year ago
pic
More
AbruptCow41
0 × 1
Report
Write your answer
93 Views
14 Answers
one year ago
4 months ago
Tags
clearml