Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi! I’Ve Been Using Clearml For Some Time In My Previous Company, But I Have A New Job Now, And Naturally I Want To Continue Using It And Hopefully Convince My Team Mates! But I Couldn’T Set The Clearml-Server Docker. We Are Discouraged From Using

Hi! I’ve been using ClearML for some time in my previous company, but I have a new job now, and naturally I want to continue using it and hopefully convince my team mates! But I couldn’t set the clearml-server docker. We are discouraged from using sudo , so I’m supposed to be able to use it locally. Is it possible? Currently it is the clearml-elastic that is returning some error:
ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes]; Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:398) at java.base/java.nio.file.Files.createDirectory(Files.java:700) at java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807) at java.base/java.nio.file.Files.createDirectories(Files.java:793) at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300) at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224) at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298) at org.elasticsearch.node.Node.<init>(Node.java:427) at org.elasticsearch.node.Node.<init>(Node.java:309) at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) at org.elasticsearch.cli.Command.main(Command.java:77) at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) For complete error details, refer to the log at /usr/share/elasticsearch/logs/clearml.logI went ahead and run it in sudo mode, but had the same issue

  
  
Posted one year ago
Votes Newest

Answers 14


oh but docker-ps shows me 8081 ports for webserver, apiserver and fileserver containers
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 0b3f563d04af allegroai/clearml:latest "/opt/clearml/wrappe…" 7 minutes ago Up 7 minutes 8008/tcp, 8080-8081/tcp, 0.0.0.0:8080->80/tcp, :::8080->80/tcp clearml-webserver 176177d7571e allegroai/clearml:latest "/opt/clearml/wrappe…" 7 minutes ago Up 5 minutes 0.0.0.0:8008->8008/tcp, :::8008->8008/tcp, 8080-8081/tcp clearml-apiserver 48173c3aa1b1 docker.elastic.co/elasticsearch/elasticsearch:7.16.2 "/bin/tini -- /usr/l…" 7 minutes ago Up 5 minutes 9200/tcp, 9300/tcp clearml-elastic e82cf1dc7202 mongo:3.6.23 "docker-entrypoint.s…" 7 minutes ago Up 5 minutes 27017/tcp clearml-mongo 779296b2b5ba allegroai/clearml:latest "/opt/clearml/wrappe…" 7 minutes ago Up 7 minutes 8008/tcp, 8080-8081/tcp, 0.0.0.0:8085->8085/tcp, :::8085->8085/tcp clearml-fileserver e19f0423d39b redis:5.0 "docker-entrypoint.s…" 7 minutes ago Up 7 minutes 6379/tcp clearml-redis

  
  
Posted one year ago

I also changed the permissions of /usr/share/elasticsearch according to this post: https://techoverflow.net/2020/04/18/how-to-fix-elasticsearch-docker-accessdeniedexception-usr-share-elasticsearch-data-nodes/ , but I’m getting the same error

  
  
Posted one year ago

Maybe those are internal ports for the docker since I can see the following for one of the dockers ports section
8008/tcp, 8080-8081/tcp, 0.0.0.0:8085->8085/tcp, :::8085->8085/tcp

  
  
Posted one year ago

so I can run the experiments, I can see them, but no plots are saved because there is an upload problem when uploading to localhost:8085

  
  
Posted one year ago

That's weird. Did you do docker-compose down and up properly?

  
  
Posted one year ago

I got it working now 🙂

  
  
Posted one year ago

Is the web UI accessible?

  
  
Posted one year ago

Hi! Good to see another ClearML user that carries it with them between companies ^^

Also, did you make sure to give the required permissions to the clearml folders in /opt/clearml/ ?

  
  
Posted one year ago

there is no /usr/share/elasticsearch/logs/clearml.log file (neither inside the container nor in my server)

  
  
Posted one year ago

another thing: I had to change 8081 to 8085 since it was already used

  
  
Posted one year ago

Did you make all the required changes in the docker compose?

  
  
Posted one year ago

Currently I’m changing /opt/ for my home folder

  
  
Posted one year ago

this is how it looks now

  
  
Posted one year ago

ok, I entered the container, replaced all 8081 to 8085 in every file, commited the container and changed the docker-compose.yml to use that image instead of the allegroai/clearml:latest and now it works 🙂

  
  
Posted one year ago
93 Views
14 Answers
one year ago
4 months ago
Tags