I Am Trying To Test And Show The Results On My Local Machine. ( Clearml-Server With

Answered

I am trying to test and show the results on my local machine. ( clearml-server with http:///localhost:8080 )

My system info:
OS: ubuntu 18.04 docker: 20.10.8 docker-compose: 1.29.8
What I did:

Modified the clearml.conf as localhost is set.# ClearML SDK configuration file api { # Notice: 'host' is the api server (default port 8008), not the web server. # API server on port 8008 api_server: " ` "

# web_server on port 8080
web_server: " ` ` "

# file server on port 8081
files_server: " ` ` "

# Credentials are generated using the webapp,  ` ` 
# Override with os environment: CLEARML_API_ACCESS_KEY / CLEARML_API_SECRET_KEY
credentials {"access_key": "451ZM9XCA0RMP02Q6EOY", "secret_key": "2yfxH5g9pYZLw4Qhs9WZzsQZNIZwicBVqYi556e2iR5gJZvsmA"}

} Run the following commands: echo "vm.max_map_count=262144" > /tmp/99-trains.conf
sudo mv /tmp/99-trains.conf /etc/sysctl.d/99-trains.conf
sudo sysctl -w vm.max_map_count=262144
sudo service docker restart

sudo mkdir -p /opt/clearml/data/elastic
sudo mkdir -p /opt/clearml/data/mongo/db
sudo mkdir -p /opt/clearml/data/mongo/configdb
sudo mkdir -p /opt/clearml/data/redis
sudo mkdir -p /opt/clearml/logs
sudo mkdir -p /opt/clearml/config
sudo mkdir -p /opt/clearml/data/fileserver

sudo chown -R 1000:1000 /opt/clearml

cp ./docker/docker-compose.yml /opt/clearml/docker-compose.yml
cd /opt/clearml
sudo docker-compose -f docker-compose.yml down
sudo docker-compose -f docker-compose.yml up
git clone
cp clearml-server/docker/docker-compose.yml /opt/trains/docker-compose.yml
cd /opt/trains
sudo docker-compose -f docker-compose.yml down
sudo docker-compose -f docker-compose.yml up `
The Resulting Error:
docker-compose log shows with clearml-elastic’s exit code 1.

clearml-elastic | uncaught exception in thread [main] clearml-elastic | ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes]; clearml-elastic | Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes clearml-elastic | at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) clearml-elastic | at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) clearml-elastic | at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) clearml-elastic | at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:398) clearml-elastic | at java.base/java.nio.file.Files.createDirectory(Files.java:700) clearml-elastic | at java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807) clearml-elastic | at java.base/java.nio.file.Files.createDirectories(Files.java:793) clearml-elastic | at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300) clearml-elastic | at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224) clearml-elastic | at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298) clearml-elastic | at org.elasticsearch.node.Node.<init>(Node.java:427) clearml-elastic | at org.elasticsearch.node.Node.<init>(Node.java:309) clearml-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) clearml-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) clearml-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) clearml-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) clearml-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) clearml-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) clearml-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) clearml-elastic | at org.elasticsearch.cli.Command.main(Command.java:77) clearml-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) clearml-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) clearml-elastic | For complete error details, refer to the log at /usr/share/elasticsearch/logs/clearml.log clearml-elastic exited with code 1

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					EcstaticBaldeagle77
				
					0
					 × 1

Votes Newest

Answers 8

SuccessfulKoala55 CostlyOstrich36
Sorry for a late reply.

I solved the above installation. The latest version’s elastic and mongo works.

Thanks a lot for your help !

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					EcstaticBaldeagle77
				
					0
					 × 1

EcstaticBaldeagle77 If you look at the installation instructions, you'll you're using incorrect folder names for some of the folders you've created (see https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server_linux_mac ) - specifically, elastic should be elastic_7 and mongo should be mongo_4

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Can you please run ls -la /opt/clearml and send the output + your docker compose file

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

CostlyOstrich36

The same error still happens.

clearml-elastic | ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];
clearml-elastic | Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
clearml-elastic | at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)
clearml-elastic | at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)
clearml-elastic | at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
clearml-elastic | at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:398)
clearml-elastic | at java.base/java.nio.file.Files.createDirectory(Files.java:700)
clearml-elastic | at java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807)
clearml-elastic | at java.base/java.nio.file.Files.createDirectories(Files.java:793)
clearml-elastic | at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300)
clearml-elastic | at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224)
clearml-elastic | at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298)
clearml-elastic | at org.elasticsearch.node.Node.<init>(Node.java:427)
clearml-elastic | at org.elasticsearch.node.Node.<init>(Node.java:309)
clearml-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234)
clearml-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234)
clearml-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434)
clearml-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166)
clearml-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157)
clearml-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77)
clearml-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112)
clearml-elastic | at org.elasticsearch.cli.Command.main(Command.java:77)
clearml-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122)
clearml-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80)
clearml-elastic | For complete error details, refer to the log at /usr/share/elasticsearch/logs/clearml.log
clearml-apiserver | [2022-03-23 10:50:28,573] [9] [INFO] [clearml.app_sequence] ################ API Server initializing #####################
clearml-apiserver | [2022-03-23 10:50:28,573] [9] [INFO] [clearml.database] Initializing database connections
clearml-apiserver | [2022-03-23 10:50:28,573] [9] [INFO] [clearml.database] Using override mongodb host mongo
clearml-apiserver | [2022-03-23 10:50:28,573] [9] [INFO] [clearml.database] Using override mongodb port 27017
clearml-apiserver | [2022-03-23 10:50:28,575] [9] [INFO] [clearml.database] Registering connection to auth-db ( mongodb://mongo:27017/auth )
clearml-apiserver | [2022-03-23 10:50:28,576] [9] [INFO] [clearml.database] Registering connection to backend-db ( mongodb://mongo:27017/backend )
clearml-elastic exited with code 1

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					EcstaticBaldeagle77
				
					0
					 × 1

CostlyOstrich36

Also, where did you find the instructions with ‘trains’ in it?

the docs dir in the master branch.

https://github.com/allegroai/clearml-server/blob/master/docs/install_linux_mac.md

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					EcstaticBaldeagle77
				
					0
					 × 1

EcstaticBaldeagle77 , please lower all the dockers then run the following commands and then try raising them again.
` sudo mkdir -p /opt/clearml/data/elastic
sudo mkdir -p /opt/clearml/data/mongo/db
sudo mkdir -p /opt/clearml/data/mongo/configdb
sudo mkdir -p /opt/clearml/data/redis
sudo mkdir -p /opt/clearml/logs
sudo mkdir -p /opt/clearml/config
sudo mkdir -p /opt/clearml/data/fileserver

sudo chown -R 1000:1000 /opt/clearml `
Also, where did you find the instructions with 'trains' in it?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

CostlyOstrich36 Thanks. I changed the dir’s name into clearml but the log still output same error…

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					EcstaticBaldeagle77
				
					0
					 × 1

Hi, where did you get the instructions thay specify 'trains' ? Everything should be switched to 'clearml'

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

1K Views

8 Answers

2 years ago

one year ago