The volumes section of elasticsearch service looks OK to me:
/opt/trains/data/elastic_7:/usr/share/elasticsearch/data
What about the UID for epdadmin user? 'id -u epdadmin'
epdadmin@epdadmin-desktop:~$ id -u epdadmin
1000
WobblyCrab70 what command are you using to start the docker-compose?
I will use whatever command you tell me and write it down forever
I used docker-compose up
and another one i can find if i look for it
Can you try doing sudo docker-compose up
?
trains-agent-services |
trains-apiserver | Traceback (most recent call last):
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:04:29.530+0000 I NETWORK [conn1004] received client metadata from 172.20.0.6:39178 conn1004: { driver: { name: "PyMongo", version: "3.10.1" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "5.4.0-48-generic" }, platform: "CPython 3.6.8.final.0" }
trains-agent-services | trains_agent: ERROR: Connection Error: it seems api_server is misconfigured. Is this the TRAINS API server http://apiserver:8008 ?
trains-apiserver | File "server.py", line 71, in <module>
trains-elastic | "Caused by: org.elasticsearch.ElasticsearchException: failed to bind service",
trains-mongo | 2020-10-14T01:04:30.097+0000 I NETWORK [conn1003] end connection 172.20.0.6:39176 (1 connection now open)
trains-agent-services |
trains-apiserver | "Error starting server: failed connecting to ElasticSearch service"
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:615) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:04:30.097+0000 I NETWORK [conn1004] end connection 172.20.0.6:39178 (0 connections now open)
trains-agent-services | http://62.0.8.131:8081 http://62.0.8.131:8080 http://apiserver:8008
trains-apiserver | Exception: Error starting server: failed connecting to ElasticSearch service
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:257) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:06:02.258+0000 I NETWORK [listener] connection accepted from 172.20.0.6:39300 #1005 (1 connection now open)
trains-agent-services | WARNING: You are using pip version 20.1.1; however, version 20.2.3 is available.
trains-apiserver | [2020-10-13 13:55:27,052] [8] [INFO] [ http://trains.es _factory] Using override elastic host elasticsearch
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:06:02.258+0000 I NETWORK [conn1005] received client metadata from 172.20.0.6:39300 conn1005: { driver: { name: "PyMongo", version: "3.10.1" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "5.4.0-48-generic" }, platform: "CPython 3.6.8.final.0" }
trains-agent-services | You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
trains-apiserver | [2020-10-13 13:55:27,052] [8] [INFO] [ http://trains.es _factory] Using override elastic port 9200
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:06:02.259+0000 I NETWORK [listener] connection accepted from 172.20.0.6:39302 #1006 (2 connections now open)
trains-agent-services |
trains-apiserver | [2020-10-13 13:55:27,229] [8] [INFO] [trains.redis_manager] Using override redis host redis
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:06:02.260+0000 I NETWORK [conn1006] received client metadata from 172.20.0.6:39302 conn1006: { driver: { name: "PyMongo", version: "3.10.1" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "5.4.0-48-generic" }, platform: "CPython 3.6.8.final.0" }
trains-agent-services | trains_agent: ERROR: Connection Error: it seems api_server is misconfigured. Is this the TRAINS API server http://apiserver:8008 ?
trains-apiserver | [2020-10-13 13:55:27,229] [8] [INFO] [trains.redis_manager] Using override redis port 6379
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:06:02.823+0000 I NETWORK [conn1006] end connection 172.20.0.6:39302 (1 connection now open)
trains-agent-services |
trains-apiserver | [2020-10-13 13:55:27,282] [8] [INFO] [trains.schema] loading schema from cache
trains-elastic | "... 6 more",
trains-mongo | 2020-10-14T01:06:02.823+0000 I NETWORK [conn1005] end connection 172.20.0.6:39300 (0 connections now open)
trains-agent-services | http://62.0.8.131:8081 http://62.0.8.131:8080 http://apiserver:8008
trains-apiserver | [2020-10-13 13:55:27,305] [8] [INFO] [trains.server] ################ API Server initializing #####################
trains-elastic | "Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes",
trains-mongo | 2020-10-14T01:07:34.499+0000 I NETWORK [listener] connection accepted from 172.20.0.6:39422 #1007 (1 connection now open)
trains-agent-services | WARNING: You are using pip version 20.1.1; however, version 20.2.3 is available.
trains-apiserver | [2020-10-13 13:55:27,305] [8] [INFO] [trains.database] Initializing database connections
trains-elastic | "at sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) ~[?:?]",
trains-mongo | 2020-10-14T01:07:34.500+0000 I NETWORK [conn1007] received client metadata from 172.20.0.6:39422 conn1007: { driver: { name: "PyMongo", version: "3.10.1" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "5.4.0-48-generic" }, platform: "CPython 3.6.8.final.0" }
trains-agent-services | You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
trains-apiserver | [2020-10-13 13:55:27,305] [8] [INFO] [trains.database] Using override mongodb host mongo
trains-elastic | "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]",
trains-mongo | 2020-10-14T01:07:34.501+0000 I NETWORK [listener] connection accepted from 172.20.0.6:39424 #1008 (2 connections now open)
trains-agent-services |
trains-apiserver | [2020-10-13 13:55:27,305] [8] [INFO] [trains.database] Using override mongodb port 27017
trains-elastic | "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116) ~[?:?]",
trains-mongo | 2020-10-14T01:07:34.501+0000 I NETWORK [conn1008] received client metadata from 172.20.0.6:39424 conn1008: { driver: { name: "PyMongo", version: "3.10.1" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "5.4.0-48-generic" }, platform: "CPython 3.6.8.final.0" }
It starts like this:WARNING: The TRAINS_HOST_IP variable is not set. Defaulting to a blank string. WARNING: The TRAINS_AGENT_GIT_USER variable is not set. Defaulting to a blank string. WARNING: The TRAINS_AGENT_GIT_PASS variable is not set. Defaulting to a blank string. Starting trains-elastic ... Starting trains-mongo ... Starting trains-fileserver ... Starting trains-redis ...
even though i have configured the WARNINGS as the guide told me
Are the errors in the elastic log the same? (it's hard to see in your pasted log)
and all the paths are in /opt/trains/...
?
I mean, you're running from /opt/trains
?
trains-elastic | OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
trains-elastic | uncaught exception in thread [main]
trains-elastic | {"type": "server", "timestamp": "2020-10-14T17:10:27,837Z", "level": "ERROR", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "trains", "node.name": "trains", "message": "uncaught exception in thread [main]",
trains-elastic | "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:174) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125) ~[elasticsearch-cli-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "Caused by: org.elasticsearch.ElasticsearchException: failed to bind service",
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:615) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:257) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "... 6 more",
trains-elastic | "Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes",
trains-elastic | "at sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) ~[?:?]",
trains-elastic | "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]",
trains-elastic | "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116) ~[?:?]",
trains-elastic | "at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:389) ~[?:?]",
trains-elastic | "at java.nio.file.Files.createDirectory(Files.java:693) ~[?:?]",
trains-elastic | "at java.nio.file.Files.createAndCheckIsDirectory(Files.java:800) ~[?:?]",
trains-elastic | "at java.nio.file.Files.createDirectories(Files.java:786) ~[?:?]",
trains-elastic | "at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:274) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:211) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:271) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:277) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:257) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "... 6 more"] }
trains-elastic | ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];
trains-elastic | Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
trains-elastic | at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)
trains-elastic | at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
trains-elastic | at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116)
trains-elastic | at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:389)
trains-elastic | at java.base/java.nio.file.Files.createDirectory(Files.java:693)
trains-elastic | at java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:800)
trains-elastic | at java.base/java.nio.file.Files.createDirectories(Files.java:786)
trains-elastic | at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:274)
trains-elastic | at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:211)
trains-elastic | at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:271)
trains-elastic | at org.elasticsearch.node.Node.<init>(Node.java:277)
trains-elastic | at org.elasticsearch.node.Node.<init>(Node.java:257)
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221)
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221)
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349)
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170)
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161)
trains-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86)
trains-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125)
trains-elastic | at org.elasticsearch.cli.Command.main(Command.java:90)
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126)
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92)
trains-elastic | For complete error details, refer to the log at /usr/share/elasticsearch/logs/trains.log
trains-elastic exited with code 1
epdadmin@epdadmin-desktop:~/opt/trains$ pwd
/home/epdadmin/opt/trains
i really have to go, I am greatful for your dedicated help. any chance to set a concentrated time for this tomorrow?
So that's the issue - the docker-compose.yml
assumes everything resides in /opt/trains
, not in your home folder
Just put everything there and it'll work 😄
I'd do the setup process again (i.e. mkdir etc.)
just to make sure you have the folders set up right