The volumes section of elasticsearch service looks OK to me:
/opt/trains/data/elastic_7:/usr/share/elasticsearch/data
trains-elastic | OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
trains-elastic | uncaught exception in thread [main]
trains-elastic | {"type": "server", "timestamp": "2020-10-14T17:10:27,837Z", "level": "ERROR", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "trains", "node.name": "trains", "message": "uncaught exception in thread [main]",
trains-elastic | "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:174) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125) ~[elasticsearch-cli-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "Caused by: org.elasticsearch.ElasticsearchException: failed to bind service",
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:615) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:257) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "... 6 more",
trains-elastic | "Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes",
trains-elastic | "at sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) ~[?:?]",
trains-elastic | "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]",
trains-elastic | "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116) ~[?:?]",
trains-elastic | "at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:389) ~[?:?]",
trains-elastic | "at java.nio.file.Files.createDirectory(Files.java:693) ~[?:?]",
trains-elastic | "at java.nio.file.Files.createAndCheckIsDirectory(Files.java:800) ~[?:?]",
trains-elastic | "at java.nio.file.Files.createDirectories(Files.java:786) ~[?:?]",
trains-elastic | "at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:274) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:211) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:271) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:277) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:257) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-elastic | "... 6 more"] }
trains-elastic | ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];
trains-elastic | Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
trains-elastic | at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)
trains-elastic | at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
trains-elastic | at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116)
trains-elastic | at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:389)
trains-elastic | at java.base/java.nio.file.Files.createDirectory(Files.java:693)
trains-elastic | at java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:800)
trains-elastic | at java.base/java.nio.file.Files.createDirectories(Files.java:786)
trains-elastic | at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:274)
trains-elastic | at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:211)
trains-elastic | at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:271)
trains-elastic | at org.elasticsearch.node.Node.<init>(Node.java:277)
trains-elastic | at org.elasticsearch.node.Node.<init>(Node.java:257)
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221)
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221)
trains-elastic | at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349)
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170)
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161)
trains-elastic | at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86)
trains-elastic | at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125)
trains-elastic | at org.elasticsearch.cli.Command.main(Command.java:90)
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126)
trains-elastic | at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92)
trains-elastic | For complete error details, refer to the log at /usr/share/elasticsearch/logs/trains.log
trains-elastic exited with code 1
Can you try doing sudo docker-compose up ?
just to make sure you have the folders set up right
epdadmin@epdadmin-desktop:~$ id -u epdadmin
1000
Just put everything there and it'll work 😄
So that's the issue - the docker-compose.yml assumes everything resides in /opt/trains , not in your home folder
I mean, you're running from /opt/trains ?
I used docker-compose up and another one i can find if i look for it
and all the paths are in /opt/trains/... ?
trains-agent-services |
trains-apiserver | Traceback (most recent call last):
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:04:29.530+0000 I NETWORK [conn1004] received client metadata from 172.20.0.6:39178 conn1004: { driver: { name: "PyMongo", version: "3.10.1" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "5.4.0-48-generic" }, platform: "CPython 3.6.8.final.0" }
trains-agent-services | trains_agent: ERROR: Connection Error: it seems api_server is misconfigured. Is this the TRAINS API server http://apiserver:8008 ?
trains-apiserver | File "server.py", line 71, in <module>
trains-elastic | "Caused by: org.elasticsearch.ElasticsearchException: failed to bind service",
trains-mongo | 2020-10-14T01:04:30.097+0000 I NETWORK [conn1003] end connection 172.20.0.6:39176 (1 connection now open)
trains-agent-services |
trains-apiserver | "Error starting server: failed connecting to ElasticSearch service"
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:615) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:04:30.097+0000 I NETWORK [conn1004] end connection 172.20.0.6:39178 (0 connections now open)
trains-agent-services | http://62.0.8.131:8081 http://62.0.8.131:8080 http://apiserver:8008
trains-apiserver | Exception: Error starting server: failed connecting to ElasticSearch service
trains-elastic | "at org.elasticsearch.node.Node.<init>(Node.java:257) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:06:02.258+0000 I NETWORK [listener] connection accepted from 172.20.0.6:39300 #1005 (1 connection now open)
trains-agent-services | WARNING: You are using pip version 20.1.1; however, version 20.2.3 is available.
trains-apiserver | [2020-10-13 13:55:27,052] [8] [INFO] [ http://trains.es _factory] Using override elastic host elasticsearch
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:06:02.258+0000 I NETWORK [conn1005] received client metadata from 172.20.0.6:39300 conn1005: { driver: { name: "PyMongo", version: "3.10.1" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "5.4.0-48-generic" }, platform: "CPython 3.6.8.final.0" }
trains-agent-services | You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
trains-apiserver | [2020-10-13 13:55:27,052] [8] [INFO] [ http://trains.es _factory] Using override elastic port 9200
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:221) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:06:02.259+0000 I NETWORK [listener] connection accepted from 172.20.0.6:39302 #1006 (2 connections now open)
trains-agent-services |
trains-apiserver | [2020-10-13 13:55:27,229] [8] [INFO] [trains.redis_manager] Using override redis host redis
trains-elastic | "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:349) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:06:02.260+0000 I NETWORK [conn1006] received client metadata from 172.20.0.6:39302 conn1006: { driver: { name: "PyMongo", version: "3.10.1" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "5.4.0-48-generic" }, platform: "CPython 3.6.8.final.0" }
trains-agent-services | trains_agent: ERROR: Connection Error: it seems api_server is misconfigured. Is this the TRAINS API server http://apiserver:8008 ?
trains-apiserver | [2020-10-13 13:55:27,229] [8] [INFO] [trains.redis_manager] Using override redis port 6379
trains-elastic | "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.6.2.jar:7.6.2]",
trains-mongo | 2020-10-14T01:06:02.823+0000 I NETWORK [conn1006] end connection 172.20.0.6:39302 (1 connection now open)
trains-agent-services |
trains-apiserver | [2020-10-13 13:55:27,282] [8] [INFO] [trains.schema] loading schema from cache
trains-elastic | "... 6 more",
trains-mongo | 2020-10-14T01:06:02.823+0000 I NETWORK [conn1005] end connection 172.20.0.6:39300 (0 connections now open)
trains-agent-services | http://62.0.8.131:8081 http://62.0.8.131:8080 http://apiserver:8008
trains-apiserver | [2020-10-13 13:55:27,305] [8] [INFO] [trains.server] ################ API Server initializing #####################
trains-elastic | "Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes",
trains-mongo | 2020-10-14T01:07:34.499+0000 I NETWORK [listener] connection accepted from 172.20.0.6:39422 #1007 (1 connection now open)
trains-agent-services | WARNING: You are using pip version 20.1.1; however, version 20.2.3 is available.
trains-apiserver | [2020-10-13 13:55:27,305] [8] [INFO] [trains.database] Initializing database connections
trains-elastic | "at sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) ~[?:?]",
trains-mongo | 2020-10-14T01:07:34.500+0000 I NETWORK [conn1007] received client metadata from 172.20.0.6:39422 conn1007: { driver: { name: "PyMongo", version: "3.10.1" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "5.4.0-48-generic" }, platform: "CPython 3.6.8.final.0" }
trains-agent-services | You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
trains-apiserver | [2020-10-13 13:55:27,305] [8] [INFO] [trains.database] Using override mongodb host mongo
trains-elastic | "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]",
trains-mongo | 2020-10-14T01:07:34.501+0000 I NETWORK [listener] connection accepted from 172.20.0.6:39424 #1008 (2 connections now open)
trains-agent-services |
trains-apiserver | [2020-10-13 13:55:27,305] [8] [INFO] [trains.database] Using override mongodb port 27017
trains-elastic | "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116) ~[?:?]",
trains-mongo | 2020-10-14T01:07:34.501+0000 I NETWORK [conn1008] received client metadata from 172.20.0.6:39424 conn1008: { driver: { name: "PyMongo", version: "3.10.1" }, os: { type: "Linux", name: "Linux", architecture: "x86_64", version: "5.4.0-48-generic" }, platform: "CPython 3.6.8.final.0" }
I will use whatever command you tell me and write it down forever
Are the errors in the elastic log the same? (it's hard to see in your pasted log)
i really have to go, I am greatful for your dedicated help. any chance to set a concentrated time for this tomorrow?
WobblyCrab70 what command are you using to start the docker-compose?
I'd do the setup process again (i.e. mkdir etc.)
What about the UID for epdadmin user? 'id -u epdadmin'
It starts like this:WARNING: The TRAINS_HOST_IP variable is not set. Defaulting to a blank string. WARNING: The TRAINS_AGENT_GIT_USER variable is not set. Defaulting to a blank string. WARNING: The TRAINS_AGENT_GIT_PASS variable is not set. Defaulting to a blank string. Starting trains-elastic ... Starting trains-mongo ... Starting trains-fileserver ... Starting trains-redis ...
even though i have configured the WARNINGS as the guide told me