ClearML does not log images when in lighting use TensorBoardLogger
Hi CheerfulGorilla72 ,
Tensorboard images aren't captures for you in ClearML?
How are you self hosting the ClearML server?
up error
/usr/local/lib/python3.7/dist-packages/urllib3/util/retry.py:86: DeprecationWarning: Using 'Retry.BACKOFF_MAX' is deprecated and will be removed in v2.0. Use 'Retry.DEFAULT_BACKOFF_MAX' instead DeprecationWarning,
2022-03-29 15:15:52,031 - clearml.metrics - WARNING - Failed uploading to
http://10.151.32.18:8091 (HTTPConnectionPool(host='10.151.32.18', port=8091): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd4ec8f2310>: Failed to establish a new connection: [Errno 111] Connection refused')))
2022-03-29 15:15:52,034 - clearml.metrics - ERROR - Not uploading 1/4 events because the data upload failed
This only happens when I try to block pictures.
When I disable image logging, this error does not occur.
Perhaps someone has already encountered this and knows how to solve it?
help please
` from clearml import Task
import numpy as np
def run():
task = Task.init(project_name="test/img", task_name="WandbLogger2_sg_nd_130_7")
logger = task.get_logger()
m = np.eye(256, 256, dtype=np.float64)
iteration = 42
logger.report_image("image", "image float", iteration=iteration, image=m)
if name == "main":
run() `
2022-03-29 16:27:55,273 - clearml.Task - INFO - No repository found, storing script code instead ClearML results page:
Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f06e4d7fe50>: Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f06e46e5710>: Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f06e46e5190>: Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f06e4672c10>: Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f06e466ba50>: Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f06e4681f10>: Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f06e4689e90>: Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f06e4696090>: Failed to establish a new connection: [Errno 111] Connection refused')': / Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f06e469dd50>: Failed to establish a new connection: [Errno 111] Connection refused')': / 2022-03-29 16:28:46,675 - clearml.metrics - WARNING - Failed uploading to
(HTTPConnectionPool(host='10.151.32.18', port=8091): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f06e46965d0>: Failed to establish a new connection: [Errno 111] Connection refused'))) 2022-03-29 16:28:46,677 - clearml.metrics - ERROR - Not uploading 1/1 events because the data upload failed Process finished with exit code -1
I tried to update the main libraries to newer ones - it did not help
now I'll try to run with an older version of the mb code in this led
I found what the problem is, I had port 8091 specified, and the file server was raised to 8081
` # Python 3.7.5 (default, Dec 9 2021, 17:04:37) [GCC 8.4.0]
clearml == 1.3.2
numpy == 1.21.5 `
I'm sorry I took your attention, thanks for your time!
all ok!
use local hosting by changing only 1 port (8080->8099) in the original docker compose file