
Reputation
Badges 1
40 × Eureka!Basically, set my Host storage as Azure
This is what I get with the ' https://
' , this is atleast getting a response from Azure
` 2020-12-03 13:48:49,667 - trains.Task - INFO - No repository found, storing script code instead
TRAINS results page: http://<IP>:8080/projects/<hash>/output/log
2020-12-03 13:48:51,505 - trains.Task - INFO - Waiting for repository detection and full package requirement analysis
2020-12-03 13:48:53,315 - trains.Task - INFO - Finished repository detection and package analysis
2020-12-03 13:48:53,315 -...
Thanks ๐
Oh! With the sleep()
function? Let me try it again
I tried it, and it is uploading it to Debug Samples ( Task.get_task()
) with task.get_logger().report_matplotlib_figure()
, but with a Task.init()
, it's uploading it to Plots.
Checking with the RC package now
Okay, my bad, the code snippet I sent is correctly uploading it to 'Plots' but in the actual script I use this:
` def plot_graphs(input_df,output_df,task):
# Plotting all the graphs
for metric in df_cols:
# Assigning X and Y axes data
in_x = input_df["frameNum"]
in_y = input_df[metric]
out_x = output_df["frameNum"]
out_y = output_df[metric]
# Creating a new figure
plt.figure()
plt.xlabel('Frame Number')
...
Ahh okay, commented out the whole thing and got the same error as earlier ( Could not get access credentials
)
Should we also provide credentials for the Storage Account on the Web UI under 'Profile' section?
Are you doingย
plt.imshow
Nope
And yes, I set the report_image=False
This is odd could it be it automatically forwards to https
I have to check with my IT Team if there's any forwarding
` * Trying X.Y.Z.W:8080...
- TCP_NODELAY set
- Connected to X.Y.Z.W (X.Y.Z.W) port 8008 (#0)
GET /debug.ping HTTP/1.1
Host: X.Y.Z.W:8080
User-Agent: curl/7.68.0
Accept: /
- Mark bundle as not supporting multiuse
< HTTP/1.1 302 Found
< Location:
< Connection: close
< X-Frame-Options: SAMEORIGIN
< X-XSS-Protection: 1; mode=block
< X-Content-Type-Options: nosniff
< Content-Security-Policy: frame-ancestors
< - Closing connection 0 `
I tried it about 2-3 months ago with trains-init (same use-case as this one) and it failed that time too.
Could it be the credentials are actually incorrect?
Highly unlikely, like I said, I generated a new set of credentials from the Web-UI and it worked perfectly fine for an Azure VM (not under the VPN).
Yes, copied and pasted the configuration file correctly, points to the right server (running on Azure). I created a clearml.conf file on another Azure VM (not under the VPN) and there it worked fine. The 'on-premise' server fails to connect to the ClearML server because of the VPN I think
Yeah I noticed that too! Ports are configured properly in the conf file though
Verifying credentials ... Error: could not verify credentials: key=xxxxxx secret=xxxxx Enter user access key:
2021-02-08 18:49:25,036 - clearml - WARNING - InsecureRequestWarning: Certificate verification is disabled! Adding certificate verification is strongly advised. See:
Retrying (Retry(total=239, connect=240, read=239, redirect=240, status=240)) after connection broken by 'ReadTimeoutError("HTTPSConnectionPool(host='X.Y.Z.W', port=8015): Read timed out. (read timeout=3.0)",)': /auth.login
Got this, times out after 5 tries
0.16.1-320
you mean 0.16?
Ah my bad, I picked up the version from docker-compose file :D
` from trains import Task
import matplotlib.pyplot as plt
import numpy as np
import time
task = Task.get_task(task_id='task_id')
for i in range(0,10):
x_1 = np.random.rand(50)
y_1 = np.random.rand(50)
x_2 = np.random.rand(50)
y_2 = np.random.rand(50)
plt.figure()
plt.scatter(x_1, y_1, alpha=0.5)
plt.scatter(x_2, y_2, alpha=0.5)
# Plot will be reported automatically
# plt.show()
task.get_logger().report_matplotlib_figure(title="My Plot Title", serie...
What if I just copy a clearml.conf file and edit out the tokens? Could that work?
It is http btw, i don't know why it logged https://
` 2020-12-03 13:31:27,296 - trains.storage - ERROR - Azure blob storage driver not found. Please install driver using "pip install 'azure.storage.blob>=2.0.1'"
Traceback (most recent call last):
File "test.py", line 3, in <module>
task = Task.init(project_name="Test", task_name="debugging")
File "/home/sam/VirtualEnvs/test/lib/python3.8/site-packages/trains/task.py", line 461, in init
task.output_uri = cls.__default_output_uri
File "/home/sam/VirtualEnvs/test/lib/python3.8/site-...
AgitatedDove14 , here's the code snippet you requested
Thanks a lot SuccessfulKoala55 ๐
Great! Thanks for the clarification AgitatedDove14 ๐
This is the whole error dump:
`
2020-12-03 13:31:27,296 - trains.storage - ERROR - Azure blob storage driver not found. Please install driver using "pip install 'azure.storage.blob>=2.0.1'"
Traceback (most recent call last):
File "test.py", line 3, in <module>
task = Task.init(project_name="Test", task_name="debugging")
File "/home/sam/VirtualEnvs/test/lib/python3.8/site-packages/trains/task.py", line 461, in init
task.output_uri = cls.__default_output_uri
File "/home/sam/Virtu...
I did that, and it works flawlessly. I swear I installed the Azure blob storage package multiple times, anyway thanks a lot again for the detailed debugging O:)
AgitatedDove14 , is there a way to set the default output URI flag so that if and when a new user creates a clearml.conf the URI is already in it? I was hoping that there's a universal flag somewhere. Asking this because I want all the Models and Artifacts to be stored in one place and the users shouldn't have to edit their configuration files.
Indeed, sleep()
did the trick but it's going into the Debug Samples tab and not the Plots, any reason why? Earlier (with Task.init()
followed by Task.get_task()
) the same plt plots got reported to 'Plots'.