Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone, We Have Been Using Clearml Free And It Has Been Working Fine! However We Have Noticed In The Last Few Days That Python Sdk Is Very Slow. Any Idea Of What The Issue Might Be?

Hi everyone,
We have been using ClearML Free and it has been working fine!
However we have noticed in the last few days that Python SDK is very slow.
Any idea of what the issue might be?

  
  
Posted 2 years ago
Votes Newest

Answers 16


We have not performed any upgrade lately. Also, we are using the community server.
Simply running a task on ClearML is very slow at the moment.

  
  
Posted 2 years ago

ExuberantBat52 if you experienced it on both the self hosted and the community servers, might it be related to network issues?

  
  
Posted 2 years ago

I was able to resolve the issue. I am currently using clearml on wsl2 and my machine is connected to a vpn that allows me to connect on to the clearml instance hosted on AWS. You were right it was a network issue, I was able to resolve it by modifying my /etc/resolv.conf file.

  
  
Posted 2 years ago

I am having the same problem on both the self hosted and free community clearml.

  
  
Posted 2 years ago

Hi SuccessfulKoala55 , I am still facing the same problem, takes minutes to run that sample script on free clearml. I have tested it in several networks :(. If I run it in a Agent in an Azure VM (West Europe), it is as fast as expected.

  
  
Posted 2 years ago

Is there anything specific I can further test from my side?

  
  
Posted 2 years ago

That's what I was thinking. But I am still having issues on the self hosted version. I think it may be an unrelated issue though. I will do some debugging and report back.

On a separate note, does clearml have a set of acceptance tests that you usually go through before a release?

  
  
Posted 2 years ago

Hi, the above snippet is again taking minutes to run 😞 ... A few days ago it seemed snappier, but not anymore. Anything I can try on my side?

  
  
Posted 2 years ago

Hi UnsightlyAnt34 , I'm not sure, but I think there's some network issue going on since I've seen report of gateway errors happening here and there

  
  
Posted 2 years ago

Hi QuaintSeal61 , have you upgraded to a new version? Are you self hosted or using the community server? Also, can you elaborate on which part of it is slow? 🙂

  
  
Posted 2 years ago

Hi John, thanks for the quick reply.
Portugal, and this is happening for different users (me and Filipe), from different networks,

  
  
Posted 2 years ago

UnsightlyAnt34 we've identified this issue and resolved it, it was indeed related to the network ingress 😞

  
  
Posted 2 years ago

Where is your server hosted?

  
  
Posted 2 years ago

Hi,

Using ClearML Free plan, this simple sample code takes 5min to run:

from clearml import Task
print('creating task')
task_ = Task.init(project_name='test_dev', task_name='task')
print('hello world')

For this test I am not running anything else

  
  
Posted 2 years ago

The community server is working again.

  
  
Posted 2 years ago

Hi UnsightlyAnt34 , what country are you running the code from? Maybe SuccessfulKoala55 might have some insight?

  
  
Posted 2 years ago
2K Views
16 Answers
2 years ago
2 years ago
Tags