Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone, We Have Been Using Clearml Free And It Has Been Working Fine! However We Have Noticed In The Last Few Days That Python Sdk Is Very Slow. Any Idea Of What The Issue Might Be?

Hi everyone,
We have been using ClearML Free and it has been working fine!
However we have noticed in the last few days that Python SDK is very slow.
Any idea of what the issue might be?

  
  
Posted one year ago
Votes Newest

Answers 16


Hi John, thanks for the quick reply.
Portugal, and this is happening for different users (me and Filipe), from different networks,

  
  
Posted one year ago

Is there anything specific I can further test from my side?

  
  
Posted one year ago

I am having the same problem on both the self hosted and free community clearml.

  
  
Posted one year ago

Hi @<1523701087100473344:profile|SuccessfulKoala55> , I am still facing the same problem, takes minutes to run that sample script on free clearml. I have tested it in several networks :(. If I run it in a Agent in an Azure VM (West Europe), it is as fast as expected.

  
  
Posted one year ago

I was able to resolve the issue. I am currently using clearml on wsl2 and my machine is connected to a vpn that allows me to connect on to the clearml instance hosted on AWS. You were right it was a network issue, I was able to resolve it by modifying my /etc/resolv.conf file.

  
  
Posted one year ago

Hi, the above snippet is again taking minutes to run 😞 ... A few days ago it seemed snappier, but not anymore. Anything I can try on my side?

  
  
Posted one year ago

That's what I was thinking. But I am still having issues on the self hosted version. I think it may be an unrelated issue though. I will do some debugging and report back.

On a separate note, does clearml have a set of acceptance tests that you usually go through before a release?

  
  
Posted one year ago

Hi @<1534344465790013440:profile|UnsightlyAnt34> , I'm not sure, but I think there's some network issue going on since I've seen report of gateway errors happening here and there

  
  
Posted one year ago

The community server is working again.

  
  
Posted one year ago

We have not performed any upgrade lately. Also, we are using the community server.
Simply running a task on ClearML is very slow at the moment.

  
  
Posted one year ago

Hi @<1534344462161940480:profile|QuaintSeal61> , have you upgraded to a new version? Are you self hosted or using the community server? Also, can you elaborate on which part of it is slow? 🙂

  
  
Posted one year ago

Hi @<1534344465790013440:profile|UnsightlyAnt34> , what country are you running the code from? Maybe @<1523701087100473344:profile|SuccessfulKoala55> might have some insight?

  
  
Posted one year ago

Where is your server hosted?

  
  
Posted one year ago

Hi,

Using ClearML Free plan, this simple sample code takes 5min to run:

from clearml import Task
print('creating task')
task_ = Task.init(project_name='test_dev', task_name='task')
print('hello world')

For this test I am not running anything else

  
  
Posted one year ago

@<1534344465790013440:profile|UnsightlyAnt34> we've identified this issue and resolved it, it was indeed related to the network ingress 😞

  
  
Posted one year ago

@<1523701168822292480:profile|ExuberantBat52> if you experienced it on both the self hosted and the community servers, might it be related to network issues?

  
  
Posted one year ago
1K Views
16 Answers
one year ago
one year ago
Tags