Looking at the 2nd image you sent, I see that in addition to "services" queue, you also have queues called "training" and "training*_2" - and the experiments you circled is in the "training" queue. In that image - there are no experiments in the services queue.
If you press on the "services" queue (like you did in the first image) you can view the experiments in the queue and the workers. Can you check if there is a situation where there are tasks pending in that queue while one of the work...
@<1750327614469312512:profile|CrabbyParrot75> - can you add your workspace id?
Hi @<1570583227918192640:profile|FloppySwallow46> . We've update the rate limits. Can you please check if the issue is still occurring?
Thanks DepressedChimpanzee34 . We'll update if/when it is supported.
sudo docker logs clearml-webserver
@<1564060248291938304:profile|AmusedParrot89> - I see the logic in displaying the last iteration per metric in the compare screen. We will need to think if this won't cause any other issues.
In the mean time - may I ask you to open a github issue - so it will be easier to track?
@<1526371986278715392:profile|VivaciousReindeer64> - Yes - please send me the docker-compose and the log of the webserver
Hi JealousSealion33 . We are planning on releasing a clearml k8s package very soon. I hope this is something that you will be able to use. If not, could you please elaborate on the issue you are facing and share the error you are receiving?
Hi ThoughtfulGorilla90 - when did you perform the deletion. It might take up to 24 hours for the application to get the updated size
VivaciousReindeer64 - you can try to add to the following to the webserver service environment section:
WEBSERVER__fileBaseUrl= https://192.168.1.145:8081
AbruptWorm50 - does the issue still occur, or did you manage to resolve it?
@<1566596960691949568:profile|UpsetWalrus59> - please note that if you report the plots as two separate series of the same metric - it should work better
Hi SmallBluewhale13 - can you go to http://<your ip>:8080/version.json and copy what you get?
you can re-direct it to a file or just copy with the clipboard
Hi JitteryCoyote63 . Just to make sure we fully understand the scenario - you had a project with several experiments, some of which were archived. Then you went to archive and selected all of the experiments and deleted them using the bulk delete operation. And then you saw that the project was empty even when you were not in archive mode. Is that correct?
NutritiousBear41 - I would like to ask you to try the following:
Refresh the web page (control+F5). Check the browser's local storage: F12 -> Application/Storage -> Local Storage - and copy the values of "currentVersion" and "dismissedVersion" (if they exist)
@<1574931903440490496:profile|CrookedBear44> - if you logged in with email - you can also login with one of the other options available in the log in page.
To reset your email's password please do the following:
- Go to the login page ( None )
- Press
Continue with Email - Go to
Log Intab - Press
Don't remember your password - Fill your email and press
SEND EMAILPlease make sure to check your spam folder
Let me know if you need any help.
@<1523701790044852224:profile|FreshParrot56> - Indeed a bug. We will fix this in the upcoming version - due in a few weeks
Oh, OK - I will check that. Thanks!
AbruptWorm50 - just to make sure there is no misunderstanding - the last image you sent is on the "training" queue and not on the "services" queue. Are there free agents running on that queue?
MotionlessMonkey27 - was this resolved?
DrainedHippopotamus42 - once you send more metrics, the calculation will be correct. The problem only occurs when you delete all the metrics.
@<1564060248291938304:profile|AmusedParrot89> - let me check this and get back to you
NastySeahorse61 - can you check if this was updated? What does you usage page say?
Hi ThoughtfulGorilla90 , how did you delete the experiments/models - was it from the web app or using the SDK?
Hi @<1526371986278715392:profile|VivaciousReindeer64> ,
I replicated your environment, and found the following solution:
- In the docker-compose, add the following to the webserver section:
volumes:
- /opt/clearml/config:/mnt/external_files/configs
- In the host machine, create a file
/opt/clearml/config/configuration.jsoncontaining the following:
{
"displayedServerUrls": {
"filesServer": "
"
}
}
- restart the docker-compose: `sudo docker-...
NutritiousBear41 - can you go to localhost:8080/version.json (or change to the relevant address of your web app) and see what it outputs?
NutritiousBear41 - If the problem still occurs - I would like to see i this is a caching issue. Can you please try the following:
Open developer tools (F12) and go to network tab Locate the last call to version.json (this occurs every few minutes so you should see it at the bottom) Right-click and select Edit and Resend On the right side - look at the Request Headers and remove the 2 lines starting with "If-Modified-Since:" and "If-None-Match:" (probably at the bottom) Press send
@<1571308003204796416:profile|HollowPeacock58> - there indeed an issue with connectivity to the payment service. I'll update when it is resolved
@<1855782492460552192:profile|IdealCamel90> - can you provide the task id of the scaler instances that is pending? You can see it in the url