AbruptWorm50 - just to make sure there is no misunderstanding - the last image you sent is on the "training" queue and not on the "services" queue. Are there free agents running on that queue?

@<1526371986278715392:profile|VivaciousReindeer64> - Yes - please send me the docker-compose and the log of the webserver

AbruptWorm50 - does the issue still occur, or did you manage to resolve it?

@<1564060248291938304:profile|AmusedParrot89> - I see the logic in displaying the last iteration per metric in the compare screen. We will need to think if this won't cause any other issues.
In the mean time - may I ask you to open a github issue - so it will be easier to track?

Hi ThoughtfulGorilla90 , how did you delete the experiments/models - was it from the web app or using the SDK?

@<1571308003204796416:profile|HollowPeacock58> - there indeed an issue with connectivity to the payment service. I'll update when it is resolved

Hi @<1526371986278715392:profile|VivaciousReindeer64> - please try this file:

DrainedHippopotamus42 - once you send more metrics, the calculation will be correct. The problem only occurs when you delete all the metrics.

@<1750327614469312512:profile|CrabbyParrot75> - can you add your workspace id?

Hi CooperativeFox72 . Thanks for reporting this issue.
Can you add the following information:
Is this on the hosted community server ( http://app.community.clear.ml ) or a server that you installed? If this is a server the you installed locally - which server version are you running Which browser, and what resolution are you using?Thanks,
Oren.

sudo docker logs clearml-webserver

EnviousStarfish54 - we identified the issue, and will fix it for the next release

you can re-direct it to a file or just copy with the clipboard

@<1574931903440490496:profile|CrookedBear44> - if you logged in with email - you can also login with one of the other options available in the log in page.
To reset your email's password please do the following:

• Go to the login page ( None )
• Press Continue with Email
• Go to Log In tab
• Press Don't remember your password
• Fill your email and press SEND EMAIL Please make sure to check your spam folder

Let me know if you need any help.

@<1526371986278715392:profile|VivaciousReindeer64> - please check the following:

• What do you get if you go to http//192.168.1.145:8080/configuration.json?
• Can you check the log of the webserver docker (using sudo docker logs clearml-webserver ) - especially the beginning? Does it say anything about the fileBaseUrl?

SmallBluewhale13 - plot comparing only shows the last iteration, where as the individual info screen displayed the last 5 iterations. Could this explain the issue?

JitteryCoyote63 - thanks for the info. We are trying to reproduce this, and will update

Looking at the 2nd image you sent, I see that in addition to "services" queue, you also have queues called "training" and "training*_2" - and the experiments you circled is in the "training" queue. In that image - there are no experiments in the services queue.
If you press on the "services" queue (like you did in the first image) you can view the experiments in the queue and the workers. Can you check if there is a situation where there are tasks pending in that queue while one of the work...

The artifacts (debug samples, models, artifacts) deletion is currently performed done from the browser, after the task object is deleted from the backend. So it might take time for all the artifacts to be deleted - please make sure not to close your browser.
Note that only artifacts saved on fileserver are deleted - exteranal artifacts (in the cloud or on a local filesystem) are not deleted.
We are working on moving the deletion to the server side, to avoid these kind of issues. Should be in ...

MotionlessMonkey27 - was this resolved?

@<1558986867771183104:profile|ShakyKangaroo32> - if you check the api section in your client-side clearml.conf, the value for files_server there should be the same one that you set in the .env file on the server. Can you check that they are indeed the same?
If they are the same - can you please send me the output of the following command in the server:
sudo docker logs -n30 async_delete

Oh, OK - I will check that. Thanks!

@<1526371986278715392:profile|VivaciousReindeer64> - I'll check it on my env

Hi DepressedChimpanzee34 .
Currently supporting plotly animations is not planned for the upcoming versions. I would suggest opening a feature request in github, or add it to the UI change request thread: https://github.com/allegroai/clearml/issues/81 .
Thanks,
Oren.

Hi DepressedChimpanzee34 . Thanks for the info.
Plotly animation is currently not supported in the web app. We're looking into adding this into a future version. Can you describe the use case of animations in your system?

AbruptWorm50 - the agent poll the queue, so any free agent can pull tasks. From the graph on the right, it looks like experiments were not waiting in the queue (max experiments is 1, and it was immediately pulled). Can you also check what happens if two experiments are enqueued at the same time?

NutritiousBear41 - If the problem still occurs - I would like to see i this is a caching issue. Can you please try the following:
Open developer tools (F12) and go to network tab Locate the last call to version.json (this occurs every few minutes so you should see it at the bottom) Right-click and select Edit and Resend On the right side - look at the Request Headers and remove the 2 lines starting with "If-Modified-Since:" and "If-None-Match:" (probably at the bottom) Press send

Hi EnviousStarfish54 .
I'm trying to make sure I understand the scenario. What I undestood is that you add a custom column (metric) to the experiments table, sort by it and then refresh with F5. I wasn't able to reproduce this on the Demo site ( https://demoapp.trains.allegro.ai/projects/*/experiments?columns=selected&columns=type&columns=name&columns=tags&columns=status&columns=project.name&columns=users&columns=started&columns=last_update&columns=last_iteration&columns=m.5451af93e0bf68a4ab...

Do you still get the new version notification?

Hi @<1526371986278715392:profile|VivaciousReindeer64> ,
I replicated your environment, and found the following solution:

• In the docker-compose, add the following to the webserver section:

    volumes:
      - /opt/clearml/config:/mnt/external_files/configs

• In the host machine, create a file /opt/clearml/config/configuration.json containing the following:

{
	"displayedServerUrls": {
		"filesServer": "

"
	}
}

• restart the docker-compose: `sudo docker-...