@<1526371986278715392:profile|VivaciousReindeer64> - I added this and it worked:
- WEBSERVER__fileBaseUrl="
"
Maybe the quotes are required.
Hi EnviousStarfish54 .
I'm trying to make sure I understand the scenario. What I undestood is that you add a custom column (metric) to the experiments table, sort by it and then refresh with F5. I wasn't able to reproduce this on the Demo site ( https://demoapp.trains.allegro.ai/projects/*/experiments?columns=selected&columns=type&columns=name&columns=tags&columns=status&columns=project.name&columns=users&columns=started&columns=last_update&columns=last_iteration&columns=m.5451af93e0bf68a4ab...
@<1566596960691949568:profile|UpsetWalrus59> - if you could also paste the payload and response of the call to events.get_multi_task_plots - from the network tab of the browser's dev-tools (F12), this might also help understand
Hi @<1798887585121046528:profile|WobblyFrog79> .
Thanks for reaching out, and sorry for the late reply.
We really appreciate community PRs and do our best to review and merge them as quickly as we can. Sometimes it takes a bit longer than we’d like to get to everything, but please don’t hesitate to give us a nudge if something’s been sitting for a while.
I’ll make sure we take another look at your PR - thanks again for helping improve ClearML!
Hi DepressedChimpanzee34 . Thanks for the info.
Plotly animation is currently not supported in the web app. We're looking into adding this into a future version. Can you describe the use case of animations in your system?
Make sure restart the compose ( docker-compose up -d )
Hi CooperativeFox72 . Thanks for reporting this issue.
Can you add the following information:
Is this on the hosted community server ( http://app.community.clear.ml ) or a server that you installed? If this is a server the you installed locally - which server version are you running Which browser, and what resolution are you using?Thanks,
Oren.
@<1585078752969232384:profile|FantasticDuck7> - you can set
WEBSERVER__displayedServerUrls={"apiServer":"<apiserver address>","filesServer":"<filesserver addess>","webServer":"<webserver address>"}
This should affect the display of the credentials screen
EnviousStarfish54 - we identified the issue, and will fix it for the next release
SuperiorPanda77 - thanks for updating. So indeed these may be similar issues. I will re-check this and udpate
EnviousStarfish54 - Got it!
I'll look into it and update you. Thanks for reporting!
AbruptWorm50 - the agent poll the queue, so any free agent can pull tasks. From the graph on the right, it looks like experiments were not waiting in the queue (max experiments is 1, and it was immediately pulled). Can you also check what happens if two experiments are enqueued at the same time?
Hi DepressedChimpanzee34 .
Currently supporting plotly animations is not planned for the upcoming versions. I would suggest opening a feature request in github, or add it to the UI change request thread: https://github.com/allegroai/clearml/issues/81 .
Thanks,
Oren.
@<1523701087100473344:profile|SuccessfulKoala55> - yes, plots are reported every iteration.
@<1564060248291938304:profile|AmusedParrot89> - the plot comparison indeed compares the latest iteration of the experiments. I will see if this can be better indicated somewhere
@<1558986867771183104:profile|ShakyKangaroo32> - are you running the server using docker-compose?
If so - please add the following to the .env file in the same directory as the compose:CLEARML_FILES_HOST=http:// <YOUR IP or HOSTNAME> :8081
Then restart the service by running sudo docker-compose up -d
Please update if this worked, or if you have any questions/issues
The artifacts (debug samples, models, artifacts) deletion is currently performed done from the browser, after the task object is deleted from the backend. So it might take time for all the artifacts to be deleted - please make sure not to close your browser.
Note that only artifacts saved on fileserver are deleted - exteranal artifacts (in the cloud or on a local filesystem) are not deleted.
We are working on moving the deletion to the server side, to avoid these kind of issues. Should be in ...
@<1558986867771183104:profile|ShakyKangaroo32> - if you check the api section in your client-side clearml.conf, the value for files_server there should be the same one that you set in the .env file on the server. Can you check that they are indeed the same?
If they are the same - can you please send me the output of the following command in the server:sudo docker logs -n30 async_delete
Do you still get the new version notification?
We limit the allowed calls per IP - to make sure the server is not blocked accidentally. We enabled over 1000 calls per minute.
Yes - I found it. Will see how to fix that. Thanks again.
Let us know if you run into any other issues
NutritiousBear41 - I'm currently checking what can cause this. Will get back to you shortly
ShinyRabbit94 - The github issue reported by SuperiorPanda77 is a display issue - meaning the files are deleted, and only the "undefined" display is incorrect. This should be fixed in the next release (1.4).
In your case the files are not deleted from the filesystem - so I assume this is a different issue. Can you provide more info so that I can try to reproduce:
How are the artifacts created? Are the links in the popup describing the un-deleted files correct? Can you add a screenshot?
Hi DrainedHippopotamus42 - I just answered in Slack (didn't see the post here...). We found the issue and it will be resolved in the next saas update. For the time being I added more storage to your workspace. Once you run a task that reports metrics - the problem should disappear.
Please let me know if this works for you
Great! Thanks for the update
Hi @<1526371986278715392:profile|VivaciousReindeer64> - please try this file:
@<1681836303299121152:profile|RoundElk14> - I'm happy that you managed to resolve the issue. We are trying to reproduce it, but so far didn't manage to do so. As far as I understand - signed up to an account with google, and later tried to login with email - is that correct?
@<1681836303299121152:profile|RoundElk14> - thanks for the info.
app.clear.ml is the correct server
app.allegro,ai is an older demo server that should not be used. Do you know where you found the link to that - so that we can remove it?
No problem. Glad it's working now
@<1526371986278715392:profile|VivaciousReindeer64> - I'll check it on my env