Files are stored on the same box where the docker is running. And there is a mounting point between file server docker and the host itself.
in your setup you should probably configure docker webserver container to mount a config file to /usr/share/nginx/html/configuration.json
When i deleted the Experiment, i obtain a the following window :
Usually the location is on the file server at opt/clearml/data/fileserver
The addresses seems strange, is this the hostname?
It seems like a mix between hostname and IP?
MotionlessCoral18 I thought no this is expected since the webapp sends a delete request for each object, but does not handle the directory. That something we need to improve
No particular information in console( no error), no network error too.
What i don't understant is the list of artifacts that were not deleted
My configuration.json is { "fileBaseUrl": " http://file.10.68.0.250.nip.io "}, but HTTP.FILE_BASE_URL still remains undefined . Something is missing ?
i tried so far but it was not so easy, because there is a python executable "update_from_env" that empties the configuration.json file. So i create a file in /mnt/external_files/configs and my configuration.json was read.
The addresses seems strange, is this the hostname?
I use the nip services to have subdomains: clearml.domain api.domain and file.domain that points to the same host.
My artifacts are now deleted but the directories where the artifacts are stored are not deleted.
it might be an issue in the UI due to this unconventional address or network settings
I think this is related to an https://github.com/allegroai/clearml-server/issues/112#issue-1149080358 that seems to be a reoccurring issue across many different setups
MotionlessCoral18 , I think there is a new version out - 1.4, can you try upgrading to that?
I was unable to define FILE_BASE_URL inside the docker container. I modify the HTTP constant in app.constants.ts with hard code values, compile the webapp again (npm) and replace it in my docker container and now it works....
It seems that i should define this variable by the use of an environment variable in ConfigurationService.globalEnvironment.
the UI should then send delete requests to the fileserver, do you see those in the network?
No, no "delete" request 😞 Is there a way to put a breakpoint just before ?
In docker-compose, image was latest allegroai/clearml:latest when i pull docker images. When i launch it, after installation i have in WebApp following informations : "WebApp: 1.3.1-169 • Server: 1.3.1-169 • API: 2.17"
it might be an issue in the UI due to this unconventional address or network settings, before you try this again, can you open the browser devtools?
the console and network tabs should give us more insight
MotionlessCoral18 if you build the UI, instead of overriding stuff with hard coded values, you can set fileBaseUrl in src/environments/environment.prod.ts
My files (fs) are deleted but i have the same issue as reported by SuperiorPanda77 , with some undefined value that is said not to be deleted. I guess that as my command deleteFileServerSources works but exit with some strange return value, other commands in the row addFaieldDeletedFiles and deleteProjectFromRoot are not executed (file src/app/webapp-common/shared/entity-page/entity-delete/base-delete-dialog.effects.ts )
you can manually override this configuration by adding or updating (if you have 1) the configuration.json file next to the index.html
with fileBaseUrl
Also, MotionlessCoral18 , you can take a look at the fileserver and see if you detect any errors, using sudo docker logs clearml-fileserver
Just fixing a typo - /opt/clearml/data/fileserver
were you able to confirm in the file server whether the files were actually deleted and the UI error message is wrong?
DeterminedCrab71 You right, if i understand correctly HTTP.FILE_BASE_URL is undefined, then file to delete is describe as "misc" instead of "fc" then i guess system is unable to launch the delete of the file
sudo docker logs clearml-fileserver
This gives no info at all. May be i should increase the log level to debug. The only message i got is about "werkzeug" the default server module of flash that shouldn't be use as production deployement (by the way, why not use gunicorn as entrypoint in docker-compose ?)
you can take a look at src/app/webapp-common/shared/entity-page/entity-delete/base-delete-dialog.effects.ts using the devtools debugger
I take a look a src/app/webapp-common/shared/entity-page/entity-delete/base-delete-dialog.effects.ts.
I see that an error is raised in the mergeMap at line 125, but i'm not familiar enough with Typescript to find why.