Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
NonsensicalSparrow35
Moderator
3 Questions, 11 Answers
  Active since 28 March 2024
  Last activity 8 months ago

Reputation

0

Badges 1

11 × Eureka!
0 Votes
5 Answers
765 Views
0 Votes 5 Answers 765 Views
Hi there! I've encountered some strange behaviour with a ClearML server self hosted via AWS EC2 AMI (WebApp: 1.14.1-448 • Server: 1.14.1-448 • API: 2.28). Fo...
8 months ago
0 Votes
5 Answers
523 Views
0 Votes 5 Answers 523 Views
Hello everyone! A question regarding uploading model weights as artifacts. I use ClearMLSaver() and Checkpoint() functionality from PyTorch Ignite and upload...
8 months ago
0 Votes
5 Answers
533 Views
0 Votes 5 Answers 533 Views
Hello there! I was trying to update the url for debug samples after migration of the server to a new domain and was following the steps from here: https://cl...
8 months ago
0 Hello Everyone! A Question Regarding Uploading Model Weights As Artifacts. I Use

Sorry again for those walls of text. Just thought that detailed explanation of how model naming for remote models works with Ignite handlers could be helpful to somebody in the future (because I spent quite some time trying to figure out why what was working perfectly fine locally started to overwrite one another when I added output_uri )

8 months ago
0 Hello Everyone! A Question Regarding Uploading Model Weights As Artifacts. I Use

And the last question on top of that (sorry!), regarding the concept of OUTPUT MODELS and MODEL NAMES. For this example, I only used one saver to save off 2 last checkpoints. When model is being uploaded for the first time the MODEL NAME in the UI is full and correct (as you can see in the first screenshot), but when it is being overwritten in the following epochs it only shows name of the experiment in the MODEL NAME and therefore all the info which was stored in the filename (like e...

8 months ago
0 Hello Everyone! A Question Regarding Uploading Model Weights As Artifacts. I Use

Just to demonstrate the workaround I described will attach an example from the UI on how it looks at the moment. Here I used 2 savers, with n_saved=2 , and filename_prefix=str(date.today()) + "_val_neg_img_loss" and filename_prefix=str(date.today()) , therefore there are 4 output models in total. If I wouldn't add "_val_neg_img_loss" to one prefix there would be only 2 models, even though (as you can see in the screenshot) in the model name the _val_neg_img_loss was used al...

8 months ago
0 Hi There! I'Ve Encountered Some Strange Behaviour With A Clearml Server Self Hosted Via Aws Ec2 Ami (Webapp: 1.14.1-448 • Server: 1.14.1-448 • Api: 2.28). For Some Reason It Doesn'T Capture Tensorboard Logs And

I've also tried to run 2 reporting examples in case of AWS hosted server:

  • None - in this case every plot was there as it should be, in the web UI under the scalars tab (including :monitor:machine with info on iterations, cpu usage, etc.)
  • None - with this sample scalars tab is compl...
8 months ago
0 Hi There! I'Ve Encountered Some Strange Behaviour With A Clearml Server Self Hosted Via Aws Ec2 Ami (Webapp: 1.14.1-448 • Server: 1.14.1-448 • Api: 2.28). For Some Reason It Doesn'T Capture Tensorboard Logs And

Apparently, the main cause was a big git diff file (about 10Mb because of the Jupyter Notebook), which somehow prevented any other upload to the server (not sure why, probably there is a timeout on any upload operation). I would much appreciate if somebody know or can guess why git diff was causing such an issue

8 months ago
0 Hi There! I'Ve Encountered Some Strange Behaviour With A Clearml Server Self Hosted Via Aws Ec2 Ami (Webapp: 1.14.1-448 • Server: 1.14.1-448 • Api: 2.28). For Some Reason It Doesn'T Capture Tensorboard Logs And

@<1523701087100473344:profile|SuccessfulKoala55> very sorry to bother you via the mention! Just wanted to ask if you (or probably somebody else from the team) have any ideas what could be the reason of missing scalars here?

8 months ago
0 Hi There! I'Ve Encountered Some Strange Behaviour With A Clearml Server Self Hosted Via Aws Ec2 Ami (Webapp: 1.14.1-448 • Server: 1.14.1-448 • Api: 2.28). For Some Reason It Doesn'T Capture Tensorboard Logs And

Thank you for a suggestion! These are the logs I've collected after running this sample None And just for the context, I can see console logs under the console tab, output models as well as a git diff uploaded to artifacts , but no scalars

8 months ago
0 Hello There! I Was Trying To Update The Url For Debug Samples After Migration Of The Server To A New Domain And Was Following The Steps From Here:

@<1523701205467926528:profile|AgitatedDove14> Am I right that the command from the link above is missing None in the end? And if so, the 9200 port should be opened first, right?

8 months ago
0 Hello There! I Was Trying To Update The Url For Debug Samples After Migration Of The Server To A New Domain And Was Following The Steps From Here:

Tried what I described above and got

{"error":"Incorrect HTTP method for uri [/] and method [POST], allowed: [GET, DELETE, PUT, HEAD]"
8 months ago
0 Hello Everyone! A Question Regarding Uploading Model Weights As Artifacts. I Use

@<1523701205467926528:profile|AgitatedDove14> I guess, the main issue is the lost of model name file especially in case when the model is being saved based on the metric value. As in the screenshots above, in the UI Model Name is being just an experiment name after the first epoch, and not the name of the actual model file (which is different from the stored file name on the server, got it). So to understand from what epoch these weights were saved off you would need manually go to model...

8 months ago
0 Hello There! I Was Trying To Update The Url For Debug Samples After Migration Of The Server To A New Domain And Was Following The Steps From Here:

Yes, I specified both "NEW_ADDRESS" and "OLD_ADRESS", but what I am talking about is that command is missing a <url> . If you check the command there is --header , --request and --data arguments but no <url> , so it returns curl: (2) no URL specified

8 months ago