Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I Have Used Aws S3 And Minio As Storage For Clearml Artifacts. But Has Anyone Used Nexus As A Storage ?

I have used AWS S3 and minio as storage for clearml artifacts.
But has anyone used Nexus as a storage ?

  
  
Posted 3 years ago
Votes Newest

Answers 9


DeliciousBluewhale87 , Hi!

I think you can have models/artifacts automatically copied to a location if the experiment is initialized with
output_uri
For example:
task = Task.init('examples', 'model test', output_uri=' ')What version of ClearML are you using? I'd suggest upgrading to the latest 🙂

  
  
Posted 3 years ago

DeliciousBluewhale87 , what would be your use case? You can save various artifacts/models/files to nexus via the previously mentioned method (You can also configure this in your clearml.conf file under sdk.development.default_output_uri="" )

  
  
Posted 3 years ago

CostlyOstrich36 :
They mentioned that they already have a Nexus backend. So just was wondering if we could use it for storage purposes.

  
  
Posted 3 years ago

Thanks. 👍

  
  
Posted 3 years ago

DeliciousBluewhale87 basically any solution that is compliant with S3 protocol will work. An example:
output_uri=" :PORT/bucket/folder"Are you sure Nexus supports this protocol ?
I "think" nexus sits on top of a storage solution (like am object storage), meaning we can use the same storage solution Nexus is using.
Just to clarify we do not support the artifactory protocol Nexus provides for storing models/artifacts. But we do support it as a source for python packages used by the agent.

  
  
Posted 3 years ago

we can always use the latest Clearml.
We were thinking of a use case for a client, who has Sonatype Nexus in their environment ? Could we leverage on it, or would we need minio instead ?

  
  
Posted 3 years ago

DeliciousBluewhale87 , I believe so, yes 🙂

  
  
Posted 3 years ago

In our local setup, we use minio though ?

  
  
Posted 3 years ago

Quick update Nexus supports direct http upload, which means that as CostlyOstrich36 mentioned, just pointing to the Nexus http upload endpoint would work:
output_uri="http://<nexus>:<port>/repository/something/"See docs:
https://support.sonatype.com/hc/en-us/articles/115006744008-How-can-I-programmatically-upload-files-into-Nexus-3-

  
  
Posted 3 years ago