Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey, We Save Our Artifacts And Models In An Azure Blob Storage. For Security Reasons, Our Blob Storage Blocks Traffic From Everything Outside An Azure Vnet (To Which Are Workers Are Connected To) We Want To Try And Use The "Clearml Gpu Compute" Applicati

Hey, we save our artifacts and models in an azure blob storage.
for security reasons, our blob storage blocks traffic from everything outside an azure VNet (to which are workers are connected to)

we want to try and use the "ClearML GPU Compute" application, but we need a way to let it access the blob storage. (network wise)
we might open access to specific public ip address, but we don't know how to extract those from the machines.

I am thinking this is a wider problem? like, anyone who stores their data in a private storage solution will have a problem intergrating with the clearml gpu compute no?

I would be happy for suggestions on how to address this issue

  
  
Posted one year ago
Votes Newest

Answers 5


plus, is there an option to configure the agent configuration? for example we are using:

force_git_root_python_path: true

can we do it there as well?

  
  
Posted one year ago

Hi @<1544853695869489152:profile|NonchalantOx99> , what actions would you exactly need to take on the machine? Genesis autoscaler allows storage on azure. If you need to add some extra commands to run before the code execution you can use the setup shell script when running inside a container

  
  
Posted one year ago

@<1523701070390366208:profile|CostlyOstrich36>
By the way, how do i set up a shell script?
i don't see an option to do it from the UI

  
  
Posted one year ago

By the way, how do i set up a shell script?

It's in under the 'container' section in the 'execution' tab of the experiment

can we do it there as well?

Yes, I think you can pass extra configurations through the shell init script

  
  
Posted one year ago

i need to read and write, i do have access from genesis autoscaler when i set off all firewall rules. but this is not recommend by microsoft.

I need to add specific firewall rules for the genesis machines, to allow them to authorize to my azure blob storage

  
  
Posted one year ago