Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, We Deploy Clearml In Azure And Have Used Azure Cache For Redis So Far. But That'S Retiring And The New Service Is Azure Managed Redis. I'Ve Managed To Connect

Hi, we deploy ClearML in Azure and have used Azure Cache for Redis so far. But that's retiring and the new service is Azure Managed Redis. I've managed to connect clearml-server and it works mostly fine except for cloning of tasks and deleting of archived tasks, where the following error pops up:

CROSSSLOT Keys in request don't hash to the same slot (context='', command='del', original-slot='2259', wrong-slot='5440', first-key='tags_d1bd92a3b039400cbafc60a7a5b1e52b_Task', violating-key='tags_d1bd92a3b039400cbafc60a7a5b1e52b_d12eae147f024490a3740fc1453b5076_Task')

This didn't happen before. The key differences between Azure Cache For Redis and Azure Managed Redis are that the former is Redis v6 and the latter is v7.
Anyone run ClearML and Redis > 6? According to any favourite AI bot the cluster slots rules enforcing got stricter so wondering if it's just an issue with moving to a later version of Redis?

If it's not Redis 6vs7, one possible related artefact: After changing the connection, clearml-server kept dying on startup with Redis Exception DB index out of range . I had to explicitly set DB index to 0 in the config for the apiserver and the workers aliases. Is there by any chance some implicit - use db 0 for some stuff and db 1 for others? (this would be bit problematic because Azure Managed Redis only supports DB 0 at this point)

Despite the error popup the operation still succeeds.

  
  
Posted 21 days ago
Votes Newest

Answers 4


Hi @<1722061389024989184:profile|ResponsiveKoala38> Thanks for the update. The Microsoft documentation for Azure Managed Redis is not 100% clear - according to None the B0 instance which we use only has one primary shard and we have HA disabled, so this would indicate that only one shard is in use.
OTOH - None states that due to clustered configuration, CROSSSLOT errors may happen and that all multi-key commands must map to the same hash slot.

  
  
Posted 17 days ago

Hi @<1888397385122451456:profile|PreciousPigeon91> , what version of ClearML are you using?

  
  
Posted 18 days ago

We identified the issue. It is connected to the cluster that has more than 1 shard. We are planning to fix it in one of the upcoming versions. Do you have the possibility to configure your Azure Managed Redis so that the cluster will use 1 shard only? In this scenario the problem should happen

  
  
Posted 17 days ago

We are using this: WebApp: 2.2.0-690 • Server: 2.2.0-690 • API: 2.33

  
  
Posted 18 days ago