Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
NonsensicalBat51
Moderator
3 Questions, 4 Answers
  Active since 19 May 2023
  Last activity 9 months ago

Reputation

0

Badges 1

4 × Eureka!
0 Votes
2 Answers
463 Views
0 Votes 2 Answers 463 Views
I Am Also Experiencing Another Issue: I Am Getting A 500 Level Error When Logging A Yolov5 Training Run To My Clearml Server
I am also experiencing another issue: I am getting a 500 level error when logging a YoloV5 training run to my ClearML server
9 months ago
0 Votes
3 Answers
506 Views
0 Votes 3 Answers 506 Views
Hi There, I Am Hosting Clearml Server (Deployed Into A K3S Cluster Via Helm) And Whenever Pods In A Replica Set Are Restarted, They Always Enter An Error State Due To File Permission Issues. Example:
Hi there, I am hosting ClearML server (deployed into a k3s cluster via helm) and whenever pods in a replica set are restarted, they always enter an error sta...
9 months ago
0 Votes
3 Answers
532 Views
0 Votes 3 Answers 532 Views
Hi There, I Was Wondering If There Are Any Examples Of Initializing Clearml Inside Of A Container And Then Adding The Credentials Later? Or Is It Possible To Initialize Clearml Outside Of Using
Hi there, I was wondering if there are any examples of initializing clearml inside of a container and then adding the credentials later? Or is it possible to...
11 months ago
0 I Am Also Experiencing Another Issue: I Am Getting A 500 Level Error When Logging A Yolov5 Training Run To My Clearml Server

Sample logs from the pod running training:

2023-07-27 17:38:21,854 - clearml.Metrics - ERROR - Action failed <504/0: events.add_batch (<html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>
)>

Log from clearml-apiserver pod:

[2023-07-27 17:57:22,033] [9] [ERROR] [clearml.service_repo] Returned 500 for events.add_batch in 60021ms, msg=General data error: err=('13 document(s) fai...
9 months ago
0 Hi There, I Was Wondering If There Are Any Examples Of Initializing Clearml Inside Of A Container And Then Adding The Credentials Later? Or Is It Possible To Initialize Clearml Outside Of Using

Thanks! I ended up getting it working by setting environment variables

11 months ago
0 Hi There, I Am Hosting Clearml Server (Deployed Into A K3S Cluster Via Helm) And Whenever Pods In A Replica Set Are Restarted, They Always Enter An Error State Due To File Permission Issues. Example:

relevant logs for container "elasticsearch" of that pod:

{"type": "server", "timestamp": "2023-07-27T17:28:30,088Z", "level": "ERROR", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "clearml-elastic", "node.name": "clearml-elastic-master-2", "message": "uncaught exception in thread [main]", 
"stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/dat...
9 months ago
0 Hi There, I Was Wondering If There Are Any Examples Of Initializing Clearml Inside Of A Container And Then Adding The Credentials Later? Or Is It Possible To Initialize Clearml Outside Of Using

for reference, I am using argoworkflows to schedule training of yolov5 (using yolov5's docker image) and would like to use yolov5's built-in clearml logger. Inside of the container I have access to the access tokens and secret through my own api, but need to properly initialize clearml before scheduling training.

11 months ago