Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
SuccessfulRaven86
Moderator
16 Questions, 63 Answers
  Active since 12 April 2023
  Last activity one year ago

Reputation

0

Badges 1

62 × Eureka!
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Hello, I Have The Same Issue As This Github Issue:
Hello, I have the same issue as this github issue: None I tried setting up my AWS autoscaler conf file with the following params: sdk.development.store_uncom...
one year ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hello Channel, I Have A Question Regarding Clearml Serving In Production. I Have Different Environments, And Different Models Each Of Them Linked To A Use Case. I Would Like To Spin Up One Kubernetes Cluster (From Triton Gpu Docker Compose) Taking Into
Hello channel, I have a question regarding clearml serving in production. I have different environments, and different models each of them linked to a use ca...
one year ago
0 Votes
3 Answers
838 Views
0 Votes 3 Answers 838 Views
Hello everyone, *Context:* I am currently facing a headache-inducing issue regarding the integration of flash attention V2 for LLM training. I am running a python script locally, that then runs remotely. Without the integration of flash attention, the co
Hello everyone, Context: I am currently facing a headache-inducing issue regarding the integration of flash attention V2 for LLM training. I am running a pyt...
one year ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi, I Have A Small Question Regarding K8S Clearml-Serving Behavior. I Have In My Cluster One Gpu Of 16Gb Ram, And Another One Of 24 Gb Ram. I Have A Llm Model Fitting The 24Gb But Not The 16Gb Gpu. When I Call The Endpoint, How Will I Know To Which Gpu I
Hi, I have a small question regarding k8s clearml-serving behavior. I have in my cluster one GPU of 16GB RAM, and another one of 24 GB RAM. I have a LLM mode...
one year ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi Channel, I Am Using K8S Clearml-Serving Helm Chart And Noticed A Small Issue. The Current Implementation Of
Hi channel, I am using K8s clearml-serving helm chart and noticed a small issue. The current implementation of ...ingress.yaml resource does not contain the ...
one year ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
Hello Channel, Two Other Related Questions:
Hello channel, Two other related questions: - ClearML is supposed to automatically detect GIT repo directly. It works when I run a python script but it does ...
one year ago
0 Votes
3 Answers
822 Views
0 Votes 3 Answers 822 Views
Hello! I Have A Small Question Regarding Storage Data Retrieval With Clearml
Hello! I have a small question regarding storage data retrieval with ClearML 😉 Context: My team uploads thousands of data samples for training as one ClearM...
one year ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Hello, I Am Trying To Modify My Clearml-Agent Running On A Aws Autoscaler (From Clearml Applications). I Want To Be Able To Clone My Repo (Working), And Install My Poetry Dependencies From
Hello, I am trying to modify my clearml-agent running on a AWS autoscaler (From ClearML applications). I want to be able to clone my repo (working), and inst...
one year ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hey, Can Clearml Uploads Data To Private Blob Storage Azure? I Have Authorization Errors. Is It Due To The Fact That I Do Not Have The Required Permission On The Storage Account (Could Be Possible) Or The Fact That The Storage Account Is Set As Private A
Hey, Can ClearML uploads data to private blob storage Azure? I have authorization errors. Is it due to the fact that I do not have the required permission on...
one year ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
Hey Channel, I Would Like To Setup Kubernetes For Serving My Models Only. Does It Mean I Can Use Clearml-Serving Helm Chart Alone? What Would Be The Use Case Of The Two Other Charts (Agent And Clearml Server). I Am Not Sure To Understand That Properly. I
Hey channel, I would like to setup Kubernetes for serving my models only. Does it mean I can use clearml-serving helm chart alone? What would be the use case...
one year ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi, Can Someone Give More Information About What An Api Call Means? Our Team Has Been Charged For 10 Millions Api Calls, But We Struggle To Understand Where They Are Coming From (We Are Only Making Training Tasks). Thanks
Hi, Can someone give more information about what an API call means? Our team has been charged for 10 Millions API calls, but we struggle to understand where ...
one year ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Hey Channel, Clearml-Serving Question Is It Good Practice To Save A .Zip File As Model, And Unzip It In The Custom Endpoint For Usage?
Hey channel, Clearml-serving question Is it good practice to save a .zip file as model, and unzip it in the custom endpoint for usage?
one year ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
Can We Use The Simple Docker-Compose.Yml File For Clearml Serving On A Huggingface Model (Not Processed To Tensorrt)?
Can we use the simple docker-compose.yml file for clearml serving on a huggingface model (not processed to tensorrt)?
one year ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hello, Question About The Time Of Upload: Is It Faster Or Exactly The Same To Upload 1 File Of 1Gb Compared To 10 Files Of 100 Mb?
Hello, Question about the time of upload: Is it faster or exactly the same to upload 1 file of 1Gb compared to 10 files of 100 Mb?
one year ago
0 Votes
40 Answers
50K Views
0 Votes 40 Answers 50K Views
Hello Channel, I Am Struggling A Lot On An Issue Linked To
Hello channel, I am struggling a lot on an issue linked to ClearMl agent and AWS Autoscaler . This issue is very problematic and urgent, please help me out! ...
one year ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hey, I Saw Previously That Grafana/Prometheus Were Not Supported As Part Of The Clearml-Serving Helm Chart. I Guess This Is Outdated Right? I See These Charts As Part Of Your Serving Chart. So They Should Be Accessible If The K8S Cluster Is Accessible Fro
Hey, I saw previously that Grafana/Prometheus were not supported as part of the clearml-serving helm chart. I guess this is outdated right? I see these chart...
one year ago
0 Can We Use The Simple Docker-Compose.Yml File For Clearml Serving On A Huggingface Model (Not Processed To Tensorrt)?

Thank you! I will try this 🙂

one year ago
0 Can We Use The Simple Docker-Compose.Yml File For Clearml Serving On A Huggingface Model (Not Processed To Tensorrt)?

Prerequisites, PyTorch models require Triton engine support, please use docker-compose-triton.yml / docker-compose-triton-gpu.yml or if running on Kubernetes, the matching helm chart.

one year ago
0 Can We Use The Simple Docker-Compose.Yml File For Clearml Serving On A Huggingface Model (Not Processed To Tensorrt)?

I would like to know if it is possible to run any pytorch model on the basic docker compose file ? Without triton?

one year ago
Show more results compactanswers