Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
VexedCat68
Moderator
60 Questions, 379 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

369 × Eureka!
0 Votes
22 Answers
500 Views
0 Votes 22 Answers 500 Views
I've setup my own clearml server. Only problem is, I can't seem to find where the credentials are. I've attached a screenshot.
2 years ago
0 Votes
9 Answers
595 Views
0 Votes 9 Answers 595 Views
Pipeline_Controller.py doesn't exist in repo, or atleast the link to it in the docs is dead in the simple pipeline example. Any help would be appreciated.
2 years ago
0 Votes
17 Answers
613 Views
0 Votes 17 Answers 613 Views
Should Dataset Triggers also be activated if there is no trigger condition except dataset_project and a new task starts in that project? Is this expected beh...
2 years ago
0 Votes
15 Answers
518 Views
0 Votes 15 Answers 518 Views
How do I get args like epochs to show up in the UI configuration panel under hyperparameters? I want to be able to change number of epochs and learning rate ...
2 years ago
0 Votes
9 Answers
494 Views
0 Votes 9 Answers 494 Views
Trying to create a data pipeline on my own. Wanted to ask, for each batch of data, do I have to create a new Dataset Object or do I just create one Dataset O...
2 years ago
0 Votes
5 Answers
549 Views
0 Votes 5 Answers 549 Views
Would appreciate some help. Getting this Error. ValueError: Node train_model, parameter '${split_dataset.split_dataset_id}', input type 'split_dataset_id' is...
2 years ago
0 Votes
5 Answers
511 Views
0 Votes 5 Answers 511 Views
2 years ago
0 Votes
12 Answers
681 Views
0 Votes 12 Answers 681 Views
I'm training a tensorflow model and saving it in the end. I looked at the OutputModel class. How do I connect the model I'm saving to the OutputModel?
2 years ago
0 Votes
8 Answers
500 Views
0 Votes 8 Answers 500 Views
2 years ago
0 Votes
15 Answers
511 Views
0 Votes 15 Answers 511 Views
2 years ago
0 Votes
15 Answers
684 Views
0 Votes 15 Answers 684 Views
I'm publishing the model artifact after the tensorflow model is saved. But in the UI, the download button is grayed out. And get_local_copy() doesn't seem to...
2 years ago
0 Votes
15 Answers
571 Views
0 Votes 15 Answers 571 Views
2 years ago
0 Votes
7 Answers
476 Views
0 Votes 7 Answers 476 Views
Hi guys, needed a bit of clarification. Every 15 minutes, the scheduler prints, "Syncing scheduler, sleeping for 15 minutes until next sync". Can you guide m...
2 years ago
0 Votes
4 Answers
452 Views
0 Votes 4 Answers 452 Views
Is it possible to write text file and see it in results of the experiment? I want to use it to version data as in keeping a track of what images have been tr...
2 years ago
0 Votes
2 Answers
589 Views
0 Votes 2 Answers 589 Views
How can I register a json file I'm creating as an artifact
2 years ago
0 Votes
13 Answers
582 Views
0 Votes 13 Answers 582 Views
Another simple query guys. I've installed clearml on ubuntu. However, it says command not found when i run any command with clearml . I feel like it might be...
2 years ago
0 Votes
3 Answers
629 Views
0 Votes 3 Answers 629 Views
2 years ago
0 Votes
7 Answers
600 Views
0 Votes 7 Answers 600 Views
When i create clearml-dataset from the cli, I get an id. The same doesn't happen when I use the Python API. is there any way to get the ID in python?
2 years ago
0 Votes
0 Answers
509 Views
0 Votes 0 Answers 509 Views
Just following instructions from the clearml-serving repo.
2 years ago
0 Votes
9 Answers
550 Views
0 Votes 9 Answers 550 Views
2 years ago
0 Votes
2 Answers
496 Views
0 Votes 2 Answers 496 Views
Is there a ClearML way to write a scheduler to watch a folder and publish a dataset when there are X number of files in that folder, or do I have to write a ...
2 years ago
0 Votes
13 Answers
513 Views
0 Votes 13 Answers 513 Views
2 years ago
0 Votes
3 Answers
498 Views
0 Votes 3 Answers 498 Views
In your docs for Dataset at https://clear.ml/docs/latest/docs/references/sdk/dataset#class-dataset , I think you might have duplicate explanations for list_m...
2 years ago
0 Votes
13 Answers
532 Views
0 Votes 13 Answers 532 Views
2 years ago
0 Votes
1 Answers
610 Views
0 Votes 1 Answers 610 Views
In the configuration section of an experiment, I can see the args I passed via argparse. Is there any way to create other sections other than args and tf_define
2 years ago
0 Votes
27 Answers
524 Views
0 Votes 27 Answers 524 Views
I wanted to ask, how to run pipeline steps conditionally? E.g if step returns a specific value, exit the pipeline or run another step instead of the sequenti...
2 years ago
0 Votes
25 Answers
577 Views
0 Votes 25 Answers 577 Views
I'll just ask this question again to get some fresh attention to this. Is there any way to run a pipeline step conditionally? E.g, under certain condition, e...
2 years ago
0 Votes
10 Answers
578 Views
0 Votes 10 Answers 578 Views
2 years ago
0 Votes
1 Answers
553 Views
0 Votes 1 Answers 553 Views
I have a question. I'm struggling with setting up my own ClearML server. I think i've got it up and running but not sure how to send clearml-task to my own s...
2 years ago
0 Votes
10 Answers
566 Views
0 Votes 10 Answers 566 Views
2 years ago
Show more results questions
2 years ago
0 Is There An Example Of Simple Pipeline Using Task Scheduler? I Want To Create A Simple Pipeline Where First A Folder Is Monitored Using A Taskscheduler, And Under Certain Conditions, Data Is Uploaded And Dataset Id Is Given To The Next Step In The Pipeli

Alright. Anyway I'm practicing with the pipeline. I have an agent listening to the queue. Only problem is, it fails because of requirement issues but I don't know how to pass requirements in this case.

2 years ago
0 Would Appreciate Some Help. Getting This Error. Valueerror: Node Train_Model, Parameter '${Split_Dataset.Split_Dataset_Id}', Input Type 'Split_Dataset_Id' Is Invalid

AgitatedDove14 Can you help me with this? Maybe something like storing the returned values or something in a variable outside the pipeline?

2 years ago
0 I Keep Facing This Issue. I'M Trying To Set Up My Own Clearml Server Using This Tutorial.

when you connect to the server properly, you're able to see the dashboard like this with menu options on the side.

2 years ago
0 I Keep Facing This Issue. I'M Trying To Set Up My Own Clearml Server Using This Tutorial.

There's a whole task bar on the left in the server. I only get this page when i use the ip 0.0.0.0

2 years ago
0 How Do I Get Args Like Epochs To Show Up In The Ui Configuration Panel Under Hyperparameters? I Want To Be Able To Change Number Of Epochs And Learning Rate From Within The Ui.

from sklearn.datasets import load_iris
import tensorflow as tf
import numpy as np
from clearml import Task, Logger
import argparse

def main():
    parser = argparse.ArgumentParser()
    parser.add_argument('--epochs', metavar='N', default=64, type=int)
    args = parser.parse_args()
    parsed_args = vars(args)
    task = Task.init(project_name="My Workshop Examples", task_name="scikit-learn joblib example")
    iris = load_iris()
    data = iris.data
    target = i...

2 years ago
0 When It Comes To Continuous Training, I Wanted To Know How You Train Or Would Train If You Have Annotated Data Incoming? Do You Train Completely Online Where You Train As Soon As You Have A Training Example Available? Do You Instead Train When You Have A

AgitatedDove14 Sorry for pinging you on this old thread. I had an additional query. If you've worked on a process similar to the one mentioned above, how do you set the learning rate? And what was the learning strategy? ADAM? RMSProp?

2 years ago
0 How Do I Get Args Like Epochs To Show Up In The Ui Configuration Panel Under Hyperparameters? I Want To Be Able To Change Number Of Epochs And Learning Rate From Within The Ui.

Quick follow up question. Once I parse args, should they be directly available for i even enque the project for the first time or will i be able to access hyperparameters after running it once?

2 years ago
0 When It Comes To Continuous Training, I Wanted To Know How You Train Or Would Train If You Have Annotated Data Incoming? Do You Train Completely Online Where You Train As Soon As You Have A Training Example Available? Do You Instead Train When You Have A

Lastly, I have asked this question multiple times, but since the MLOps process is so new, I want to learn from others experience regarding evaluation strategies. What would be a good evaluation strategy? Splitting the batch into train test? that would mean less data for training but we can test it asap. Another idea I had was training on the current batch, then evaluating it on incoming batches. Any other ideas?

2 years ago
0 How Do I Get Args Like Epochs To Show Up In The Ui Configuration Panel Under Hyperparameters? I Want To Be Able To Change Number Of Epochs And Learning Rate From Within The Ui.

I'm using clear-ml agent right now. I just upload the task inside a project. I've used arg parse as well however as of yet, I have not been able find writable hyperparameters in the UI. Is there any tutorial video you can recommend that deals with this or something? I was following https://www.youtube.com/watch?v=Y5tPfUm9Ghg&t=1100s this one on youtube but I can't seem to recreate his steps as he sifts through his code.

2 years ago
0 How Do I Get Args Like Epochs To Show Up In The Ui Configuration Panel Under Hyperparameters? I Want To Be Able To Change Number Of Epochs And Learning Rate From Within The Ui.

Basically when I have to re run the experiment with different hyperparameters, I should clone the previous experiment and change the hyperparameters then before putting it in the queue?

2 years ago
0 Is There A Tutorial For Clearml Serving? I Followed The Steps On Its Repo But I Still Don'T Understand It. Also The Serving Engine Keeps Failing After A While. I Also Don'T Know How To Access The Serving Engine Or How To Send Inference Requests To It.

I've finally gotten the triton engine to run. I'll be going through nvidia triton docs to find how to make an inference request. If you have an example inference request, I'll appreciate if you can share it with me.

2 years ago
0 When It Comes To Continuous Training, I Wanted To Know How You Train Or Would Train If You Have Annotated Data Incoming? Do You Train Completely Online Where You Train As Soon As You Have A Training Example Available? Do You Instead Train When You Have A

I get what you're saying. I was considering training on just the new data to see how it works. To me it felt like that was the fastest way to deal with data drift. I understand that it may introduce instability however. I was curious how other developers who have successfully managed to set up continuous training deal with it. 100% new data, or a ratio between new and old data. And if it is the latter, what should be the case, which should be the majority, old data or new data?

2 years ago
0 When It Comes To Continuous Training, I Wanted To Know How You Train Or Would Train If You Have Annotated Data Incoming? Do You Train Completely Online Where You Train As Soon As You Have A Training Example Available? Do You Instead Train When You Have A

Understandable. I mainly have regular image data, not video sequences so I can do the train test splits like you mentioned normally. What about the epochs though? Is there a recommended number of epochs when you train on that new batch?

2 years ago
0 When I Create Clearml-Dataset From The Cli, I Get An Id. The Same Doesn'T Happen When I Use The Python Api. Is There Any Way To Get The Id In Python?

My use case is basically if I want to now access this dataset from somewhere else, shouldn't I be able to do so using its id?

2 years ago
0 I'D Been Following The Clearml Serving Example On Its Github Repo Here. It Basically Deploys A Keras Mnist Model. The Tutorial However Ends Once The Model Is Deployed However And I'Ve Tried Going Through Resources On How To Do Inference But Have Had Troub

For anyone who's struggling with this. This is how I solved it. I'd personally not worked with GRPC so I instead looked at the HTTP docs and that one was much simpler to use.

2 years ago
2 years ago
0 I Wanted To Ask, How To Run Pipeline Steps Conditionally? E.G If Step Returns A Specific Value, Exit The Pipeline Or Run Another Step Instead Of The Sequential Step

Another question, in the parents sequence in pipe.add_step, we have to pass in the name of the step right?

2 years ago
Show more results compactanswers