Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
VivaciousBadger56
Moderator
14 Questions, 84 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

84 × Eureka!
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
What is the difference between Model and InputModel?
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi everyone, I am very new to ClearML. I would like to do a tutorial to gain practical experience with ClearML. I have seen that https://clear.ml/docs/latest...
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
2 years ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
I am trying to run the urbandsounds8k example, but when I run "preprocessing" I get the error in the line self.metadata = Task.get_task(task_id=self.original...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hello everyone, I would like to know what your projects are in terms of the usage of ClearML pipelines? What are your most elaborate pipelines? So far, I am ...
one year ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
I cannot get the configuration from a task: I run from clearml import Task, TaskTypes, Model, OutputModel, InputModel from clearml.task_parameters import Tas...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Is there an larger example on how to use task.connect other than in the doc string? For example None says "Once objects are connected to a task, all object e...
2 years ago
0 Votes
22 Answers
1K Views
0 Votes 22 Answers 1K Views
In
In None is said that the python environment is logged. I do not see where in the ClearML web app and I am not able to find a way to do this programmatically.
2 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
How do I properly complete a task in a Python console? If I run the code from clearml import Task, TaskTypes task = Task.init(project_name='FirstTrial', task...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
How can one combine ClearML with other tools. The documentation does not provide much information on integration. I am particularily interested in combining ...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
In None it is said that code level variables are logged. I do not see where in the ClearML web app and I am not able to find a way to do this programmatically.
2 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
2 years ago
0 Votes
31 Answers
77K Views
0 Votes 31 Answers 77K Views
ClearML pipelines can be build from tasks, functions, and decorated functions, according to the examples in None . I am guessing there was a certain way of d...
2 years ago
0 Votes
45 Answers
83K Views
0 Votes 45 Answers 83K Views
2 years ago
0 I Am Trying To Run The Urbandsounds8K Example, But When I Run "Preprocessing" I Get The Error In The Line

KindChimpanzee37 , this time, I was away for a week 🙂 . I do not think, that I made the mistake you suggested. At the top of the script I wrote
project_name = 'RL/Urbansounds'and then later
` self.original_dataset = Dataset.get(dataset_project=project_name, dataset_name='UrbanSounds example')

This will return the pandas dataframe we added in the previous task

self.metadata = Task.get_task(task_id=self.original_dataset.id).artifacts['metadata'].get() `

2 years ago
0 Clearml Pipelines Can Be Build From Tasks, Functions, And Decorated Functions, According To The Examples In

Last point on component caching, what I suggest is actually providing users the ability to control the cache "function". Right now (a bit simplified but probably accurate), this is equivalent to hashing of the following dict:

{"code": "code here", "container": "docker image", "container args": "docker args", "hyper-parameters": "key/value"}

We could allow users to add a function that get's this dict and returns a new dict that will be used for hashing. This way we will e...

2 years ago
0 I Am Trying To Run The Urbandsounds8K Example, But When I Run "Preprocessing" I Get The Error In The Line

KindChimpanzee37 : First I went to the dataset and clicked on "Task information ->" in the right bottom corner of the "VERSION INFO". I supposed that is the same as what you meant with "right click on more information"? Because I did not find any option to "right click on more information". The "Task information ->" leads me to a view in the experiment manager. I posted the two screen shots.

PS: It is weird to me that the datamanager leads me to the experiment manager, specifically an experi...

2 years ago
0 Clearml Pipelines Can Be Build From Tasks, Functions, And Decorated Functions, According To The Examples In

@<1523701083040387072:profile|UnevenDolphin73> : No, I love it ❤ . Now, I just have to read everything 😄 .

2 years ago
0 Clearml Pipelines Can Be Build From Tasks, Functions, And Decorated Functions, According To The Examples In

@<1523701083040387072:profile|UnevenDolphin73> : A big point for me is to reuse/cache those artifacts/datasets/models that need to be passed between the steps, but have been produced by colleagues' executions at some earlier point. So for example, let the pipeline be A(a) -> B(b) -> C(c), where A,B,C are steps and their code, excluding configurations/parameters, and a,b,c are the configurations/parameters. Then I might have the situation, that my colleague ran the pipeline A(a) -> B(b) -> C(c...

2 years ago
0 Clearml Pipelines Can Be Build From Tasks, Functions, And Decorated Functions, According To The Examples In

@<1523701205467926528:profile|AgitatedDove14> : In general: If I do not build a package out of my local repository/project , I cannot reference anything
from the local project/repository directly, right? I must make a package out of it, or I must reference it with the repo argument, or I must reference respective functions using the helper_functions argument. Did I get this right?

2 years ago
0 In

I am using professional version 1.6.4.

2 years ago
0 In

Ah... if I run the same script not from PyCharm, but from the terminal, then it gets completed... puh...

2 years ago
0 In

My entire code is

from clearml import Task, TaskTypes
task = Task.init(project_name='FirstTrial', task_name='first_trial', task_type=TaskTypes.training)
PACKAGE_VERSION = '0.4.1'
dataset_name = "Demodata"

which I - now - also ran as a whole script.

2 years ago
0 In

I just see the website that I linked to. I am not sure what is meant by "python environment". I cannot make a screen shot, because I do not know where to look for this in the first place.

2 years ago
0 In

But then I do not see the "installed packages" in "excecution".

2 years ago
0 In

>pip show clearml
WARNING: Ignoring invalid distribution -upyterlab (c:\users\...\lib\site-packages)
WARNING: Ignoring invalid distribution -illow (c:\users\...\lib\site-packages)
Name: clearml
Version: 1.6.4
Summary: ClearML - Auto-Magical Experiment Manager, Version Control, and MLOps for AI
Home-page: None
`Auth...

2 years ago
0 In

It means "The syntax for the file name, folder name or volume label / disk is wrong" somthing along those lines. The [...] is the directory path to my project, which I opened in PyCharm and from which I run the commands in the Python Console.

2 years ago
0 In

But still, in the web app the task is considered to be still "running". I am not sure what to do, so that the task is considered to be "completed".

2 years ago
0 I Am Trying To Run The Urbandsounds8K Example, But When I Run "Preprocessing" I Get The Error In The Line

CostlyOstrich36 sure:
[..]\urbansounds8k\venv\lib\site-packages\torchaudio\backend\utils.py:62: UserWarning: No audio backend is available. warnings.warn("No audio backend is available.") ClearML Task: overwriting (reusing) task id=[..] 2022-09-14 14:40:16,484 - clearml.Task - INFO - No repository found, storing script code instead ClearML results page: `
Traceback (most recent call last):
File "[..]\urbansounds8k\preprocessing.py", line 145, in <module>
datasetbuilder = DataSe...

2 years ago
0 In

I am running it in the Python Console in PyCharm with Task.init. I get with the log:

ClearML Task: overwriting (reusing) task id=dfa2dff538d54c18ad97ea1593cbd357
2023-02-14 13:06:44,336 - clearml.Task - WARNING - Failed auto-detecting task repository: [WinError 123] Die Syntax für den Dateinamen, Verzeichnisnamen oder die Datenträgerbezeichnung ist falsch: '[...]\<input>'
ClearML results page: [None](https://app.clear.ml/projects/9acc061c880344a881790461a4baa837/experiments/dfa2dff538d54c1...

2 years ago
0 How Can One Combine Clearml With Other Tools. The Documentation Does Not Provide Much Information On Integration. I Am Particularily Interested In Combining Clearml With Kedro And A Feature Store. I Detail My Question In

KindChimpanzee37 : Ok, will do. (More question from my side though. :-D) But I need to have pretty good idea before presenting our concept to the bosses.

2 years ago
0 In

Understand. Here I only see:
image

2 years ago
0 What Is The Difference Between Model And Inputmodel?

@<1523701070390366208:profile|CostlyOstrich36> I read those, but did not understand.

2 years ago
0 What Is The Difference Between Model And Inputmodel?

@<1523701070390366208:profile|CostlyOstrich36> : After more playing around, it seems that ClearML Server does not store the models or artifacts itself. These are stored somewhere else (e.g., AWS S3-bucket) or on my local machine and ClearML Server is only storing configuration parameters and previews (e.g., when the artifact is a pandas dataframe). Is that right? Is there a way to save the models completely on the ClearML server?

2 years ago
0 What Is The Difference Between Model And Inputmodel?

Also, I could not find any larger examples on github about Model, InputModel, or OutputModel. It's kind of difficult to build a PoC this way... 😅

2 years ago
0 What Is The Difference Between Model And Inputmodel?

As far as I understand, the workflow is like this. I define some model. Then I register it as an OutputModel. Then I train it. During training I save snapshots (not idea how, though) and then I save the final model when training is finished. This way the Model is a) connected to the task and b) available in the model store of ClearML.

Later, in a different task, I can load an already trained model with InputModel. This InputModel is read-only (regarding the ClearML model store), but I can ma...

2 years ago
0 Clearml Pipelines Can Be Build From Tasks, Functions, And Decorated Functions, According To The Examples In

What is helper_functions in

  • None
  • Nonegood for?
    I do not find any example. The descriptions says

By default the pipeline step function has no access to any of the other functions, by specifying additional functions here, the remote pipel...

2 years ago
Show more results compactanswers