Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
VivaciousBadger56
Moderator
14 Questions, 84 Answers
  Active since 10 January 2023
  Last activity 10 months ago

Reputation

0

Badges 1

84 × Eureka!
0 Votes
22 Answers
514 Views
0 Votes 22 Answers 514 Views
In
In None is said that the python environment is logged. I do not see where in the ClearML web app and I am not able to find a way to do this programmatically.
one year ago
0 Votes
2 Answers
486 Views
0 Votes 2 Answers 486 Views
one year ago
0 Votes
8 Answers
631 Views
0 Votes 8 Answers 631 Views
one year ago
0 Votes
4 Answers
461 Views
0 Votes 4 Answers 461 Views
Hello everyone, I would like to know what your projects are in terms of the usage of ClearML pipelines? What are your most elaborate pipelines? So far, I am ...
10 months ago
0 Votes
12 Answers
638 Views
0 Votes 12 Answers 638 Views
I cannot get the configuration from a task: I run from clearml import Task, TaskTypes, Model, OutputModel, InputModel from clearml.task_parameters import Tas...
one year ago
0 Votes
12 Answers
552 Views
0 Votes 12 Answers 552 Views
I am trying to run the urbandsounds8k example, but when I run "preprocessing" I get the error in the line self.metadata = Task.get_task(task_id=self.original...
one year ago
0 Votes
9 Answers
548 Views
0 Votes 9 Answers 548 Views
What is the difference between Model and InputModel?
one year ago
0 Votes
4 Answers
596 Views
0 Votes 4 Answers 596 Views
Is there an larger example on how to use task.connect other than in the doc string? For example None says "Once objects are connected to a task, all object e...
one year ago
0 Votes
1 Answers
489 Views
0 Votes 1 Answers 489 Views
Hi everyone, I am very new to ClearML. I would like to do a tutorial to gain practical experience with ClearML. I have seen that https://clear.ml/docs/latest...
one year ago
0 Votes
0 Answers
546 Views
0 Votes 0 Answers 546 Views
How do I properly complete a task in a Python console? If I run the code from clearml import Task, TaskTypes task = Task.init(project_name='FirstTrial', task...
one year ago
0 Votes
1 Answers
643 Views
0 Votes 1 Answers 643 Views
In None it is said that code level variables are logged. I do not see where in the ClearML web app and I am not able to find a way to do this programmatically.
one year ago
0 Votes
4 Answers
496 Views
0 Votes 4 Answers 496 Views
How can one combine ClearML with other tools. The documentation does not provide much information on integration. I am particularily interested in combining ...
one year ago
0 Votes
31 Answers
17K Views
0 Votes 31 Answers 17K Views
ClearML pipelines can be build from tasks, functions, and decorated functions, according to the examples in None . I am guessing there was a certain way of d...
one year ago
0 Votes
45 Answers
15K Views
0 Votes 45 Answers 15K Views
one year ago
0 What Is The Difference Between Model And Inputmodel?

@<1523701070390366208:profile|CostlyOstrich36> I read those, but did not understand.

one year ago
0 What Is The Difference Between Model And Inputmodel?

@<1523701070390366208:profile|CostlyOstrich36> : After more playing around, it seems that ClearML Server does not store the models or artifacts itself. These are stored somewhere else (e.g., AWS S3-bucket) or on my local machine and ClearML Server is only storing configuration parameters and previews (e.g., when the artifact is a pandas dataframe). Is that right? Is there a way to save the models completely on the ClearML server?

one year ago
0 Is There A Way To Save The Models Completely On The Clearml Server? It Seems That Clearml Server Does Not Store The Models Or Artifacts Itself, But They Are Stored Somewhere Else (E.G., Aws S3-Bucket) Or On My Local Machine And Clearml Server Is Only Sto

@<1523701087100473344:profile|SuccessfulKoala55> I think I might have made a mistake earlier - but not in the code I posted before. Now, I have the following situation:

  • In my training Python process on my notebook I train the custom made model and put it on my harddrive as a zip file. Then I run the code
output_model = OutputModel(task=task, config_dict={...}, name=f"...")
output_model.update_weights(weights_filename=r"C:\path\to\mymodel.zip", is_package=True)
  1. I delete the "...
one year ago
0 Clearml Pipelines Can Be Build From Tasks, Functions, And Decorated Functions, According To The Examples In

@<1523701083040387072:profile|UnevenDolphin73> , you wrote

Well, I would say then that in the second scenario it’s just rerunning the pipeline, and in the third it’s not running it at all

(I mean, in both the code may have changed, the only difference is that in the second case you’re interested in measuring it, and in the third,
you’re not, so it sounds like a user-specific decision).

Well, I would hope that in the second scenario step A is not rerun. Yes, in the third scen...

one year ago
0 What Is The Difference Between Model And Inputmodel?

@<1523701070390366208:profile|CostlyOstrich36> : Thanks, where can I find more information on ClearML's model repository. I hardly find any in the documentation.

Also, that leaves the question open, what Model is for. I described how I understand, the workflow should look like, but my question remains open...

one year ago
0 In

"uncommitted changes" and "container" is also empty.

one year ago
0 In

I am using professional version 1.6.4.

one year ago
0 Is There An Larger Example On How To Use Task.Connect Other Than In The Doc String? For Example

Thank you I found the error.
myPar = task.connect(myPar, name='from TaskParameters')
is required.

one year ago
0 Is There A Way To Save The Models Completely On The Clearml Server? It Seems That Clearml Server Does Not Store The Models Or Artifacts Itself, But They Are Stored Somewhere Else (E.G., Aws S3-Bucket) Or On My Local Machine And Clearml Server Is Only Sto

@<1523701087100473344:profile|SuccessfulKoala55> Also, I think that - in this case, but also in other cases - the issue is not just the documentation, but also the design of the SDK.

one year ago
0 I Cannot Get The Configuration From A Task: I Run

Secondly, I do not understand this:

None says

Manually mark a Task as completed. This will close the running process and will change the Task’s status to Completed (Use this function to close and change status of remotely executed tasks). To simply change the Task’s status to completed, use task.close()

None says

Closes the current Task and cha...

one year ago
0 Clearml Pipelines Can Be Build From Tasks, Functions, And Decorated Functions, According To The Examples In

@<1523701083040387072:profile|UnevenDolphin73> : A big point for me is to reuse/cache those artifacts/datasets/models that need to be passed between the steps, but have been produced by colleagues' executions at some earlier point. So for example, let the pipeline be A(a) -> B(b) -> C(c), where A,B,C are steps and their code, excluding configurations/parameters, and a,b,c are the configurations/parameters. Then I might have the situation, that my colleague ran the pipeline A(a) -> B(b) -> C(c...

one year ago
0 Clearml Pipelines Can Be Build From Tasks, Functions, And Decorated Functions, According To The Examples In

: What does

  • The component code still needs to be self-composed (or, function component can also be quite complex)

Well it can address the additional repo (it will be automatically added to the PYTHONPATH), and you can add auxilary functions (as long as they are part of the initial pipeline script), by passing them to

helper_functions

mean? Is it not possible that I call code that is somewhere else on my local computer and/or in my code base? That makes thi...

one year ago
0 I Cannot Get The Configuration From A Task: I Run

Ok, I checked: A is terminated. This is not what I thought would happen and not what I intended with my documentation. I should clarify that.

one year ago
0 I Am Trying To Run The Urbandsounds8K Example, But When I Run "Preprocessing" I Get The Error In The Line

KindChimpanzee37 , I ensured that the dataset_name is the same in get_data.py and preprocessing.py and that seemed to help. Then, I got the error RuntimeError: No audio I/O backend is available. , because of which I installed PySoundFile with pip; that helped. Weirdly enough then, the old id error came back. So, I re-ran get_data.py and then preprocessing.py - this time the id error was gone again. Instead, I got `raise TypeError("Invalid file: {0!r}".format(self.name))
TypeError:...

one year ago
0 I Am Trying To Run The Urbandsounds8K Example, But When I Run "Preprocessing" I Get The Error In The Line

KindChimpanzee37 : First I went to the dataset and clicked on "Task information ->" in the right bottom corner of the "VERSION INFO". I supposed that is the same as what you meant with "right click on more information"? Because I did not find any option to "right click on more information". The "Task information ->" leads me to a view in the experiment manager. I posted the two screen shots.

PS: It is weird to me that the datamanager leads me to the experiment manager, specifically an experi...

one year ago
0 In

I am using a venv environment, managed by poetry. Not sure if that helps.

one year ago
0 In

But then I do not see the "installed packages" in "excecution".

one year ago
0 In

Ah, wait, when I run the entire script, I do see the respective information in "execution".

one year ago
0 In

>pip show clearml
WARNING: Ignoring invalid distribution -upyterlab (c:\users\...\lib\site-packages)
WARNING: Ignoring invalid distribution -illow (c:\users\...\lib\site-packages)
Name: clearml
Version: 1.6.4
Summary: ClearML - Auto-Magical Experiment Manager, Version Control, and MLOps for AI
Home-page: None
`Auth...

one year ago
0 I Cannot Get The Configuration From A Task: I Run

@<1523701205467926528:profile|AgitatedDove14> In the documentation it warns about .close() "Only call Task.close if you are certain the Task is not needed."
What does the documentation refer to? My understanding would be that if close the task within a program, I am not able to use the task object anymore as before and I need to retrieve it via query_tasks to get it again. Is that correct?

one year ago
0 In

I see that with task.mark_completed(), I am able to programmatically complete the task.

one year ago
0 In

Ah... if I run the same script not from PyCharm, but from the terminal, then it gets completed... puh...

one year ago
0 Clearml Pipelines Can Be Build From Tasks, Functions, And Decorated Functions, According To The Examples In

What is helper_functions in

  • None
  • Nonegood for?
    I do not find any example. The descriptions says

By default the pipeline step function has no access to any of the other functions, by specifying additional functions here, the remote pipel...

one year ago
0 What Is The Point Of User Properties In Comparisson To Hyperparameters In The Configuration Of A Task? While The Syntax Of Using Them Is Different, I Do Not See What User Properties Can Do That Hyperparameters / "Task Parameters" Are Not Able To Do.

I mean those, that you see in the screen shot. The difference in code is - at least for me - to write

  • parameters_data = {'custom1': 'no', 'custom2': False}; parameters_data = task.connect(parameters_data , name='data')
  • task.set_user_properties(custom1='no', custom2=False)
    image
one year ago
0 In

It means "The syntax for the file name, folder name or volume label / disk is wrong" somthing along those lines. The [...] is the directory path to my project, which I opened in PyCharm and from which I run the commands in the Python Console.

one year ago
Show more results compactanswers