Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
EnthusiasticCow4
Moderator
23 Questions, 66 Answers
  Active since 11 March 2023
  Last activity one month ago

Reputation

0

Badges 1

53 × Eureka!
0 Votes
5 Answers
323 Views
0 Votes 5 Answers 323 Views
4 months ago
0 Votes
1 Answers
367 Views
0 Votes 1 Answers 367 Views
For model monitoring, is there a good feature in ClearML? If not is there a go-to tool that works well with this framework?
7 months ago
0 Votes
0 Answers
263 Views
0 Votes 0 Answers 263 Views
Currently, things run in a pipeline are automatically moved to a /.pipelines/ subproject. Is there a way to allow the tasks done via pipelines to show up as ...
5 months ago
0 Votes
1 Answers
332 Views
0 Votes 1 Answers 332 Views
Hello all. I'm trying to figure out how to get the task from pipelines listed under the experiments tab or at least in a place that's easier to find. I'm run...
5 months ago
0 Votes
7 Answers
307 Views
0 Votes 7 Answers 307 Views
4 months ago
0 Votes
1 Answers
325 Views
0 Votes 1 Answers 325 Views
I found an interesting error. If I run the following: # Load the model from remote storage if model_url is provided if cfg.clearml.get("model_url", None): # ...
6 months ago
0 Votes
6 Answers
401 Views
0 Votes 6 Answers 401 Views
Hi all, I've been experimenting around with automating the data sync. This is related to this thread: None Here is my expectation, so correct me if I'm wrong...
7 months ago
0 Votes
1 Answers
396 Views
0 Votes 1 Answers 396 Views
If you're paying for the premium features would those be available to a self hosted server or only on the web client?
6 months ago
0 Votes
2 Answers
286 Views
0 Votes 2 Answers 286 Views
4 months ago
0 Votes
2 Answers
347 Views
0 Votes 2 Answers 347 Views
Hello all. I'm generating an OutputModel in one task and using it as an InputModel for another task. Since there's already a timestamp on the model creation ...
6 months ago
0 Votes
7 Answers
345 Views
0 Votes 7 Answers 345 Views
6 months ago
0 Votes
7 Answers
410 Views
0 Votes 7 Answers 410 Views
7 months ago
0 Votes
2 Answers
397 Views
0 Votes 2 Answers 397 Views
7 months ago
0 Votes
5 Answers
358 Views
0 Votes 5 Answers 358 Views
6 months ago
0 Votes
4 Answers
444 Views
0 Votes 4 Answers 444 Views
7 months ago
0 Votes
3 Answers
425 Views
0 Votes 3 Answers 425 Views
I ran into something that I'd describe and an error but I want to verify this to be the case first. The error seems to be produced if I call output_model.upd...
7 months ago
0 Votes
9 Answers
469 Views
0 Votes 9 Answers 469 Views
Hello all. I'm experimenting with ClearML and I've run into a strange issue. I used Task.init on a project, it logs to the app.clear.ml but it doesn't seem t...
8 months ago
0 Votes
7 Answers
312 Views
0 Votes 7 Answers 312 Views
AWS Autoscaler question: what is best practices for providing the autoscaled instances with access to credentials for things like S3? With self-hosted agents...
4 months ago
0 Votes
5 Answers
337 Views
0 Votes 5 Answers 337 Views
Is there any way to exclude archived datasets from Dataset.list_datasets()?
4 months ago
0 Votes
17 Answers
381 Views
0 Votes 17 Answers 381 Views
Hello again, Is there any way to get a list of the datasets from ClearML that excludes archived datasets?
5 months ago
0 Votes
16 Answers
242 Views
0 Votes 16 Answers 242 Views
I'm trying to spin up a task on an agent and inside the task I have two packages that I've created custom versions of and specified a git repo for in the req...
2 months ago
0 Votes
3 Answers
467 Views
0 Votes 3 Answers 467 Views
8 months ago
0 Votes
1 Answers
437 Views
0 Votes 1 Answers 437 Views
8 months ago
0 Hello All, I’M An Ml Engineer Looking To Transition Our Company To A New Mlops System. Many Of Our Projects Are Currently Built Around Hydra And I’M Attempting To See What I Would Need To Do To Integrate Clearml Into Our Workflow. I’M Fully Aware That You

The answer is simple but also not completely obvious to someone new to the platform. So you can inject new command line args that hydra will recognize. This is what the Hydra section of args is for. However, if you enable _allow_omegaconf_edit_: True , I think ClearML will “inject” the OmegaConf saved under the configuration object of the prior run, overwriting the overrides. I’ll experiment with this behavior a bit more to be sure.

8 months ago
0 I'M Trying To Understand The Difference Between Tasks And Pipelines. I Get The Big Picture But The Thing I Struggle To Understand Is The Interplay In The Code Itself. If You Set Up A Pipeline You Wouldn'T Include A Task Init? Or Is There A Reason To Use B

Thanks for your reply @<1523701070390366208:profile|CostlyOstrich36> Is there an example where a pipeline is built from existing tasks? I'd like to experiment with it and I don' t see any examples of what you describe with my (clearly lacking) google-fu. What happens if you wrap a function with a task.init() with a pipeline decorator or is that the process you're speaking of?

7 months ago
0 Hi All, I'Ve Been Experimenting Around With Automating The Data Sync. This Is Related To This Thread:

Hi again @<1523701435869433856:profile|SmugDolphin23> ,

The approach you suggested seems to be working albeit with one issue. It does correctly identify the different versions of the dataset when new data is added, but I get an error when I try and finalize the dataset:

Code:

        if self.task:
            # get the parent dataset from the project
            parent = self.clearml_dataset = Dataset.get(
                dataset_name="[LTV] Dataset",
                dataset_project=...
7 months ago
0 Hi All, I'Ve Been Experimenting Around With Automating The Data Sync. This Is Related To This Thread:

Interesting approach. I'll give that a try. Thanks for the reply!

7 months ago
0 I Ran Into Something That I'D Describe And An Error But I Want To Verify This To Be The Case First. The Error Seems To Be Produced If I Call

@<1523701070390366208:profile|CostlyOstrich36> ClearML: 1.10.1, I'm not self-hosting the server so whatever the current version is. Unless you mean the operating system?

@<1523701435869433856:profile|SmugDolphin23> Good to know.

7 months ago
0 If I Ran A Hyperparemeter Sweep And I Wanted To Create A Graph Where The X-Axis Was One Of The Hyperparameters, Let'S Say The Momentum Term Of The Optimizer, And I Wanted To Plot That Vs The Min-Loss Over All Epochs, Is There A Good Way To Do This With Cl

Hi Again Eugen,

If I use the hyperparameter tool in ClearML, won't that create a different experiment for every step of the hyperparameter-optimizer? So this will be run across experiments. I could do something with pipelines but since the metrics are already available in the ClearML hyperparameter/metric tables I thought it would make sense to be able to plot against those values.

6 months ago
0 Aws Autoscaler Question: What Is Best Practices For Providing The Autoscaled Instances With Access To Credentials For Things Like S3? With Self-Hosted Agents I Can Add The Credentials To The Clearml Config As Part Of The Environment Variables.

I figured as much. This is basically what I was planning to do otherwise. I have questions around that.

  • It appears that the 'extra' config is displayed in plain text on the web app and downloadable in json. I was just curious if this is best practices.
  • I noticed in the AWS instance that's spun up when starting the autoscaler there's 3 settings in the config: use_credentials_chain: false, use_iam_instance_profile: false, use_owner_token: False are these strictly for the credentials t...
4 months ago
0 I'M A Bit Confused. It Seems Like Something Has Changed With How Clearml Handles Recording Datasets In Tasks. It Used To Be The Case That When I Would Create A Dataset Under A Task, Clearml Would Record The Id Of The Dataset In The Hyperparameters/Datase

Yes, it indeed appears to be a regex issue. If I run:

Dataset.list_datasets(
                dataset_project=self.task.get_project_name(),
                partial_name=re.escape('[LTV] Dataset Test'),
                only_completed=True,
            )

It works as expected. I'm not sure how raw you want to leave the partial_name features. I could create a PR to fix this but would you want me to re.escape at the list_datasets() level? Or go deeper and do it at `Task._query_task...

4 months ago
4 months ago
0 I'M A Bit Confused. It Seems Like Something Has Changed With How Clearml Handles Recording Datasets In Tasks. It Used To Be The Case That When I Would Create A Dataset Under A Task, Clearml Would Record The Id Of The Dataset In The Hyperparameters/Datase

The plot thickens. It seems like there's something odd going on with the interaction between [LTV] and additional text. If I just search [LTV] it works, if I just search Dataset Test it works, but if I put them together it breaks the search. Now that I think about it, there's other oddities that seem to happen in the web interface that might be explained by some bugs around using brackets in names.

4 months ago
0 Hey There, I Am A New User Of Clearml And Really Enjoying It So Far! I Noticed That My Model Checkpoints Are Saved After Each Epoch. Instead I Would Like To Only Save The Best And Last Model Checkpoint. Is That Possible? I Could Not Find Something Regardi

Depending on the framework you're using it'll just hook into the save model operation. Every time you save a model, which will probably happen every epoch for some subset of the training. If you want to do it with the existing framework you could change the checkpoint so that it only clones the best model in memory and saves the write operation for last. The risk with this is if the training crashes, you'll lose your best model.

Optionally, you could also disable the ClearML integration with...

8 months ago
0 I'M A Bit Confused. It Seems Like Something Has Changed With How Clearml Handles Recording Datasets In Tasks. It Used To Be The Case That When I Would Create A Dataset Under A Task, Clearml Would Record The Id Of The Dataset In The Hyperparameters/Datase

I see. Thanks for the insight. That seems to be the case. I'm struggling a bit with datasets. For example, if I wanted to trace the genealogy of a dataset that's used by traditional tasks and pipelines. I'll try and write something up about the challenges around that when I get the chance. But your comment revealed another issue:

It appears that the partial name matching isn't going well. I'm unclear why this wouldn't be matching. In the attached photo you can see the input for `partial_nam...

4 months ago
Show more results compactanswers