Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
EnthusiasticCow4
Moderator
34 Questions, 130 Answers
  Active since 11 March 2023
  Last activity 6 months ago

Reputation

0

Badges 1

108 × Eureka!
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Hello all, I'm trying to queue a task in python but I'd like to reuse the prior task ID. In the webapp you can Reset and Enqueue a task and it'll reuse the t...
one year ago
0 Votes
19 Answers
467 Views
0 Votes 19 Answers 467 Views
Hi all 😄 The hyperparameter tuner functionality has just stopped working. When I try and launch an instance of the tuner it gets stuck at "This instance has...
6 months ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
I found an interesting error. If I run the following: # Load the model from remote storage if model_url is provided if cfg.clearml.get("model_url", None): # ...
2 years ago
0 Votes
9 Answers
2K Views
0 Votes 9 Answers 2K Views
Hello all. I'm experimenting with ClearML and I've run into a strange issue. I used Task.init on a project, it logs to the app.clear.ml but it doesn't seem t...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
one year ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
Is there any way to exclude archived datasets from Dataset.list_datasets()?
2 years ago
0 Votes
29 Answers
1K Views
0 Votes 29 Answers 1K Views
one year ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
I ran into something that I'd describe and an error but I want to verify this to be the case first. The error seems to be produced if I call output_model.upd...
2 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
2 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
2 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
AWS Autoscaler question: what is best practices for providing the autoscaled instances with access to credentials for things like S3? With self-hosted agents...
one year ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
2 years ago
0 Votes
17 Answers
2K Views
0 Votes 17 Answers 2K Views
Hello again, Is there any way to get a list of the datasets from ClearML that excludes archived datasets?
2 years ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
2 years ago
0 Votes
14 Answers
1K Views
0 Votes 14 Answers 1K Views
one year ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
Hello all. I'm trying to figure out how to get the task from pipelines listed under the experiments tab or at least in a place that's easier to find. I'm run...
2 years ago
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
2 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
one year ago
0 Votes
2 Answers
950 Views
0 Votes 2 Answers 950 Views
Why is one of the ghosts from Packman in the corner of my workspace folders? 👻
one year ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
For model monitoring, is there a good feature in ClearML? If not is there a go-to tool that works well with this framework?
2 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
2 years ago
0 Votes
1 Answers
2K Views
0 Votes 1 Answers 2K Views
If you're paying for the premium features would those be available to a self hosted server or only on the web client?
2 years ago
0 Votes
3 Answers
759 Views
0 Votes 3 Answers 759 Views
8 months ago
0 Votes
12 Answers
1K Views
0 Votes 12 Answers 1K Views
Hello all, I want to clarify something. In the ClearML Task Scheduler .add_tast() method there's a parameter for schedule_function . I think I had some assum...
one year ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
one year ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
2 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Currently, things run in a pipeline are automatically moved to a /.pipelines/ subproject. Is there a way to allow the tasks done via pipelines to show up as ...
2 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
one year ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Hello all. I'm generating an OutputModel in one task and using it as an InputModel for another task. Since there's already a timestamp on the model creation ...
2 years ago
Show more results questions
0 Hope Everyone'S Having A Nice Holiday Period. I'Ve Been Debating Between Cron And The Clearml Taskscheduler Cron Is The Solution I'M Currently Using But I Wanted To Understand The Advantages To Using The Taskscheduler. Right Now I'M Using The Classic Cro

Strange, the code seems to work perfectly when I run it locally. To make it more confusing, the queue that I enqueue it to when I run it remotely is using agents from the same server that I'm running it locally from.

one year ago
0 Hello All, I Want To Clarify Something. In The

I figured you'd say that so I went ahead with that PR. I got it working but I'm going to test it a bit further.

one year ago
0 Hello All, I Want To Clarify Something. In The

Should I post this in dev?

one year ago
0 Hope Everyone'S Having A Nice Holiday Period. I'Ve Been Debating Between Cron And The Clearml Taskscheduler Cron Is The Solution I'M Currently Using But I Wanted To Understand The Advantages To Using The Taskscheduler. Right Now I'M Using The Classic Cro

Alright, I fixed the issue with the scheduler eating itself. But now I'm still getting the same bug as two days ago. So the Scheduler process starts fine and doesn't "crash." But I don't get the config object in the web-app again. It seems to work if I run it locally.

To answer your earlier question, I'm using the app.clear.ml portal so

  • WebApp: 3.20.1-1525
  • Server: 3.20.1-1299
  • API: 2.28
  • And my Python ClearML version: 1.14
one year ago
0 Hope Everyone'S Having A Nice Holiday Period. I'Ve Been Debating Between Cron And The Clearml Taskscheduler Cron Is The Solution I'M Currently Using But I Wanted To Understand The Advantages To Using The Taskscheduler. Right Now I'M Using The Classic Cro

Hi @<1523701205467926528:profile|AgitatedDove14> . I think I'm misunderstanding something here. I have the scheduler service running. Now that it's running how does one add a new task or remove an existing task from the scheduler? I get that I can add them before starting the scheduler service but once the service is running is there any way to connect to it and change the schedule?

I thought the advantage of this service would be we could schedule tasks just by connecting to the existing t...

one year ago
0 Hi All, I'Ve Been Experimenting Around With Automating The Data Sync. This Is Related To This Thread:

Interesting approach. I'll give that a try. Thanks for the reply!

2 years ago
0 Aws Autoscaler Question: What Is Best Practices For Providing The Autoscaled Instances With Access To Credentials For Things Like S3? With Self-Hosted Agents I Can Add The Credentials To The Clearml Config As Part Of The Environment Variables.

I figured as much. This is basically what I was planning to do otherwise. I have questions around that.

  • It appears that the 'extra' config is displayed in plain text on the web app and downloadable in json. I was just curious if this is best practices.
  • I noticed in the AWS instance that's spun up when starting the autoscaler there's 3 settings in the config: use_credentials_chain: false, use_iam_instance_profile: false, use_owner_token: False are these strictly for the credentials t...
one year ago
0 I'M Trying To Understand The Difference Between Tasks And Pipelines. I Get The Big Picture But The Thing I Struggle To Understand Is The Interplay In The Code Itself. If You Set Up A Pipeline You Wouldn'T Include A Task Init? Or Is There A Reason To Use B

Thanks for your reply @<1523701070390366208:profile|CostlyOstrich36> Is there an example where a pipeline is built from existing tasks? I'd like to experiment with it and I don' t see any examples of what you describe with my (clearly lacking) google-fu. What happens if you wrap a function with a task.init() with a pipeline decorator or is that the process you're speaking of?

2 years ago
0 Hello All, I’M An Ml Engineer Looking To Transition Our Company To A New Mlops System. Many Of Our Projects Are Currently Built Around Hydra And I’M Attempting To See What I Would Need To Do To Integrate Clearml Into Our Workflow. I’M Fully Aware That You

The answer is simple but also not completely obvious to someone new to the platform. So you can inject new command line args that hydra will recognize. This is what the Hydra section of args is for. However, if you enable _allow_omegaconf_edit_: True , I think ClearML will “inject” the OmegaConf saved under the configuration object of the prior run, overwriting the overrides. I’ll experiment with this behavior a bit more to be sure.

2 years ago
0 I'Ve Noticed A Change From Clearml

This does appear to resolve the issue. I'll keep you updated if I find any other issues. Thanks @<1523701435869433856:profile|SmugDolphin23>

one year ago
0 Hi All, Details: Both Projects Are Using Clearml V1.14.2Rc0 (But I'Ve Tested It With Other Versions). I'M Using The Web-App, So We'Re Not Hosting Our Own Cleaml-Server We Do Have A Server With Several Cleaml-Agents V1.7.0 I'M Running Into A Seemingly Co

I'm not sure why the logs were incomplete. I think part of the reason it wasn't pulling from the repo was that it was pulling from cache. I cleared the clearml cache for that project and reran it. This should be the full log.

one year ago
0 Hi All, I'Ve Been Experimenting Around With Automating The Data Sync. This Is Related To This Thread:

Hi again @<1523701435869433856:profile|SmugDolphin23> ,

The approach you suggested seems to be working albeit with one issue. It does correctly identify the different versions of the dataset when new data is added, but I get an error when I try and finalize the dataset:

Code:

        if self.task:
            # get the parent dataset from the project
            parent = self.clearml_dataset = Dataset.get(
                dataset_name="[LTV] Dataset",
                dataset_project=...
2 years ago
0 I Ran Into Something That I'D Describe And An Error But I Want To Verify This To Be The Case First. The Error Seems To Be Produced If I Call

@<1523701070390366208:profile|CostlyOstrich36> ClearML: 1.10.1, I'm not self-hosting the server so whatever the current version is. Unless you mean the operating system?

@<1523701435869433856:profile|SmugDolphin23> Good to know.

2 years ago
0 Hello All, I'M Trying To Queue A Task In Python But I'D Like To Reuse The Prior Task Id. In The Webapp You Can

This turns out to be a layer-8 error . task.execute_remotely does work but there was a bug in my code and I wasn't correctly setting the reuse_task flag when run. Sorry to bother the both of you with my mistake.

one year ago
0 Hope Everyone'S Having A Nice Holiday Period. I'Ve Been Debating Between Cron And The Clearml Taskscheduler Cron Is The Solution I'M Currently Using But I Wanted To Understand The Advantages To Using The Taskscheduler. Right Now I'M Using The Classic Cro

@<1523701205467926528:profile|AgitatedDove14> Then it isn't working at intended. To test it I started the scheduler and set a simple dead man snitch process to run once a day. In the web-app (on your site app.cleearml.ml), when looking at the scheduler process in the DevOps section, I was able to see a configuration file under artifacts but it was not as all obvious how you'd change that because it wasn't part of the configuration section, it was just an artifact. So I thought maybe it was b...

one year ago
0 I'M Running Into A Perplexing Issue. I Have Several Agents Running On A Workstation, I Also Am Directly Running Code From The Same Workstation. There Are Several Projects On The Workstation But One Of The Projects Is Struggling With Authentication To Git

Results:

I first tried uncommenting enable_git_ask_pass: false but it didn't resolve the issue.

I then cleared the cache in the vcs-cache folder, and that did fix the issue. This is the second time the cache seemed to have been the root cause of the problem. At some point I did move from token-based auth to ssh keys. Would this require clearing the cache for any project that was cached prior to the auth change?

one year ago
0 I'Ve Noticed A Change From Clearml

There is no issues when I run the "raw" script. Also, since it's based on tasks, the code must have run without fault for it to be pulled as a task in the pipeline.

As for when it fails, looking at the log here it looks like it's on the first task or maybe as the first task is launching. But I'd have to go back to be sure. I rolled back to 1.13.1 and that's working fine. But, if you want I can help explore this bug in detail because it would be nice to find the root of the issue. LmK what y...

one year ago
Show more results compactanswers