EnthusiasticCow4

34 Questions, 130 Answers

Active since 11 March 2023

Last activity 10 months ago

Reputation

Badges 1

108 × Eureka!

Questions 34
Answers 130

0 Votes

2 Answers

2K Views

0 Votes 2 Answers 2K Views

Good Day All. I'M Working With The Pipelinecontroller For Creating Pipelines From Tasks. One Thing I'Ve Noticed Is That If I Do Pipe.Start_Locally() It Does Run The Pipeline But It Still Seems To Enqueue The Tasks And Runs Them On The Remote Agents. Am I

Good day all. I'm working with the PipelineController for creating pipelines from tasks. One thing I've noticed is that if I do pipe.start_locally() it does ...

clearml

2 years ago

0 Votes

0 Answers

1K Views

0 Votes 0 Answers 1K Views

Has Anyone Tried Using Clearml Reports With Grammarly? I Recently Decided To Try The Reports Feature In Clearml. I'M Using Chrome Version 121.0.6167.160 (Official Build) (Arm64), Macos 14.3.1 (23D60), With Grammarly Chrome Extension, The Clearml Webapp: 3

Has anyone tried using ClearML reports with Grammarly? I recently decided to try the reports feature in ClearML. I'm using Chrome Version 121.0.6167.160 (Off...

clearml

one year ago

0 Votes

1 Answers

2K Views

0 Votes 1 Answers 2K Views

For Model Monitoring, Is There A Good Feature In Clearml? If Not Is There A Go-To Tool That Works Well With This Framework?

For model monitoring, is there a good feature in ClearML? If not is there a go-to tool that works well with this framework?

clearml

2 years ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Why Is One Of The Ghosts From Packman In The Corner Of My Workspace Folders?

Why is one of the ghosts from Packman in the corner of my workspace folders? 👻

clearml

one year ago

0 Votes

14 Answers

2K Views

0 Votes 14 Answers 2K Views

I'M Running Into A Perplexing Issue. I Have Several Agents Running On A Workstation, I Also Am Directly Running Code From The Same Workstation. There Are Several Projects On The Workstation But One Of The Projects Is Struggling With Authentication To Git

I'm running into a perplexing issue. I have several agents running on a workstation, I also am directly running code from the same workstation. There are sev...

mlops

one year ago

0 Votes

1 Answers

2K Views

0 Votes 1 Answers 2K Views

Hello All, I Wanted To Get The Advice Of The People Here About Data Versioning And Tracking Using Clearml. Many Of The Dataset We Work With Are Generated By Sql Query. It’S Not Necessary To Generate Them Every Time But I’M Trying To Get Advice On How To

Hello all, I wanted to get the advice of the people here about data versioning and tracking using ClearML. Many of the dataset we work with are generated by ...

clearml

2 years ago

0 Votes

1 Answers

2K Views

0 Votes 1 Answers 2K Views

Hello All. I'M Trying To Figure Out How To Get The Task From Pipelines Listed Under The Experiments Tab Or At Least In A Place That'S Easier To Find. I'M Running A Pipeline Based On Tasks And If I Look At The

Hello all. I'm trying to figure out how to get the task from pipelines listed under the experiments tab or at least in a place that's easier to find. I'm run...

clearml

2 years ago

0 Votes

5 Answers

2K Views

0 Votes 5 Answers 2K Views

On The Clearml Web Interface You Obviously Need To Provide The Aws Credentials To Do Things Like Download Artifacts And Data Stored On Aws. One Thing I'M Curious About Is If You Do Provide The Credentials, When You Do Things Like Delete A Dataset Or Task,

On the ClearML web interface you obviously need to provide the AWS credentials to do things like download artifacts and data stored on AWS. One thing I'm cur...

clearml

2 years ago

0 Votes

12 Answers

2K Views

0 Votes 12 Answers 2K Views

Hello All, I Want To Clarify Something. In The

Hello all, I want to clarify something. In the ClearML Task Scheduler .add_tast() method there's a parameter for schedule_function . I think I had some assum...

clearml

one year ago

0 Votes

3 Answers

2K Views

0 Votes 3 Answers 2K Views

Hello All, I’M An Ml Engineer Looking To Transition Our Company To A New Mlops System. Many Of Our Projects Are Currently Built Around Hydra And I’M Attempting To See What I Would Need To Do To Integrate Clearml Into Our Workflow. I’M Fully Aware That You

Hello all, I’m an ML engineer looking to transition our company to a new MLops system. Many of our projects are currently built around Hydra and I’m attempti...

clearml

2 years ago

0 Votes

7 Answers

2K Views

0 Votes 7 Answers 2K Views

In My Current Project I Generate The Data From An Sql Query. Is The Only Way To Register The Dataset With Clearml To Write The Files To Disk First Or Is There Another Method? This Leads Into The Second Issue I Have, Which Is What Happens When I Store The

In my current project I generate the data from an SQL query. Is the only way to register the dataset with ClearML to write the files to disk first or is ther...

clearml

2 years ago

0 Votes

17 Answers

2K Views

0 Votes 17 Answers 2K Views

Hello Again, Is There Any Way To Get A List Of The Datasets From Clearml That Excludes Archived Datasets?

Hello again, Is there any way to get a list of the datasets from ClearML that excludes archived datasets?

clearml

2 years ago

0 Votes

2 Answers

2K Views

0 Votes 2 Answers 2K Views

Hi All, I'M Generating Pipelines From Tasks And There'S A Step That Requires Providing Outputs From The Parent Task To The Child, But I'D Like To Pass It As A Single List Of Values. I Was Planning To Use Parameter_Override To Pass A List Of Values, Each

Hi all, I'm generating pipelines from tasks and there's a step that requires providing outputs from the parent task to the child, but I'd like to pass it as ...

clearml

2 years ago

0 Votes

7 Answers

3K Views

0 Votes 7 Answers 3K Views

Question About Clearml Models And Metadata. I'M Using The Web Interface For Clearml. I Create An Trained An Output_Model That Was Stored In Clearml From A Training Process And On The Web App I Manually Added Some Metadata To The Model. In A Separate Task

Question about ClearML models and metadata. I'm using the web interface for ClearML. I create an trained an output_model that was stored in ClearML from a tr...

clearml

2 years ago

0 Votes

4 Answers

2K Views

0 Votes 4 Answers 2K Views

I'M Trying To Understand The Difference Between Tasks And Pipelines. I Get The Big Picture But The Thing I Struggle To Understand Is The Interplay In The Code Itself. If You Set Up A Pipeline You Wouldn'T Include A Task Init? Or Is There A Reason To Use B

I'm trying to understand the difference between tasks and pipelines. I get the big picture but the thing I struggle to understand is the interplay in the cod...

clearml

2 years ago

0 Votes

6 Answers

2K Views

0 Votes 6 Answers 2K Views

Hi All, Details: Both Projects Are Using Clearml V1.14.2Rc0 (But I'Ve Tested It With Other Versions). I'M Using The Web-App, So We'Re Not Hosting Our Own Cleaml-Server We Do Have A Server With Several Cleaml-Agents V1.7.0 I'M Running Into A Seemingly Co

Hi All, Details: Both projects are using clearml v1.14.2rc0 (but I've tested it with other versions). I'm using the web-app, so we're not hosting our own cle...

pytorch

one year ago

0 Votes

29 Answers

2K Views

0 Votes 29 Answers 2K Views

Hope Everyone'S Having A Nice Holiday Period. I'Ve Been Debating Between Cron And The Clearml Taskscheduler Cron Is The Solution I'M Currently Using But I Wanted To Understand The Advantages To Using The Taskscheduler. Right Now I'M Using The Classic Cro

Hope everyone's having a nice holiday period. I've been debating between cron and the ClearML TaskScheduler Cron is the solution I'm currently using but I wa...

clearml

one year ago

0 Votes

6 Answers

2K Views

0 Votes 6 Answers 2K Views

Hi All, I'Ve Been Experimenting Around With Automating The Data Sync. This Is Related To This Thread:

Hi all, I've been experimenting around with automating the data sync. This is related to this thread: None Here is my expectation, so correct me if I'm wrong...

clearml

2 years ago

0 Votes

2 Answers

2K Views

0 Votes 2 Answers 2K Views

Hello All. I'M Generating An Outputmodel In One Task And Using It As An Inputmodel For Another Task. Since There'S Already A Timestamp On The Model Creation Date, Is There A Way To Get The Date From The Inputmodel?

Hello all. I'm generating an OutputModel in one task and using it as an InputModel for another task. Since there's already a timestamp on the model creation ...

clearml

2 years ago

0 Votes

1 Answers

2K Views

0 Votes 1 Answers 2K Views

If You'Re Paying For The Premium Features Would Those Be Available To A Self Hosted Server Or Only On The Web Client?

If you're paying for the premium features would those be available to a self hosted server or only on the web client?

clearml

2 years ago

0 Votes

5 Answers

2K Views

0 Votes 5 Answers 2K Views

Hello All, I'M Trying To Queue A Task In Python But I'D Like To Reuse The Prior Task Id. In The Webapp You Can

Hello all, I'm trying to queue a task in python but I'd like to reuse the prior task ID. In the webapp you can Reset and Enqueue a task and it'll reuse the t...

clearml

one year ago

0 Votes

6 Answers

2K Views

0 Votes 6 Answers 2K Views

I'Ve Noticed A Change From Clearml

I've noticed a change from ClearML 1.13.1 to 1.13.2 relating to the Hydra integration. I'm not yet convinced it's a bug but it could be but it also might jus...

clearml

one year ago

0 Votes

6 Answers

2K Views

0 Votes 6 Answers 2K Views

I Have An Interesting Issue. It Seems Like When I Run Several Agents On The Same Server I Run Into An Issue Where Some Of The Agents Will Timeout When Connecting To Github. Each Task In The Pipeline Is Pulling From The Same Repo And It'S Working For Some

I have an interesting issue. It seems like when I run several agents on the same server I run into an issue where some of the agents will timeout when connec...

clearml

one year ago

0 Votes

5 Answers

2K Views

0 Votes 5 Answers 2K Views

If I Ran A Hyperparemeter Sweep And I Wanted To Create A Graph Where The X-Axis Was One Of The Hyperparameters, Let'S Say The Momentum Term Of The Optimizer, And I Wanted To Plot That Vs The Min-Loss Over All Epochs, Is There A Good Way To Do This With Cl

If I ran a hyperparemeter sweep and I wanted to create a graph where the x-axis was one of the hyperparameters, let's say the momentum term of the optimizer,...

clearml

2 years ago

0 Votes

19 Answers

776 Views

0 Votes 19 Answers 776 Views

Hi All

Hi all 😄 The hyperparameter tuner functionality has just stopped working. When I try and launch an instance of the tuner it gets stuck at "This instance has...

clearml

10 months ago

0 Votes

9 Answers

2K Views

0 Votes 9 Answers 2K Views

Hello All. I'M Experimenting With Clearml And I'Ve Run Into A Strange Issue. I Used

Hello all. I'm experimenting with ClearML and I've run into a strange issue. I used Task.init on a project, it logs to the app.clear.ml but it doesn't seem t...

clearml

2 years ago

0 Votes

0 Answers

2K Views

0 Votes 0 Answers 2K Views

Currently, Things Run In A Pipeline Are Automatically Moved To A

Currently, things run in a pipeline are automatically moved to a /.pipelines/ subproject. Is there a way to allow the tasks done via pipelines to show up as ...

clearml

2 years ago

0 Votes

7 Answers

2K Views

0 Votes 7 Answers 2K Views

Aws Autoscaler Question: What Is Best Practices For Providing The Autoscaled Instances With Access To Credentials For Things Like S3? With Self-Hosted Agents I Can Add The Credentials To The Clearml Config As Part Of The Environment Variables.

AWS Autoscaler question: what is best practices for providing the autoscaled instances with access to credentials for things like S3? With self-hosted agents...

clearml

2 years ago

0 Votes

3 Answers

2K Views

0 Votes 3 Answers 2K Views

I Ran Into Something That I'D Describe And An Error But I Want To Verify This To Be The Case First. The Error Seems To Be Produced If I Call

I ran into something that I'd describe and an error but I want to verify this to be the case first. The error seems to be produced if I call output_model.upd...

clearml

2 years ago

0 Votes

5 Answers

2K Views

0 Votes 5 Answers 2K Views

Is There Any Way To Exclude Archived Datasets From Dataset.List_Datasets()?

Is there any way to exclude archived datasets from Dataset.list_datasets()?

clearml

2 years ago

Show more results

0 Hi Everyone! I Cannot Create A Dataset. Is This A Limitation Of The Free Version? Error: Datasets Are Not Supported With Your Current Clearml Server Version. Please Update Your Server.

What version of ClearML server are you using?

2 years ago

0 Hello All, I Want To Clarify Something. In The

Should I post this in dev?

one year ago

0 Hi All

I just checked the clearml.conf and I'm not specifying any version of python for the agents.

10 months ago

0 Is There Any Way To Exclude Archived Datasets From Dataset.List_Datasets()?

I think the PR is a good idea. I read the contribution guidelines. It talks about referencing an issue. Did you want me to duplicate this issue on the repo or is it enough to link to this thread?

2 years ago

0 Hey There, I Am A New User Of Clearml And Really Enjoying It So Far! I Noticed That My Model Checkpoints Are Saved After Each Epoch. Instead I Would Like To Only Save The Best And Last Model Checkpoint. Is That Possible? I Could Not Find Something Regardi

Yeah, it's because it's just hooking into the save operation and capturing the output, regardless of the parent call.

2 years ago

Depending on the framework you're using it'll just hook into the save model operation. Every time you save a model, which will probably happen every epoch for some subset of the training. If you want to do it with the existing framework you could change the checkpoint so that it only clones the best model in memory and saves the write operation for last. The risk with this is if the training crashes, you'll lose your best model.

Optionally, you could also disable the ClearML integration with...

2 years ago

0 Hope Everyone'S Having A Nice Holiday Period. I'Ve Been Debating Between Cron And The Clearml Taskscheduler Cron Is The Solution I'M Currently Using But I Wanted To Understand The Advantages To Using The Taskscheduler. Right Now I'M Using The Classic Cro

@<1523701205467926528:profile|AgitatedDove14> Then it isn't working at intended. To test it I started the scheduler and set a simple dead man snitch process to run once a day. In the web-app (on your site app.cleearml.ml), when looking at the scheduler process in the DevOps section, I was able to see a configuration file under artifacts but it was not as all obvious how you'd change that because it wasn't part of the configuration section, it was just an artifact. So I thought maybe it was b...

one year ago

0 In My Current Project I Generate The Data From An Sql Query. Is The Only Way To Register The Dataset With Clearml To Write The Files To Disk First Or Is There Another Method? This Leads Into The Second Issue I Have, Which Is What Happens When I Store The

Thanks for the reply @<1523701070390366208:profile|CostlyOstrich36> !

It says in the documentation that:
Add a folder into the current dataset. calculate file hash, and compare against parent, mark files to be uploaded

It seems to recognize the dataset as another version of the data but doesn't seem to be validating the hashes on a per file basis. Also, if you look at the photo, it seems like some of the data does get recognized as the same as the prior data. It seems like it's the correct...

2 years ago

0 If I Ran A Hyperparemeter Sweep And I Wanted To Create A Graph Where The X-Axis Was One Of The Hyperparameters, Let'S Say The Momentum Term Of The Optimizer, And I Wanted To Plot That Vs The Min-Loss Over All Epochs, Is There A Good Way To Do This With Cl

Hi Again Eugen,

If I use the hyperparameter tool in ClearML, won't that create a different experiment for every step of the hyperparameter-optimizer? So this will be run across experiments. I could do something with pipelines but since the metrics are already available in the ClearML hyperparameter/metric tables I thought it would make sense to be able to plot against those values.

2 years ago

0 Good Day All. I'M Working With The Pipelinecontroller For Creating Pipelines From Tasks. One Thing I'Ve Noticed Is That If I Do Pipe.Start_Locally() It Does Run The Pipeline But It Still Seems To Enqueue The Tasks And Runs Them On The Remote Agents. Am I

Ah, perfect.

2 years ago

Show more results