EnthusiasticCow4

34 Questions, 130 Answers

Active since 11 March 2023

Last activity 10 months ago

Reputation

Badges 1

108 × Eureka!

Answers 130

0 Is There Any Way To Exclude Archived Datasets From Dataset.List_Datasets()?

None ✅

2 years ago

0 Hello Again, Is There Any Way To Get A List Of The Datasets From Clearml That Excludes Archived Datasets?

I had 2 datasets on archive and 0 unarchived. When I ran the following command:

Dataset.list_datasets(dataset_project=self.task.get_project_name(), only_completed=True)

It returned two entrees for the two datasets I had on archive.

2 years ago

0 Hi

Will there be a recording posted?

2 years ago

0 Hi All, I'M Generating Pipelines From Tasks And There'S A Step That Requires Providing Outputs From The Parent Task To The Child, But I'D Like To Pass It As A Single List Of Values. I Was Planning To Use Parameter_Override To Pass A List Of Values, Each

I will add a gh issue. Is this part open source? Could I make a PR?

In the mean time I still need to implement this with the current version of ClearML. So the only way would be to have one variable per parent? Is there any smarter way to work around it?

2 years ago

0 Hello Again, Is There Any Way To Get A List Of The Datasets From Clearml That Excludes Archived Datasets?

I'm aware of that but it doesn't help this situation.

2 years ago

0 I Ran Into Something That I'D Describe And An Error But I Want To Verify This To Be The Case First. The Error Seems To Be Produced If I Call

@<1523701070390366208:profile|CostlyOstrich36> ClearML: 1.10.1, I'm not self-hosting the server so whatever the current version is. Unless you mean the operating system?

@<1523701435869433856:profile|SmugDolphin23> Good to know.

2 years ago

0 In My Current Project I Generate The Data From An Sql Query. Is The Only Way To Register The Dataset With Clearml To Write The Files To Disk First Or Is There Another Method? This Leads Into The Second Issue I Have, Which Is What Happens When I Store The

The original file sizes are the same but the compressed sizes seem to be different.

2 years ago

0 I'M Trying To Spin Up A Task On An Agent And Inside The Task I Have Two Packages That I'Ve Created Custom Versions Of And Specified A Git Repo For In The Requirements.Txt. Example With Hydra-Core And Omegaconf:

Oh, duh. I'll test that out. But I did have the agent.force_git_ssh_protocol: true

2 years ago

0 Aws Autoscaler Question: What Is Best Practices For Providing The Autoscaled Instances With Access To Credentials For Things Like S3? With Self-Hosted Agents I Can Add The Credentials To The Clearml Config As Part Of The Environment Variables.

I figured as much. This is basically what I was planning to do otherwise. I have questions around that.

It appears that the 'extra' config is displayed in plain text on the web app and downloadable in json. I was just curious if this is best practices.
I noticed in the AWS instance that's spun up when starting the autoscaler there's 3 settings in the config: use_credentials_chain: false, use_iam_instance_profile: false, use_owner_token: False are these strictly for the credentials t...

2 years ago

0 Hi All, I'Ve Been Experimenting Around With Automating The Data Sync. This Is Related To This Thread:

Interesting approach. I'll give that a try. Thanks for the reply!

2 years ago

Show more results