CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 Hey I Hope Everyone Is Having A Good Day, Two Quick Questions About Datasets:

And additionally does the

When executing a Task (experiment) remotely, this method has no effect).

part means that if it is executed in a remote worker inside a pipeline without the dataset downloaded the method will have no effect ?

I think this means the add tags specifically will have no effect

2 years ago

0 Hi I'M Using Clearml Datasets. How Do I Tell From The Clearml Ui Which Datasets Version Am I Using?

SubstantialElk6 , do you mean the dataset task version?

4 years ago

0 After Resetting And Enqueueing A Task, The Pip Installation Procedure In A Remote Agent Tries To Install Packages Different From Packages That Were Installed In The Execution Session Before The Resetting And Enquiring Of The Task. How Can I Control That

Hi SweetHippopotamus84 🙂
What do you mean different? Entirely unrelated packages or entirely different unrelated versions? Could it be those packages are dependencies of your requirements?

Can you provide some examples/screenies?

3 years ago

0 Hi I’M Trying To Schedule The Tasks Execution Using

Can you verify in the INFO section of an individual step to what queue it is enqueued into? Can you see them in the Queues page?

12 months ago

0 Hi, Yesterday I Updated The Clearml Server, Now All My Tasks Disappeared, There Are Only The Demo Tasks On The Interface. But The Data Is Still In The /Opt/Clearml/Data Folder.

Hi, SkinnyPanda43 , from what version did you upgrade to which version?

3 years ago

0 Hi Everyone, I Hosting A Clearml Server Locally, And In The Same Computer I Want To Train Some Experiments, But I Cant, When I Try To Clearml-Init My Credentials Aren'T Valid, So The Clearml.Conf File Isnt Create, I Copy The Clearml.Conf File From Another

When the SDK runs it takes the default in ~/clearml.conf

3 years ago

0 Hi Team, I Am Running Code In Vsc And Connected To Clearml Server. It Taking Too Much Of Time To Execute,May I Know The Reason?

Hi SuperiorCockroach75 , can you please elaborate? What is taking to execute?

2 years ago

0 Hey Guys! I'M Saving My Datasets On Our Self-Hosted Clearml File-Server. However, When Deleting Them Through The Ui, It Doesn'T Delete Them On The Server. I Have To Go To

Hi SmugSnake6 , interesting point! Maybe open a Github issue to track this 🙂

2 years ago

0 Hello, I Believe You Have A Bug In

I see, thanks for reporting this! I guess it should be an easy fix. Can you please open a Github issue to follow up on this?

2 years ago

0 Is There Any Way (Or Are There Any Plans) To Include Some View For Datasets In The Webui? One That Is Detached From The Generating Task?

As far as I know Hyper-datasets also support csv/tabular data quite well 🙂

3 years ago

0 Hi! We'Re Trying To Orchestrate An Experiment Through The Clearml Ui With A Remote Agent On K8S. Our Training Job Requires A Package Only Available On Our Internal Pypi Server. How Should We Go About This Because The Job Keeps Failing With:

Hi CostlyFox64 ,

Can you try configuring your ~/clearml.conf with the following?
agent.package_manager.extra_index_url= [ "https://<USER>:<PASSWORD>@packages.<HOSTNAME>/<REPO_PATH>" ]

3 years ago

0 I'M Trying To Use Store Some Data In Clearml-Data. Then I Want To Get It Back Elsewhere Using Dataset.Get_Local_Copy. It Returns A Directory But I Don'T Know How To Actually Access And Use That Data, And Remove It When It'S Done. Help Would Be Appreciated

VexedCat68 Hi 🙂

Can you please provide snippets of how you're saving and retrieving the files?

3 years ago

0 Hi, I Have An Artifact Which Is A Path To The Outputs Of The Model That Was Trained And Its Used In Another Task Later On But As A String, But When I Use Upload Artifact It Uploads The Whole Folder And Not Just As A String, Is There Are Way To Just Upload

That's the controller. I would guess if you fetch the controller you can get it's id as well

2 years ago

0 Hi Folks, I Have A Question Related To The Storage Of Artifacts, As It Is Not Entirely Clear To Me Where To Configure It. If I Read The Documentation

SarcasticSquirrel56 , you're right. I think you can use the following setting in ~/clearml.conf : sdk.development.default_output_uri: <S3_BUCKET> . Tell me if that works

3 years ago

0 How Do You Get Clearml Gpu Compute To Show Up Under Applications Or Autoscalers?

Hi @<1719524641879363584:profile|ThankfulClams64> , what do you mean regarding ClearML GPU Compute? Do you mean the Genesis autoscaler?

11 months ago

0 Hello! Is It Possible To 'Send' / Compose Specific Reports Automatically From Tasks To The Designated Report Under The Reports Page In The Ui? I'Ve Looked Into

Hi @<1544853721739956224:profile|QuizzicalFox36> , currently there is no SDK option for this, however you can automate this using the API. I suggest opening developer tools (F12) to see what the UI sends when creating/editing reports and that way you can automate it

2 years ago

0 Sometimes I Notice That At The End Of An Experiment Clearml Keeps Hanging (Something With Repository Detection?) And The Script Does Not End. Do More People See This? Especially In Our Continuous Integration Pipeline This Give Problems Because Tests Are G

EcstaticGoat95 , thanks a lot! Will take a look 🙂

3 years ago

0 Hello, Tldr, Delete Metrics, Plots And Debug Samples From A Previous Task More Details: I Have A Task I Ran That Trained A Model And Then Tested It. The Test Results Were Reported By The Logger In Metrics, Plots And Debug Samples. I Wrote Code That Gets

Hi @<1541592227107573760:profile|EnchantingHippopotamus83> , to "clean" a task, you need to reset it. Resetting a task will purge all outputs

2 years ago

0 Hi, I Am Trying To Use Omegaconf With Task.Connect_Configuration And I Get The Following Error:

Can you try with Task.connect() ?
https://clear.ml/docs/latest/docs/references/sdk/task#connect

3 years ago

0 Hi Im Trying To Use Logger.Report_Media And It Seems Like We Need To Rescale Video To 1280X1024 For Example. Otherwise I Cant Watch Full Video In Clearmlui From Scratch. Maybe Add Into Report Media Something Like Video Resizing Before Reporting?

Hi @<1523701457835003904:profile|AbruptHedgehog21> , what happens if you use a different size?

2 years ago

0 Hi There I'M Trying Out Clearml. I Saw Mention That Clearml Can Capture Tensorboard Output So I Tried It With This Little Script (Image Below). The Events File Is Filled, The Clearml Task Is Created, And Marked Complete However There Is Nothing In The Sc

Hi PanickyMoth78 ,

What version of ClearML are you using?

3 years ago

0 Hi, What Would Be The Recommended Way To Add/Track Arbitrary Models To/With Outputmodels? Currently Hacking It By Using Joblib Dump And Subsequently Deleting Unwanted "Local" Files. Arbitrary In This Case Just Extensions To Some Scikitlearn Classes.

Hi SlimyDove85 ,

Regarding the easiest method to track models - you can try tagging them.
Can you please elaborate on your use case?

3 years ago

0 Hello Everyone! How Can I Conveniently Pass A Large Number Of Parameters To The Pipeline In Order To Re-Run It Through Ui?

Hi @<1578555761724755968:profile|GrievingKoala83> , you can do it directly through the UI by adding parameters, see examples here - None

2 years ago

0 Hi, I Want To Upgrade Clearml Server From 1.1 To 1.2 (Self Hosted). I Have The Following Setup:

Yes you could do that just make sure you have backups on everything and no data is lost 🙂

3 years ago

0 Hi There, I Am Working On An Audio Analysis Project And I Am Interested In Using Clearml To Manage Our Data Versions And Models. However, I Have Some Questions About Dataset Versioning And Reproducibility That I Hope You Can Help Me With. Specifically, I

Hi @<1523713932588486656:profile|PerplexedWalrus3> , I'm not sure about the exact configuration of your setup but I'm quite sure you could do this fairly easily with pipelines and datasets in ClearML. Have you tried playing with Datasets to get the feeling of how it works?

2 years ago

0 Hello, I Was Wondering About The Billing Options For The Clearml Pro Plan. Could You Let Me Know If There Are Options For Monthly Or Yearly Payments?

Not in the Pro, no

10 months ago

0 Hi All! I'Ve Found This From Clearml-Agent Docs. I'M A Little Confused With Content. Could Anyone Explain This Line

Hi @<1664079296102141952:profile|DangerousStarfish38> , it means that it's not supported out of the box and might require more tinkering, but I've managed to run agent with docker mode on a windows machine previously 🙂

one year ago

0 Hi! If There Are Several Tasks Running Concurrently, Which Task Should

GiganticTurtle0 , then I'd guess that's the task that would be returned 🙂

Did you try?

3 years ago

0 What Determines The Value Of User? (See Screenshot) Right Now All My Teammates' Experiments Show Up Under My Own User Name. Thanks

You can edit the mongodb manually (strongly suggest against) to change users of experiments. Besides that, I'm afraid not. Each user would have to create separate credentials for themselves under their own user in the system.

A suggestion I might have is using the 'Description' field to write down the relevant user manually and adding that as a column in your view. The small cogwheel near the top right (next to the refresh button) will give you the option to add that column.

Hope this helps...

3 years ago

0 Can "Clearml-Task" Not Try To Download Data From "Github? I Specified --Folder And --Script, But It Automatically Detects Git Credentials And Tries To Pull The Code, Although I Clearly Want To Run The Script From The Local Machine On The Agent

Hi @<1742355077231808512:profile|DisturbedLizard6> , you can open a GitHub feature request for this to be added 🙂

one year ago

Show more results