CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

0 Hi All! What'S The Best Way To Send My (Automatically Tracked Pytorch) Models To The Clearml Server? My Models Are Curently Saved With

Hi @<1556450111259676672:profile|PlainSeaurchin97> , I think what you're looking for is the output_uri parameter in Task.init()

2 years ago

0 Hi Friends

My guess is that it wasn't run yet (drafts for example)

3 years ago

0 Hi, I Am Using Clearml Own Hosted Server On Aws Ec2. When I Am Creating A Task I Am Getting This Error "Retrying (Retry(Total=239, Connect=239, Read=240, Redirect=240, Status=240)) After Connection Broken By 'Connecttimeouterror(<Urllib3.Connection.Httpco

@<1624579015031394304:profile|JitterySeal56> , is it possible there are connectivity issues between the client and the server? Do you see anything in the logs of the apiserver?

2 years ago

0 Hi, How Is The Priority Of The Configuration Like? Which One Takes Precedence? For Example, Output_Uri

HI SubstantialElk6 ,

If I'm not mistaken the order is as goes:
output_uri (Both code and CLI) Configurations vault default_output_uri in clearml.conf

3 years ago

0 Hi. Is There A Way To Transfer Clearml Workspace Ownership To Another Team Member?

Happy to help 🙂

Note that you will get almost all information about the task using tasks.get_by_id , then you would need a few more calls to extract the console/scalars/plots/debugs

9 months ago

0 Hi, I Was Wondering If There Is A Proper Way To Integrate My Model Config File (Json) Into The Workflow Using The Ui. I'Ve Managed To Connect It As A Configuration Object But It Would Be Preferable If I Could Load It Into A Table Like The Other Params (In

Hi, how do you connect your configs currently?

You mean you'd like to be able to connect/create configuration objects via UI?

3 years ago

0 Hi, Question About Setting Output_Uri=True For A Pipeline Step Using Decorators. What I’M Seeing Is That Training Results In No Output Destination Specified, And Logs To Local Disk (When Run Remotely In Docker Container), Where Is The Proper Place To Set

Hi ExuberantParrot61 , that's a good question. This is a bit hacky but what if you try to catch the task with Task.current_task() from inside the step and try to change the output_uri attribute there?

3 years ago

0 Hi Everyone! I Have A Question Regarding Running A Script Inside Docker Container With Clearml: I Build An Image Containing All Requirements To Run Some Python Script That Is Getting Arguments Via Argparse. When I Build A Wrapper Script That Will Run This

@<1539417873305309184:profile|DangerousMole43> , I think you're trying to do with the agent something that it wasn't intended to. As @<1523701087100473344:profile|SuccessfulKoala55> mentioned the agent does not support running custom entry points. The idea is to clone tasks in the system and enqueue them where the agent is capable of creating the required environment and running the code through cloning the repo

2 years ago

0 Is There An Example Of Simple Pipeline Using Task Scheduler? I Want To Create A Simple Pipeline Where First A Folder Is Monitored Using A Taskscheduler, And Under Certain Conditions, Data Is Uploaded And Dataset Id Is Given To The Next Step In The Pipeli

I think the pipeline runs from start to end, starting when the first step starts

3 years ago

I would suggest structuring everything around the Task object. After you clone and enqueue the agent can handle all the required packages / environment. You can even set environment variables so it won't try to create a new env but use the existing one in the docker container.

2 years ago

0 Hi All, What Options Do I Have For Setting Up Autoscaling Queues On Azure? Anything Else Other Than Kubernetes? And If Going The Kubernetes Route Is Enterprise Needed Or Would The Pro Package Be Enough? Would Scaling To 0 Be Possible? Also, Any Way To Ea

The functionality is basically the same as the GCP/AWS ones but since it is only in the Scale/Enterprise I don't think there is any documentation externally

one year ago

0 Hi, I Am Trying To Pull Api Data From /Tasks.Get_All Endpoint

DrabCockroach54 , you can set it all up. I suggest you open developer tools (F12) and see how it is done in the UI. You can then implement this in code.

For example to filter tasks that started 10 minutes ago is something you can view via the UI

3 years ago

0 Hi Another Issue Regarding Dataset

Hi OutrageousSheep60 , can you elaborate on how/when this happens?

whenever

preview

ing the dataset (which is in a parquet tabular format) the browser automatically downloads a copy of the preview file as a text file

3 years ago

0 Hi, I Recently Updated Clearml-Server To 1.7 And I Am Getting A Lot Of The Following Errors Since Today On Any Experiment (I Didn'T Had This Error Before):

If Elastic isn't crashing then it should be good. Once I get a confirmation I'll update you 🙂

3 years ago

0 Has Anyone Found A Workaround For The Bug?

BitterLeopard33 , ReassuredTiger98 , my bad. I just dug a bit in slack history, I think I got the issue mixed up with long file names 😞

Regarding http/chunking issue/solution - I can't find anything either. Maybe open a github issue / github feature request (for chunking files)

3 years ago

0 Hello Everyone, While Calling Get_Local_Copy Of The Dataset From The Fileserver, I Get The Path To The Local Copy, But The Files Are Not Downloaded And The Folder Is Empty. Tell Me What Could Be The Problem. I Don'T Get Any Additional Errors Or Warnings.

Hi @<1524560082761682944:profile|MammothParrot39> , did you make sure to finalize the dataset you're trying to access?

2 years ago

0 Hey, I Just Try To Switch From Public Mongo To Private And Notice, We Need Database With Name

What do you mean by public to private mongo? @<1734020208089108480:profile|WickedHare16>

one year ago

0 Hi Clearmlers, I'M Trying To Create A Dataset With Tagged Batches Of Data. I Firstly Create An Empty Dataset With Dataset_Name = 'Name_Dataset', And Then Create A Another Tagged Dataset With The First Batch And With Parent_Datasets=['Name_Dataset']. It'S

Please add it as a code snippet.

one year ago

0 Gcp Autoscaler Limits Not Working Correctly?

Hi @<1529271085315395584:profile|AmusedCat74> , thanks for reporting this, I'll ask the ClearML team to look into this

one year ago

0 Hi All, My Name Is Evgeny From Corsound. I Have A Question. I Have A Dataset With Audio Files, In The Preview Bar I Can Select A File And Play It Inside An Iframe As It Has A Url. Now I'M Also Using Twilio, It Can Get A Url And Play It As A Recording. Is

Hi @<1714088832913117184:profile|MammothSnake38> , not sure I understand. Can you add a screenshot of how you currently play audio files?

one year ago

0 Hi Everyone, I'M Having An Issue With Clearml Datasets And Would Like To Know If This Is Possible. I Have A Task That Is Executed Repeatedly. This Task May Require Data To Be Loaded And Updated From A Dataset. My Question Is: Is There A Way To Append To A

In that case you are correct. If you want to have a 'central' source of data then Datasets would be the suggested approach. Regarding your question on adding data, you would always have to create a new child version and append new data to the child.

Also maybe squashing the dataset might be relevant to you - None

4 months ago

0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Of course :)

You can select tasks in different projects in table view or you can add experiments to an existing compare

3 years ago

0 How Does Clearml Handle

Hi @<1523701842515595264:profile|PleasantOwl46> , I think that is what happening. If server is down, code continues running as if nothing happened and ClearML will simply cache all results and flush them once server is back up

one year ago

0 Hey, Guys, Are Any Of Your Have An Experience Of Configuring Clearml Agent To Use A Custom Non-Aws S3 Cloud Which Uses Http Endpoint. If So, How Did You Do It? I Would Really Like To Use Clearml But I Can'T Figure Out How To Set Up It Properly. I Tried Do

Maybe @<1523701087100473344:profile|SuccessfulKoala55> has more insight into this 🙂

2 years ago

0 Hi All! I Want To Setup A Tool That I Can Use To Analyse Clearml Logs (Just User And Experiment Logs, I Am Not Doing Any Model Serving Yet). Is There An Api Endpoint That I Can Fetch Such Metrics? Metrics Like Number Of Active Users, Number Of Experiments

Hi @<1573119955400921088:profile|CloudyPelican46> , you can certainly do this. You can find all the related api calls here - None
I suggest opening developer tools (F12) and seeing what is sent in the UI to fetch the various metrics you're looking for

2 years ago

0 Hi Everyone! After Clearml Worked Well For Use For About 2 Years, We Now Have The First Problem When Updating The Open Source Server. I Have Performed The Update As Advised Here With

Hi @<1523702496097210368:profile|ScantChimpanzee51> , from what version to what version did you try upgrading? Did you perform a backup?

4 months ago

0 Hi, I’M Trying To Upload Output Model Files (Like .Pth) To Clearml Server. Assume My

Hi @<1523721697604145152:profile|YummyWhale40> _, what if you specify the output_uri through the code in Task.init() ?

one year ago

0 Hello Everyone, When I Try To Connect To My Clearml Server Using Clearml-Init, I Encounter This Error.

I was suspecting connectivity issues. Glad to hear it's working

3 years ago

0 Another Thing, Can I Get The Git Repo/Commit Info Of My Experiment Through The Sdk? Couldn'T Find It In The Docs.

UnevenDolphin73 , interesting idea! Could you open a github issue to track this?

3 years ago

0 Is This The Write Way To Add A Tag To An Output Model Artifact Of A Task? Torch.Save(Model, '

I wasn't able to reproduce it on my side. Can you try the following?
In clearml/examples/reporting/mode_config.py
Under line 45:
OutputModel().update_weights('my_best_model.bin')
Add the following:
output_model = task.models['output'][-1]
output_model.tags=['deployed']

And check in the UI if you get a tag on the model

3 years ago

Show more results