CostlyOstrich36

0 Questions, 4181 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4181

0 Hi Everyone! I Have Weird Issue With Clearml Pipelines: Sometimes When I Run My Script Localy And Then Connect To Remote, Old Script Executes With Old Parameters On The Remote, Instead Of Current One, Even Though I Didn'T Change Anything. Which Logs Shoul

Hi @<1635088270469632000:profile|LividReindeer58> , I would investigate the pipeline controller + all the steps

one year ago

0 Hi! My Agent Has Very Limited Disk Space. And When A New Task Is Launched And The Loading Of New Data Begins, There May Not Be Enough Space. Is There A System For Automatically Clean Up Old Currently Unused Data In

DepressedFish57 , I'm not sure there is something for this. There is a cleanup service to kill old failed/aborted tasks but to clear caches you'd have to handle it manually 🙂

3 years ago

0 Is It Possible To Change The

And regarding the first question - Edit your ~/clearml.conf

3 years ago

0 Hey All, I Am Having An Issue With Clearml That Never Happened Before. It Looks Like It Happens On The Version

Can you try running with the latest version of clearml ?

4 months ago

0 Hey All, I Am Having An Issue With Clearml That Never Happened Before. It Looks Like It Happens On The Version

Hi @<1787653566505160704:profile|EnchantingOctopus35> , what are you running?

4 months ago

0 Is There An Example Of Simple Pipeline Using Task Scheduler? I Want To Create A Simple Pipeline Where First A Folder Is Monitored Using A Taskscheduler, And Under Certain Conditions, Data Is Uploaded And Dataset Id Is Given To The Next Step In The Pipeli

VexedCat68 , I don't think such an example exists, but if you create one it would be great if you opened a PR for the open source 🙂

3 years ago

0 Hi Everyone And Apologies For The Incredibly 'Basic' Question. I'M Trying To Deploy Clearml Server On An Ovh Hosted Vm. What Do You Think Is A Suitable Disk Size? Would 1 Tb Be Sufficient?

Hi @<1572032783335821312:profile|DelightfulBee62> , I think 1 TB should be enough. I would suggest maybe even having 2T just for the safe side

2 years ago

0 Is There An Autoscaler Equivalent For K8S? That Is, A Service That Will Launch Pods Based On Incoming Requests?

I think this is what you're looking for - the agent integration
None

2 years ago

0 I Would Like To Make A Retry Mechanism On Tasks (If Failed, Then Give Some More Chances To Run Correctly). When Tasks Is Failed, I Can'T Put It To The Queue One More Time, I Need To Clone It And Enqueue. But It Is A Clone, Other Task, With Other Id. Is Th

Hi RoundMosquito25 , you can reset a failed task and this will bring it back to draft mode

2 years ago

0 How Do You Save Models And Store The Classes As Well? When We Save The Model Using Pytorch We Just Save The State Dict And Not The Custom Classes For Different Models. I Was Thinking Of Just Pickling The Model But If Anyone Has A Better Suggestion That Wo

I think this would be right up your alley 🙂
https://clear.ml/docs/latest/docs/references/sdk/model_outputmodel
And you can update weights later using:
https://clear.ml/docs/latest/docs/references/sdk/model_outputmodel#update_weights

3 years ago

0 Hello Everyone, I’M Running Clearml Using Sagemaker And Its Strange I See No Plots Show Up When I Create A Matplotlib Plot After Initializing My Task, Wondering If Theres A Solution To This?

Hi @<1523701717097517056:profile|ScantMoth28> , what version of ClearML are you using? Are you using a self hosted server or the community one?

2 years ago

0 Hello Everyone, I’M Running Clearml Using Sagemaker And Its Strange I See No Plots Show Up When I Create A Matplotlib Plot After Initializing My Task, Wondering If Theres A Solution To This?

And if you run the same code locally everything is reported correctly?

2 years ago

0 Hi Everyone, I Am Having A Few Problems With The Ui: 1. I Uploaded An Optimization Task Yesterday - And I See It Running, But The Hyper-Parameter Optimization App Disappeared From The Ui. I Managed To Access It Only In An Indirect Way - Through The Worker

AbruptWorm50 , regarding the debug samples:
When were they registered?
Were you able to view them before?
Where are they registered?

3 years ago

AbruptWorm50 , can you try deleting your cookies/data on your browser to see if you manage to load the debug samples? I think this might be related: https://github.com/allegroai/clearml/issues/637

3 years ago

AbruptWorm50 , you can send me. Also can you please answer the following two questions?
When were they registered? Were you able to view them before?Also, you mention plots but in the screenshot you show debug samples. Can I assume you're talking about debug samples?

3 years ago

AbruptWorm50 , I also see the HPO app is missing, I'm told this is under investigation.

3 years ago

0 Hi, Yesterday I Updated The Clearml Server, Now All My Tasks Disappeared, There Are Only The Demo Tasks On The Interface. But The Data Is Still In The /Opt/Clearml/Data Folder.

https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server_mongo44_migration
Looks like what you might need 🙂

3 years ago

0 Hi, Yesterday I Updated The Clearml Server, Now All My Tasks Disappeared, There Are Only The Demo Tasks On The Interface. But The Data Is Still In The /Opt/Clearml/Data Folder.

SkinnyPanda43 , I think so yes 🙂

3 years ago

0 Hi, Yesterday I Updated The Clearml Server, Now All My Tasks Disappeared, There Are Only The Demo Tasks On The Interface. But The Data Is Still In The /Opt/Clearml/Data Folder.

Hi, SkinnyPanda43 , from what version did you upgrade to which version?

3 years ago

0 Hi, Yesterday I Updated The Clearml Server, Now All My Tasks Disappeared, There Are Only The Demo Tasks On The Interface. But The Data Is Still In The /Opt/Clearml/Data Folder.

I see, I suspect you might need to do some migrations

3 years ago

0 Hello, I'M Using

Hi VirtuousFish83 ,

You can do it using the API directly tasks.get_all is what you're looking for
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksget_all

3 years ago

0 Hi, I'Ve Run Into A Problem And Would Appreciate Some Help. I Installed Clearml Locally. When I Run A New Task On A Remote Server And In The Python Training Code I Set It To Only Train On One Gpu. Everything Works Fine And I See All The Scalars Automatica

What versions of clearml-agent & clearml are you using? Is it a self hosted server?

9 months ago

0 So I Decided To Re-Create My Clearml Server, I

Then the fix should be out in next version 🙂

3 years ago

0 Hi, I Configured An On-Prem File Server For Clearml Which Is Mounted On My Pc. I Am Trying Retrieve An Artifact From A Previous Run . Because This File Is Big I Want To Bring It To The Local Cache (On My Pc). However, When I Do The Following Artifact =Tas

Hi @<1546303277010784256:profile|LivelyBadger26> , can you provide a snippet that reproduces this?

2 years ago

0 Hello We Want To Serve A Simple Rulebase Model. Think It As A .Py With With A Simple If...Else Function 1) How Do You Deliver A Rule Based Model. Or Do I Need To Train A Tensorflopytorch,Scikitlearn To Serve A Simple Rulebase Model. 2) How Do You Manage

Adding a custom engine example is on the 'to do' list but if you manage to add a PR with an example it would be great 🙂

3 years ago

0 Hello All, Although I Call Pipe.Wait() Or Pipe.Start(Wait=True), The Pipelinecontroller Does Not Wait In The Script Until The Pipeline Actually Terminates And Throws: Warning - Terminating Local Execution Process. Can Someone Please Help Me? Thanks A Lot

Hi @<1552101474769571840:profile|DepravedLion86> , do you have something that reproduces this behavior?

2 years ago

0 Hi,

About 2. I'm not familiar in depth with it. What does it come out as? Text?

2 years ago

0 Hi All, Is There An Easy Way To Ping The Server Programatically? I'M Just Trying To See What Is The Default Server That Is Set, And Is It Responsive

Please implement in python the following command curl <HOST_ADDRESS>/v2.14/debug/ping

3 years ago

0 Once I Set Up A Clear Ml Server On A Machine. I Understand I Need An Agent Listening On A Queue To Run Code. Do I Absolutely Have To Have An Agent And The Gpu On The Same Machine As The Server? Also Do The Gpu And Agent Have To Be On The Same Machine?

VexedCat68 , you need to run the agent on a machine with gpu. The server doesn't need to have gpu 🙂

Regarding the queue:
Yes, if someone enqueues a task onto queue X, an agent listening to that queue will run the task.

3 years ago

0 Hi All Is There An Openapi Schema For The Clearml Rest Api?

REST API is language agnostic, you can just implement the API calls in any language you like. Same as you can do with python unrelated to the APIclient module in the SDK

one year ago

Show more results