CostlyOstrich36

Hi @<1523701295830011904:profile|CluelessFlamingo93> , when running remotely the agent assumes it will be a different machine. I think the best way to solve this is to add utils to your repository and import it from there during code execution.

What do you think?

one year ago

0 Hello Everyone What'S The Proper Way To Run Multiple Interactive Jupyter Sessions On One Machine/Agent? What I Am Doing Is Running Multiple Agents On The Same Machine, Each Agent Handling One Running Session To Avoid Subsequent Tasks Being In

Hi @<1670964701451784192:profile|SteepSquid49> , that sounds like the correct setup 🙂
What were you thinking of improving or do you have some pain points in your current setup?

9 months ago

0 Hello Everyone, I'M Working On A Flexible Machine Learning Pipeline Using Clearml, Covering Data Retrieval, Preprocessing, Training, And Evaluation. I Want To Add Hyperparameter Optimization (Hpo) As A Pipeline Step That Could Optimize The Preprocessing A

Hi @<1730396272990359552:profile|CluelessMouse37> , I would suggest reviewing the relevant docs regarding pipelines & HPO and then running said examples before integrating them 🙂

None
None
None
[None](https://clear.ml/docs/latest/docs/references/sdk/hpo_optimizati...

one month ago

0 Hi I’M Trying To Schedule The Tasks Execution Using

Hi @<1706116294329241600:profile|MinuteMouse44> , is there any worker listening to the queue?

2 months ago

0 Hi, I'M Trying To Use Clearml On Pytorch-Lightning With Multiple Gpus, But It Seems As If The Server Does Not Monitor The Experiment. I Can See No Progress In The Console (Steps Counter Stays On 0) Nor Any Tensorboard Loggings. On A Single Gpu Everything

Cool, thanks for the info! I'll try to play with it as well 🙂

2 years ago

0 Hey, How Can We Control The Pod Of Pipelinecontroller Not Use The Gpu? According To The Documentation, The

Hi @<1726047624538099712:profile|WorriedSwan6> , ideally the pipeline controller would be running on the services agent which is part of the server deployment and does not require GPU resources at all

3 months ago

0 Hi Clearml, I Tried To Upgrade The Clearml Server Following This

SarcasticSparrow10 , it seems you are right. At which point in the instructions are you getting errors from which step to which?

2 years ago

0 Hi, I Have Another Bug To Report For Clearml-Server 1.2 (Self Hosted) In The Console Logs Of An Experiments, I Cannot See The Latest Logs. Eg My Experiment Is Done, But I Can Only See The Logs Of To The Installation Of The Packages. If I Download The Log

Sure, if you can post it here or send in private if you prefer it would be great

2 years ago

0 Two Questions Today. First, Is There Some Way To Calculate The Number Of Gpu-Hours Used For A Project? Could I Select All Experiments And Count Up The Number Of Gpu-Hours/Gpu-Weeks? I Realize I Could Do This Manually By Looking At The Gpu Utilization Grap

SmallDeer34 Hi 🙂
I don't think there is a way out of the box to see GPU hours per project, but it can be a pretty cool feature! Maybe open a github feature request for this.

Regarding on how to calculate this, I think an easier solution for you would be to sum up the runtime of all experiments in a certain project rather than looking by GPU utilization graphs

2 years ago

0 Hey Can Anyone Explain This, My Max Number Of Instances Is 5 But Its Showing Something Like That: Its Showing 8 Instance Which Does Not Make Sense,

Can you also please share logs of the autoscaler?

one year ago

0 Hi, I'M Trying To Reduce My Team And My Api Calls When Training Models, We All Ready Added The Following Flags In Our Config File On Each Training Agent

Hi @<1523701295830011904:profile|CluelessFlamingo93> , I think you can also control the agent sampling rate (to sample queue every 10 or 20 seconds instead of 5 for example)

one year ago

0 Hello, I Have An Issue With Task.Close(). On A Mac It Works As Expected, But On My (Gpu Enabled) Linux Machine The Code Execution Freezes When Calling Task.Close(). Do You Have Any Idea What The Issue Could Be Or How I Cloud Debug It? The Log Does Not Sho

Hi @<1695969549783928832:profile|ObedientTurkey46> , is this happening when running on top of the agent or locally?

one month ago

0 Hey Team! There'S Something Small Yet Annoying That I Would Like To Bring To Your Attention... When Reporting Plots / Tables, The Name Of The Series Doesn'T Get Saved, And Instead All Of The Tables Get The Same Name (The Title And The Iteration) Here'S An

Hi WhoppingMole85 , can you please provide a small code snippet to play with? How are you saving the tables?

2 years ago

0 Hi, I Am Trying To Login To My Clearml Pro Account, After Not Logging In For A While, And I Am Receiving The Error Message That My Email Is Not Registered. But I Have Received The Receipt For This Month Subscription A Week Ago.

Hi @<1523701875835146240:profile|SkinnyPanda43> , with what email are you trying to login?

one year ago

0 Hi, Can I Ask How I Can Make Clearml-Datasets In Comparison With Pytorch Datasets/Dataloader? In Particular, Pytorch Dataloaders Would Be Able To Batch Pull And Then Preprocess Data Using Multi-Cpus, Feed It Into The Training Loop And Achieve As High Util

SubstantialElk6 , I think this is what you're looking for:
https://clear.ml/docs/latest/docs/references/sdk/dataset#get_local_copy
Dataset.get_local_copy(..., part=X)

2 years ago

0 Hello Everybody, I Am Using Clearml Self-Hosted. Is There A Way To Run Multiple Clearml Instances (Multiple Webservers, Apiservers And Fileservers) But With A Shared Databases (Elastic, Mongo)? Elasticsearch Requires A Lot Of Ram And It Would Be An Overki

Hi @<1582904426778071040:profile|SteepBat69> , that's an interesting question. In theory I think it should be possible

one year ago

0 Hello Everyone, Can You Help Me With An Issue I Faces Recently? Namely I'Ve Got This Message In Console While Training My Neural Net With Pytorch Lightning (+Clearml): "Traceback (Most Recent Call Last): File "/Home/Ubuntu/Anaconda3/Envs/Recsys-Kf/Lib/P

@<1554638160548335616:profile|AverageSealion33> , what if you just run a very simple piece of code that includes Task.init() ? One of the examples in the repository, does this issue reproduce?

one year ago

0 Hi Hi, I Have A Ui Question\Suggestion, Seeing The Total Number Of Workers Assigned Per Queue, Is It Possible? I Am Running Multiple Experiments And Managing Multiple Queues, I Am Trying To Get Some Overview Of The Status Of Each Queue. And I Am Interest

DepressedChimpanzee34 , Hi 🙂

Let's break this one down:
In the 'queues & workers' window if you switch to 'queues' you can actually see all the workers assigned to a specific queue In the workers window, you can see which workers are active and which are not. Is this enough or do you think something else is needed? You can see the resources used by each worker in the workers window. Is that what you mean? You can already do that! Simply drag and drop experiments in the queue window
I'm...

3 years ago

I see, so if you have 60 in queue and you select 30 you'd like to move them up the queue but so out of the selected 30 they would still keep their relative order, correct?

3 years ago

You mean that you have 30 jobs each in a separate queue and you'd like to move all of them to top priority in each queue?

3 years ago

0 I Have A Question Regarding "Imitating" An Agent Pulling Some Task For Debugging Purposes I Am Trying To Do Something Like: Creating A Task On The Server

DepressedChimpanzee34 , how are you trying to get the remote config values? Also, what which configurations are we talking about specifically?

3 years ago

0 I Have A Question Regarding "Imitating" An Agent Pulling Some Task For Debugging Purposes I Am Trying To Do Something Like: Creating A Task On The Server

@Alex Finkelshtein, if the parameters you're using are like this:

parameters = { 'float': 2.2, 'string': 'my string', }
Then you can update the parameters as mentioned before:
parameters = { 'float': 2.2, 'string': 'my string', } parameters = task.connect(parameters) parameters['new_param'] = 'this is new' parameters['float'] = '9.9'
Please note that parameters['float'] = '9.9' will update the parameter specifically. I don't think you can update the parameter en masse...

3 years ago

0 I Have A Question Regarding "Imitating" An Agent Pulling Some Task For Debugging Purposes I Am Trying To Do Something Like: Creating A Task On The Server

Can you give an example for your test_config ?

3 years ago

0 I Have A Question Regarding "Imitating" An Agent Pulling Some Task For Debugging Purposes I Am Trying To Do Something Like: Creating A Task On The Server

DepressedChimpanzee34 , the only way I see currently is to update manually each parameter

For example:
parameters = { 'float': 2.2, 'string': 'my string', } parameters = task.connect(parameters) parameters['new_param'] = 'this is new' parameters['float'] = '9.9'
Does this help?

3 years ago

Show more results