CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

0 Hi Guys, I Have A Question Regarding Clearml-Serving. I Have Deployed My Model To An Api, Now I Want To Add A Front End Interface For The Url, How Should I Go About Doing It?

Regarding UI - you can either build your own frontend for it or use streamlit / gradio applications (Which are supported in the enterprise license).

About using a model outside of ClearML - You can simply register the model to the model artifactory - None

2 years ago

0 Hi All, I Have A Pipeline Construct From Multiple Base Tasks. Is There A Way To Get Output Or Notification Somehow From One Of The Steps In The Pipeline On The Fly? I Want To Know If I Can Trigger The A Child Step Based On Some "Go" Command That I Will Pu

@<1539417873305309184:profile|DangerousMole43> , I think for this specific ability you would need to re-write your pipeline code with pipelines from decorators

2 years ago

0 Hi Everyone, Im Trying To Use The Aws Autoscaler Service. Provided The Pac But Is Not Able To Clone The Repo. It Is Not Using The Pac (Using Gitlab)

Hi Juan, can you please elaborate? What is pac? What is failing to clone the repo, can you provide an error message?

3 years ago

0 Hi There, I Would Like To Know How We Can Pass An Environment Variable For The Running Script When The Script Is Run Remotely By An Agent?

Hi @<1529995795791613952:profile|NervousRabbit2> , if you're running in docker mode you can easily pass it in the docker_args parameter for example so you can set env variables with -e docker arg

2 years ago

0 Hi, I'M Not Sure When Exactly But At Some Point I'Ve Got No Access To My Debug Samples. We'Re Using Self-Hosted Clearml, Which Runs Within A Docker Container. Any Ideas? Thanks!

Hi @<1717350332247314432:profile|WittySeal70> , where are the debug samples stored? Have you recently moved the server?

one year ago

0 I Am Trying To Run A Task On An Agent For The First Time But I Am Running Into Some Things I Do Not Understand, I Hope Someone Can Help Me Out With This. I Got An Agent Running On Google Colab, But When I Clone A Task And Enqueue It From The Web Ui, I Ge

Regarding the packages issue:
What python did you run on originally - Because it looks that 1.22.3 is only supported by python 3.8. You can circumvent this entire issue by running in docker mode with a docker that has 3.7 pre-installed

Regarding the data file loading issue - How do you specify the path? Is it relative?

3 years ago

0 Sometimes I Notice That At The End Of An Experiment Clearml Keeps Hanging (Something With Repository Detection?) And The Script Does Not End. Do More People See This? Especially In Our Continuous Integration Pipeline This Give Problems Because Tests Are G

EcstaticGoat95 , thanks a lot! Will take a look 🙂

4 years ago

0 Two Questions Today. First, Is There Some Way To Calculate The Number Of Gpu-Hours Used For A Project? Could I Select All Experiments And Count Up The Number Of Gpu-Hours/Gpu-Weeks? I Realize I Could Do This Manually By Looking At The Gpu Utilization Grap

SmallDeer34 Hi 🙂
I don't think there is a way out of the box to see GPU hours per project, but it can be a pretty cool feature! Maybe open a github feature request for this.

Regarding on how to calculate this, I think an easier solution for you would be to sum up the runtime of all experiments in a certain project rather than looking by GPU utilization graphs

3 years ago

0 What Is

MelancholyElk85 if you're using add_function_step() it has a 'docker' parameter. You can read more here:
https://clear.ml/docs/latest/docs/references/sdk/automation_controller_pipelinecontroller#add_function_step

4 years ago

0 Hi, I Have An Artifact Which Is A Path To The Outputs Of The Model That Was Trained And Its Used In Another Task Later On But As A String, But When I Use Upload Artifact It Uploads The Whole Folder And Not Just As A String, Is There Are Way To Just Upload

That's the controller. I would guess if you fetch the controller you can get it's id as well

2 years ago

0 Hello! I Need To Run Clearml Pipeline With Caching Of Steps. I Specify Cache_Executed_Step=True For Each Step, But My Steps Are Not Cached And Ended With The Status - Completed.

How are you writing your pipelines?

8 months ago

0 Hi All

Is the services agent part of the docker compose?

2 years ago

0 Hey All, Is There A Way To Transfer A Workspace To Someone Else? One Of My Reports Did The Original Spike On Which Experiment Tracking Platform To Use And The Company Workspace Is Under His Name. With A New Hire, We'Re Over The Seat Count Now And Blowing

What do you mean by organization? In Enterprise, you have users, roles & access controls based on those roles.

6 months ago

0 I Also Want A Low Latency Unthrottled System. It Seems Like The Free Version Of Clearml Is Somewhat Throttled. I Tried Uploading An Artifact To The Free Version Of Clearml And It'S Very Slow To Download The Artifact To My Laptop Using Get_Local_Copy() Fun

AgitatedDove41 , there isn't any throttling in ClearML and it uses the native packages when communicating with AWS (boto3 for example)

Where were you uploading to/from?

4 years ago

0 Help Please. I Have My Clearml Server Running In A Docker Container. Now, I Am Training My Ml Models In Another Docker Container. I Want To Track These Models With My Clearml Server Located In The First Container. What Configuration Do I Need To Do?

Hi @<1673501397007470592:profile|RelievedDuck3> , you simply need to integrate clearml into your code.

from clearml import Task
task = Task.init(...)

More info here:
None

one year ago

0 Hi Everyone, How Can I Check Programmatically Whether A Task Is Running Remotely And How Can I Get The Hostname? Additionally, Retrieving The User Name That Is Shown In The Server Ui Would Be Nice.

Hi @<1523701868901961728:profile|ReassuredTiger98> , you can fetch the task object, there one of the attributes of the task is it's worker. This way you can see on what machine it is running 🙂

2 years ago

0 Hi Everyone. I’M Struggling To Setup Minio Storage. Below Is What I’M Adding In My Credentials And When I Try To Create A New Dataset Using Below Command; I Get Errors: Configs:

try None :port/bucket

one year ago

0 Hey, I Use

Does this reproduce if you run it as a single task and not a pipeline?

6 months ago

0 Hi All, I'M Trying To Set Up Aws Autoscaler To Spin Up Ec2 Instances From Predefined Ami So I Was Able To Set Up The Autoscaler, But I Am Experiencing Some Issues With Spinning Up The Ec2 Instance. Seems Like It Keeps Failing (Spinning Up An Instance, The

Also can you provide the configuration of the autoscaler? You can export it through the webUI just make sure to scrape off any credentials

9 months ago

0 Hi, Having Problems During Credentials Verification In Clearml-Init. Server Installed On A Separate Machine, Web Ui Is Accessible Where I Generated Credentials For Api. Here Is The Log. Don'T Know Why I'M Getting Http 403. Detected Credentials Key="Wrdif3

It looks like there might be a firewall or something of the sort, please try the curl command from the machine itself to verify

4 years ago

0 Hi Everyone, I Am Having A Few Problems With The Ui: 1. I Uploaded An Optimization Task Yesterday - And I See It Running, But The Hyper-Parameter Optimization App Disappeared From The Ui. I Managed To Access It Only In An Indirect Way - Through The Worker

AbruptWorm50 , it looks like the application issue was solved for us 🙂

3 years ago

0 Hi. I'D Like To Try The Gcp Autoscaler.

I noticed that the base docker image does not appear in the autoscaler task'

configuration_object

It should appear in the General section

3 years ago

0 Hi Folks, Any Idea Why I Am Getting This Strange Error From Clearml-Data:

Shouldn't be a factor

3 years ago

0 Hi, Folks! Cannot See Plots In Clearml. Do You Know Why This Can Happen?

In network, the plots call returns empty?

one year ago

0 Hi Everyone, We Use Clearml Pro. Is There A Way To Find Out Which Tasks Are Using Significant Storage For Metrics And Artifacts? We'Re Around 25Gb Above The Free Quota For Metrics And Even Though We'Ve Been Deleting A Lot Of Stuff, The Amount Stored Hasn'

Hi @<1898906633770110976:profile|MinuteFlamingo30> , from my understanding this is actually on the roadmap. Currently there is no easy way to check it. Basically any experiment with a lot of scalars or console logs (think like experiments that ran for very long)

6 days ago

0 +1 For Being Able To Get Data Usage Per Task. We Have Been Trying To Figure Out A Similar Way To Identify And Delete High Data Tasks That Aren'T High Priority.

Hi @<1858681577442119680:profile|NonchalantCoral99> , please see my reply to Vojta 🙂

6 days ago

0 Hello, I Always Got A "Modulenotfounderror: No Module Named..." Error When I Run A Pipeline And Import A Local .Py File. I'M Using Decorator Pipeline, How Can I Import That Local .Py Files? My Pipeline Code And That .Py Files I Wanted To Import Already In

I was referring to the SDK python package (ClearML) and ClearML-Agent

3 years ago

0 When Trying To Run My Agent With Poetry As Package Manager (Could Also Be With Pip, But Definitely With Poetry), Strange Things Seem To Happen When Trying To Execute A Pipeline:

Do you have a log of this?

one year ago

0 Hi Hi, I Have A Ui Question\Suggestion, Seeing The Total Number Of Workers Assigned Per Queue, Is It Possible? I Am Running Multiple Experiments And Managing Multiple Queues, I Am Trying To Get Some Overview Of The Status Of Each Queue. And I Am Interest

DepressedChimpanzee34 , I see. Regarding the things that are not currently implemented, please open a github issue so we can track this 🙂

4 years ago

0 Problem: Excessive Scalar Storage From Tensorboard Integration Causing Out-Of-Memory On Clearml Server Hi Team, We’Ve Run Into A Problem With Clearml Ingesting Extremely Large Numbers Of Scalars From Tensorboard (Auto_Connect_Frameworks) (~800K Samples P

Hi @<1853245764742942720:profile|DepravedKoala88> , I don't think there is any downsampling when ingesting from Tensorboard. You can always turn off the autologging and only log what you want and downsample accordingly. Keep in mind that on one hand you should avoid bloat on the server and on the other have high enough granularity in your scalars.

What do you think?

4 months ago

Show more results