CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 Hi, I’M Trying To Minimize Startup Time For My Training Tasks, I’Ve Set

You can read up on the caching options in your ~/clearml.conf
You can make virtualenv creation a bit faster

3 years ago

0 Hi All, I'M Running Dl Experiments On Top Of Mmdetection. The Experiments Are Deployed Remotely On A Dedicated Ec2 Instance Through

When the agent starts running a task it will print out where the logs are being saved

3 years ago

0 Hello All, I'M Trying To Download A File Hosted In The Clearml Server And I Receive The Following Error :

Hi ShallowCormorant89 ,

When does 1. happen? Can you add the full log?

Regarding 2, can you please elaborate? What is your pipeline doing and what sort of configurations would you want to add? On the pipeline controller level or steps?

2 years ago

0 Hey All, There Is A Way To Compare All The Experiments In A Project

Hi @<1523706700006166528:profile|DizzyHippopotamus13> , you can simply do it in the experiments dashboard in table view. You can rearrange columns, add custom columns according to metrics and hyper parameters. And of course you can sort the columns

2 years ago

0 Hi All, I Would Like To Know The Input Page_Size Of Clearml/Backend_Api/Services/V2_13/Tasks.Py Getallrequest. I Have Confirmed The Response Rows Will Be Change Depends On Given Page_Size. However Even When I Pass Page_Size Number Over 500, The Response W

Hi StraightParrot3 , page_size is indeed limited to 500 from my understanding. You need to scroll through the tasks. The first tasks.get_all response will return scroll_id , you need to use this scroll_id in your following call. Every call afterwards will return a different scroll_id which you will always need to use in your next call to continue scrolling through the tasks. Makes sense?

2 years ago

0 Hey. I Want To Run Task Remotely, But Neither The Clearml Server Nor Worker Can Clone The Repository With Training Code (They Dont Have Access). Can I Somehow Tell The Task That It Has To Use Local Copy Of The Package? I.E.:

Hi,

can you paste the error you're getting?

3 years ago

0 Cannot Import My Custom Python File When Creating A Pipeline Using The Decorator Do Anyone Have Any Idea As To How To Solve This Issue.

What do you mean? How are you running the pipeline - locally or remotely?

2 years ago

0 Hi! I Started Clearml Server On Ec2 Using Prebuilt Image. Everything Works Fine, Except One Small Thing: When Web App Shows Image That Stored On S3, It Asked Me For Aws Key/Secret Key. Then It Uses These Credentials To Provide Me With Signed Image Url, T

Hi @<1566959349153140736:profile|ShinyChicken29> , when you try to access the image on your browser, the browser tries access the S3 bucket directly - This is why you get the popup. Data never goes through ClearML backend. Makes sense?

2 years ago

0 Cannot Import My Custom Python File When Creating A Pipeline Using The Decorator Do Anyone Have Any Idea As To How To Solve This Issue.

Hi @<1533619725983027200:profile|BattyHedgehong22> , I think it needs to be part of repository

2 years ago

0 Clearml Tracks The Executed

Hi @<1541954607595393024:profile|BattyCrocodile47> , how does ClearML react when you run the scripts this way? The repository is logged as usual?

2 years ago

0 There Are Still A Ton Of Instances Of The Documentation Using 'Import Allegroai', Is That Deprecated?

For Enterprise related questions please use your dedicated Slack channel. You need to provide an extra index url, instructions are given in the ClearML Python Package Setup as shown in the screenshot:

one year ago

0 Hey, Guys, Are Any Of Your Have An Experience Of Configuring Clearml Agent To Use A Custom Non-Aws S3 Cloud Which Uses Http Endpoint. If So, How Did You Do It? I Would Really Like To Use Clearml But I Can'T Figure Out How To Set Up It Properly. I Tried Do

How are you currently setting it up?

2 years ago

0 How Do I Stop A Zombie Agent?

UnevenDolphin73 , can you verify that the process is not running on the machine? for example with htop or top

3 years ago

0 Hi There, I Am Running A Clearml-Agent And Now Trying To Run A Pipeline On A Schedule. When I Try Run The Schedule Using The Queue Assigned To The Worker I'Ve Got Running, I Get The Following Error About

Hi @<1654294828365647872:profile|GorgeousShrimp11> , it appears the issue is due to running with different python versions. It looks like the python you're running the agent on, doesn't have virtualenv

one year ago

0 Hi, Could Anybody Please Help Me With Spin Up Agent After Reboot On My Ubuntu Machine? I'M Currently Trying To Do It Thru Systemd Service And Script.

Is something failing? I think that's the suggested method

one year ago

0 Hi, I'M Trying To Use Clearml On Pytorch-Lightning With Multiple Gpus, But It Seems As If The Server Does Not Monitor The Experiment. I Can See No Progress In The Console (Steps Counter Stays On 0) Nor Any Tensorboard Loggings. On A Single Gpu Everything

Also, what if you try using only one GPU with pytorch-lightning? Still nothing is reported - i.e. console/scalars?

3 years ago

0 I Have A Question Related To Pipelinev2 (Using Decorator) Is Pipelinev2 Support Uploading Artifacts To S3 (Instead Of Fileserver)?

GrittyKangaroo27 , I see no special reason why not, as long as you set the credentials correctly 🙂
Have you tried?

3 years ago

0 I Recently Upgraded My Clearml Version And Here Are Some Questions That I Have:

What is the address of your server?

one year ago

0 Hi, I’M Trying To Upload Output Model Files (Like .Pth) To Clearml Server. Assume My

Hi @<1523721697604145152:profile|YummyWhale40> _, what if you specify the output_uri through the code in Task.init() ?

one year ago

0 Hello Everyone! I'M Using S3 For My Model Saving. During Hyperparameter Optimization My New Tasks Get Very Long Names Due To Override Parameters And Uploading Path Becomes Something Like This "/Traffic Lights Classification/

MinuteGiraffe30 , Hi ! 🙂

What if you try to manually create such a folder?

3 years ago

0 Hey. Is It Possible To Keep Docker Container Once Job Finished/Failed? I See In Logs That "--Rm" Is Passed To "Docker Run". Is It Possible To Avoid It?

Aren't you getting logs from the docker via ClearML? I think you can build that capability fairly easily with ClearML, maybe add a PR?

3 years ago

0 Hey Everyone, I'M New To Clearml Pipelines And My Tasks Are Always In Pending. 1) I Have Created Clearml Agent And It Is Connected To The Main Clearml Server. 2) Agent Configured To Use Docker With Mounted Volumes, Does Listen To The "Services" Queue And

Hi @<1635088270469632000:profile|LividReindeer58> , you should do a separation. The pipeline controller should run on the services queue. Pipeline steps should run on different queues. This is why they are sitting in pending - there is no free worker to pick them up.

one year ago

0 Can You Give Me The Difference Between Pipeline And Task?

Hi 🙂

A task is the most basic object in the system in regards to experiments. A pipeline is a bunch of tasks that are controller by another task 🙂

3 years ago

0 What Is The Best Way To Set S3 As A Files Server? We Have A Clearml Deployment Without A Files Server, But After/During A Training Run Clearml.Metrics Always Fails Due To A Connection Error While Trying To Call <Url>:8081 (We Don'T Have 8081 Because Of

Note that you used an env variable, I want to try the config directly first 🙂

one year ago

0 Hello, I Want To Use Custom Packages In My Code.It Works Fine When I Run It Locally.But When I Clone The Experiments And Run On Agent It Shows Package Not Found Error In Agent. Can Anyone Help Me Out How To Use Custom Packages In Clearml? Which Parameter

You don't need to do any special actions. Simply run your script from within a repository and ClearML will detect the repo + commit + uncommitted changees

2 years ago

0 I Get An

Great! Let me check if this is by design or an issue 🙂

3 years ago

0 Hello I Wanted To Set Up My Clearml Server Locally, Is It Normal That The Webpage On

Thats strange, you don't have a create new credentials button?

2 months ago

0 Hello All

Hi @<1718437476634202112:profile|SteepAnt48> , you certainly can! But you already have HPO capability built in:
None
None

one year ago

0 Hi All, Is There Any Way To List/Query All The Metric Events That Are Associated With A Particular Task? I Did Some Experiments With Apiclient Class, But No Success.

@<1523703961872240640:profile|CrookedWalrus33> , you can use the UI as reference. Open dev tools (F12) and see the network (filter by XHR).
For example, in scalars/plots/debug samples tabs the relevant calls seem to be:

events.get_task_single_value_metrics
events.scalar_metrics_iter_histogram
events.get_task_plots
events.get_task_metrics

2 years ago

0 Sporadic Failure To Retrieve Scalars And Console Logs. Context: Self-Hosted In Azure With 2 Separate Azure Container App For The Ui And Api Server. Elasticsearch, Mongodb As Azure Service Subscription. Symptom: For Long Running Task, We Sometime Get Err

Hi @<1576381444509405184:profile|ManiacalLizard2> , it feels like something related to the resources of the server or networking and it's having a hard time retrieving the data from ES. What resources have you allocated for the API server/ ES?

7 months ago

Show more results