CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

0 Hey, Is There A Way To Hide Certain Configuration Paramters? We Want To Login To Db To Fetch Data, For Task Run. But We Don'T Want The Db Connection Details To Be Logged Into Clearml, Is There A Way To Hide It?

I'm not sure it's possible to hide via the Task object. But I think such configurations should be saved as env variables or in clearml.conf

Can you please be more specific on the use case?

2 years ago

0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

Which config file? The one sitting locally on your computer? You would still need to transmit that data to the application that is spinning the instances up and down. Maybe a CLI? But that would be adding more complexity on top of it. What do you think?

3 years ago

0 Hi,

How would you report this to a Task?

2 years ago

0 Hi Team, I Have A Hosted Clearml Server. When I Upload A Large Artifact (Around 25Mb) To The

Hi NervousRabbit2 , what version of ClearML server are you running? Also what clearml version are you using?

2 years ago

0 Hello Looking For Full Working Example Of

None

one year ago

0 How Would Ya'Ll Approach Backing Up The Elastic-Search/Redis/Etc. Data In Self-Hosted Clearml? Any Drawbacks/Risks Of Doing A Simple Process That Periodically Zips Up The

@<1541954607595393024:profile|BattyCrocodile47> , that is indeed the suggested method - although make sure that the server is down while doing this

2 years ago

0 How To Use Clearml-Session.. I Mean Jupyter Notebook.. I Tried This Command "Clearml-Session" On My Clearml Server.. It Wasnt Working

Are you getting some errors? Did you run an agent?

2 years ago

0 Can Anyone Help Me Understand When The Content Shown In The Ui Is Set/Updated? In Particular, If I Initialize A Task And The Ui Receives Updates For Things Like The Notebook Preview, How Can I Update That Notebook Preview? I Can Imagine Manually Updating

Hi @<1836213542399774720:profile|ConvincingDragonfly85> , from my understanding as long as you run Task.init() at the start, running any cell afterwards should update the backend

5 months ago

0 Hi Everyone! I'M Currently Using The Free Hosted Version (Open Source) Of Clearml. I'M Mainly Using Clearml-Data At To Manage Our Datasets At The Moment, And I'Ve Already Hit The Limit For The Free Metrics Storage. Since We Didn'T Store A Lot Of Metrics (

Hi @<1618418423996354560:profile|JealousMole49> , I'm afraid there is no such capability at the moment. Basically metrics mean any metadata that was saved (scalars, logs, plots etc). You can delete some log/metric heavy experiments/tasks/datasets to free up some space. Makes sense?

one year ago

0 Hey, I'M Trying To Set Up Clearml To Work With Shared Drive Where All Models Are Going To Be Stored. Do You Know How To Store The Models During Training Simply By Saving The Path To Its Location? I Don'T Need To Send The Gigabyte-Size Files Through Clear

Hi @<1570220844972511232:profile|ObnoxiousBluewhale25> , you can use the output_uri parameter in Task.init to set a predetermined output destination for models and artifacts

2 years ago

0 Hi Everyone, I Was Running An Optimization Task With Optunaoptimzer, But I Had The Following Error :

Please do. You can download the entire log from the UI 🙂

3 years ago

0 Hi, Clearml We'Re Running Self-Hosted Clearml Server:

Then I think this is something you need to implement in your script to mark the task as failed if the spot goes down

11 months ago

0 Can You Please Point Me To Documentation Of Cron Jobs In Clearml?

Hi UpsetTurkey67 ,

Is this what you're looking for?
https://clear.ml/docs/latest/docs/references/sdk/trigger#add_model_trigger

3 years ago

0 "Clearml.Task - Error - Action Failed <500/0: Tasks.Edit/V1.0 (Update Failed (Bsonobj Size: 18330801 (0X117B4B1) Is Invalid. Size Must Be Between 0 And 16793600(16Mb) F"

Hi DrabOwl94 , how did you create/save/finalize the dataset?

3 years ago

0 Hi, When I Run

Hi EnviousPanda91 , what version of ClearML are you using? Are you running on a self hosted server?

3 years ago

0 Hi All, Want To Ask, How I Can Debugg Logger Class. I Have Problems With Displaying Graphs On The Ui, Logger.Report_Text Works, But Any Scalar Or Plot Is Not Displayed, I Integrated Tensorboard, But There Are No Logs From It Either. There Are No Warnings

Hi @<1603198163143888896:profile|LonelyKangaroo55> , how are you currently reporting, do you have a code snippet? Are you using the community server or a self hosted one?

2 years ago

0 Hey Everyone Is There A Way To Have Metrics Upload To Default_Output_Uri Instead Of Fileserver? We'Re Self Hosting Clearml On Kubernetes And We'D Like To Completely Get Rid Of Fileserver And Have All Uploads (Metrics, Models, Artifacts Etc.) In One Place

Hi @<1845635622748819456:profile|PetiteBat98> , metrics/scalars/console logs are not stored on the files server. They are all stored in Elastic/Mongo. Files server is not required to use. default_output_uri will point all artifacts to your Azure blob

5 months ago

0 I Am Experiencing Performance Issues With Using Clearml Together With Pytorch Lightning Cli For Experiment Tracking. Essentially What We'Re Doing Is Fetching The Logger Object Through Task.Get_Logger() And Then Using The Reporting Methods. However, It Ad

Hi SoreHorse95 ,

Does ClearML not automatically log all outputs?

Regarding logging maybe try the following setting in ~/clearml.conf sdk.network.metrics.file_upload_threads: 16

3 years ago

0 Hi Everyone, I Just Started Learning Clearml. My Goal Is To Create A Task And Connect My Jupter Notebook On Clearml. However, I’Ve Tried Clean Cookies, Uninstall Clearml And Restart My Computer, It Still Shows

AlertCrow40 , by the way. ClearML already has an integrated tool to work on a jupyter notebook.

In a couple of lines it will open a jupyter notebook for you to work with. Further reading here: https://clear.ml/docs/latest/docs/apps/clearml_session/
🙂

4 years ago

0 We Use Environment Variables In Our

Hmmm Regarding your issue you can use the following env vars to define your endpoint
https://clear.ml/docs/latest/docs/configs/env_vars/#server-connection

What is your usecase? Do you want to change the endpoint mid run?

3 years ago

0 There Is A Problem Starting From Clearml 1.7.0 With Python-Fire

Hi PricklyRaven28 , can you try with the latest clearml version? 1.7.1

3 years ago

0 Hey, I Have A Question Regarding Pipelines. Let'S Say I Have 2 Scripts: Train.Py And Evaluate.Py. Each Of Them Creates A Task Using Task.Init And Logs Some Information. These Scripts Are Run Independently (In My Case They Are Run By Dvc). I Would Like Bot

ScaryLeopard77 , Hi! Is there a specific reason to the aversion from pipelines? What is the use case?

"continue with this already created pipeline and add the currently run task to it"

I'm not sure I understand, can you please elaborate? (I'm pretty sure it's a pipelines feature)

3 years ago

0 Is There Any Way To Change The X-Axis On The Charts For Scalars, To Say E.G. "Epochs" Instead Of "Iterations"? Or Is That Hardcoded?

I'm not sure. Maybe @<1523703436166565888:profile|DeterminedCrab71> might have some input

2 years ago

0 Hi Everyone, I Got Several Error Messages Like This When Trying To Upload Data On The Clearml Which We Self-Hosted. Do You Have Any Ideas?

Looks like you're having some connectivity to the files server


2024-11-14 07:05:30,888 - clearml.storage - INFO - Uploading: 5.00MB / 12.82MB @ 35.88MBs from /tmp/state.vykhyxpt.json
2024-11-14 07:05:31,111 - clearml.storage - INFO - Uploading: 10.00MB / 12.82MB @ 22.36MBs from /tmp/state.vykhyxpt.json
1731567938707 labserver error WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib...

one year ago

0 I Have A Dataset Uploaded To Clearml. By Mistake I Didn'T Set The Destination Correctly And The Dataset Is Now Saved On A Computer Rather Than In S3. Is There An Easy Way To Rectify This?

Setting the upload destination correctly and doing the same steps again

one year ago

0 Hi Everyone I Am Experiencing Issues With

Hi @<1643785593177509888:profile|FrustratingSeagull27> , do you have some sample code that recreates this behavior?

one year ago

0 Hi, I'M Trying To Understand How To Add Kpis Artifact In A Way That Will Allow To Compare Them. Currently Clearml Presents Them As A File, Not Metrics. Please See My Code And Clearml "Compare Experiments" Screenshot Below.

Hi AttractiveShrimp45 , can you please elaborate on what you mean by KPIs artifact?

2 years ago

0 Hi Everyone, I Am Launching Clearml Webapp. Asks Me For User And Pass. How Do I Get That?

Can you elaborate on how you did that?

one year ago

0 Hello, I Have The Same Issue As This Github Issue:

Hi @<1556812486840160256:profile|SuccessfulRaven86> , just to make things easier, can you comment out these 3 lines in the config file? This will cause the sdk to have default behavior. Afterwards try with store_code_diff_from_remote: false

What do you see in the uncommitted changes section of the experiment?

2 years ago

0 If Possible, I Would Like All Together Prevent The Fileserver And Write Everything To S3 (Without Needing Every User To Change Their Config)

In the UI check under the execution tab in the experiment view then scroll to the bottom - You will have a field called "OUTPUT" what is in there? Select an experiment that is giving you trouble?

3 years ago

Show more results