CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

Hi, regarding your questions:
If you create and finalize the dataset, it should upload the file contents to the fileserver (or any other storage you configure). The dataset is an object similar to a task - it has a unique ID You can add metric columns to the experiments table. You can do this by clicking the little cog wheel at the top right of the experiments table. You can also select multiple experiments and compare them (Bottom left on the bar that appears after selecting more than 1 expe...

3 years ago

0 Is There A Quicker Way To Abort All Running Experiments In A Project? I Have Over A Thousand Running Anonymous Data Tasks In A Specific Project And I Want To Abort Them Before Debugging Them.

Or
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksstop_many

3 years ago

0 Hi Folks, Is It Possible To Disable Automatic Package Detection And Just Use Requirements.Txt? I Have Different Local And Remote (Agent) Environments So I'D Like To Keep Those Two Separate. I'Ve Tried Using Task.Set_Packages("Requirements_Remote.Txt") Aft

Hi @<1631102016807768064:profile|ZanySealion18> , I think this is what you're looking for:
None

one year ago

0 In Pipelines. Is It Possible To Inject A Requierment.Txt Such That The Executing Node Will Install Before Running Tasks?

and just making sure - by pipeline we're talking about the ClearML pipelines, correct?
https://clear.ml/docs/latest/docs/references/sdk/automation_controller_pipelinecontroller

3 years ago

0 Hi, I’M Training On Multi-Node, Clearml Captures Only A Single Machine Utility (Memory/Cpu/Etc.). I Assume It Captures Node 0. Is There A Way To Make It Report All Nodes?

Hi @<1558624430622511104:profile|PanickyBee11> , how are you doing the multi node training?

2 years ago

0 Hi Guys, I Am Having Some Trouble Running Some Training Scripts With The Agent Functionality:

UnsightlyHorse88 & ShallowGoldfish8 , can you please provide a code snippet to play with?

3 years ago

0 Hi, I Have A Question About Task Status. I Have A Script That Runs "Forever": It Loads (Or Creates, If It Does Not Exist Yet) A Specific Clearml Task, Does Some Work (In My Case, Checks If Database Has Changed And If So Dump It To A File And Upload It As

Usually tasks are timed out by default after not having any action after 2 hours. I guess you could just keep the task alive as a process on your machine by printing something once every hour or 30 minutes

one year ago

0 Hello, I’M Using

RattyLouse61 , great!

3 years ago

0 Also, Any Advice On Using Best Practice Of Using Task.Create() Instead Of Task.Init()? I Have The Need Of Specifying Docker And Repository, So Only Find Task.Create() Can Achive What I Need. But Then I End Up With Always Creating 2 Scripts For Each Task I

I mean that task.init will automatically detect the repo without specifying it

8 months ago

0 Hi Again

Heya ReassuredTiger98 ,

Is there anything specific you're looking for?

3 years ago

0 Hi Everyone! I'M Trying To Setup Web Login With Fixed Users Using Default Apiserver.Conf From Doc. When User Firstly Created Everything Seems To Be Ok, But After Server Restart It Throws "Invalid User/Password Combination". I Have Available Elastic And Mo

Hi @<1693795218895147008:profile|FlatMole2> , is it possible that the apiserver.conf file isn't persistent and somehow changes?

one year ago

0 Hi! To Make My Script Work Inside A Task, I Need To Add

You can export it in the same shell you run the agent in and that should work for example

export FOO=bar clearml-agent daemon ...

one year ago

0 Hi! Could Someone Clarify If There Is A Way To Get The Credentials Without Going To The Ui -> "Workspace" And Click "Create New Credentials" And Use The Value Provided? Like A Api Call?

How are you trying it programatically? Are you providing API keys for authentication?

3 months ago

0 Bug Report? We Noticed That The Aws Autoscaler Will Lose Track Of Instances Crashing Due To No Space Left On Device, And The Ec2 Instance Will Remain Running Indefinitely.

Hi @<1523701083040387072:profile|UnevenDolphin73> , you're using a PRO account, right?

2 years ago

0 Hi All, I Would Like To Know The Input Page_Size Of Clearml/Backend_Api/Services/V2_13/Tasks.Py Getallrequest. I Have Confirmed The Response Rows Will Be Change Depends On Given Page_Size. However Even When I Pass Page_Size Number Over 500, The Response W

Hi StraightParrot3 , page_size is indeed limited to 500 from my understanding. You need to scroll through the tasks. The first tasks.get_all response will return scroll_id , you need to use this scroll_id in your following call. Every call afterwards will return a different scroll_id which you will always need to use in your next call to continue scrolling through the tasks. Makes sense?

3 years ago

0 Hello, I Have Been Using Clearml For My Projects Lately. I Have Set It Up To Log The Training Data For An Rl Training Job. As Of Now It Currently Logs Data As Follows: 1 Million Episodes And Rewards For 3 Agents Each I'D Have Guessed That The Storage Requ

Hi @<1726772411946242048:profile|CynicalBlackbird36> , what you're looking at is the metrics storage, this is referring to all the console outputs, scalars, plots and debug samples.

This is saved in the backend of ClearML. There is no direct way to pull this but you can technically fetch all of this using the API.

wdyt?

one year ago

0 Hi, I Have A Self-Hosted Clearml Server. How Do I Change The Default Path

Hi @<1774245260931633152:profile|GloriousGoldfish63> , you can configure it in the volumes section of the fileserver in the docker compose.

9 months ago

0 Is There A Way To Save The Models Completely On The Clearml Server? It Seems That Clearml Server Does Not Store The Models Or Artifacts Itself, But They Are Stored Somewhere Else (E.G., Aws S3-Bucket) Or On My Local Machine And Clearml Server Is Only Sto

Hi @<1523704157695905792:profile|VivaciousBadger56> , you can configure Task.init(..., output_uri=True) and this will save the models to the clearml file server

2 years ago

0 Hi, I Have Another Bug To Report For Clearml-Server 1.2 (Self Hosted) In The Console Logs Of An Experiments, I Cannot See The Latest Logs. Eg My Experiment Is Done, But I Can Only See The Logs Of To The Installation Of The Packages. If I Download The Log

Sure, if you can post it here or send in private if you prefer it would be great

3 years ago

0 Hi. Does Clearml Support Auto-Magical (Scalars) For Scenarios Where We Need To Execute Third Party Installed Toolkits, Which Runs Training With Common Ml Frameworks Such As Pytorch And Tensorflow? Two Examples Below. Clearml Can Capture The Console Output

Hi SubstantialElk6 , I think you need to have Task.init() inside these sub processes as well.

2 years ago

0 Hi All, We Have A Self Hosted Clearml Server, My Colleague Uploaded A Dataset From His Machine And When I Try To Clone And Enqueue The Dataset Into Different Project From My Machine The Task Gets Failed Prompting "The System Cannot Find The File Specified

Hi @<1528546301493383168:profile|ThoughtfulElephant4> , where did you upload the dataset? Can you add the full log? If your colleague clones and enqueues - the code assumes that the files are local, no?

2 years ago

0 Weird Error; My Local Execution Hung With

And when you run it again under exactly the same circumstances it works fine?

3 years ago

0 Hi Everyone

Hi @<1546303293918023680:profile|MiniatureRobin9> , can you please add logs of the tasks + controller?

2 years ago

0 Hey Clearml Team, Would Be Nice To Include Dataset Hash When Using Clearml-Data Cli. Is The Order Of --Ids The Same As Returned Rows?

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , not sure I understand this line

Is the order of --ids the same as returned rows?

Also, regarding the hash, I'd suggest opening a github feature request for this.

one year ago

0 Has Anybody Encountered:

I think the issue is that the message isn't informative enough. I would suggest opening a GitHub issue on this requesting a better message. Regarding confirming - I'm not sure but this is the default behavior of Optuna. You can run a random or a grid search optimization and then you won't see those messages for sure.

What do you think?

2 years ago

0 From What I Understand Clearml Should Be Auto Logging My Model, How Ever This Isn'T Happening. I Have Clear Ml Installed Via Docker On A Local Server, And Am Using Jupyter Lab On A Separate Local Server. Some Things Get Logged, Including Console Text, But

Hi RoundMole15 , what version of clearml are you using? Also how is the model being saved without ClearML?

3 years ago

0 Hi All

Hi @<1546303293918023680:profile|MiniatureRobin9> , can you please add the full log of the run? Also, do you have some code that reproduces this?

2 years ago

0 Hello, What Are Mongodb Default Login Credentials For Self Hosted Clearml Server? We Are Moving Our Datasets To Another Place And So Far I Think Clearml Doesnt Support It. So I Would Like To Try Change The Database Entry (Im Guessing Its Stored Somewhere)

Yep 🙂

one year ago

0 +1 For Being Able To Get Data Usage Per Task. We Have Been Trying To Figure Out A Similar Way To Identify And Delete High Data Tasks That Aren'T High Priority.