CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 Hi, Anyone Know How To Report Scalars With Tenserflow? Thanks

If I'm not mistaken Task.get_last_iteration()
https://clear.ml/docs/latest/docs/references/sdk/task#get_last_iteration
reports the last iteration that was reported. However someone has to report that iteration. You either have to report it manually yourself during the script OR have something else like tensorflow/tensorboard do that reporting and ClearML should capture it

Does it make sense?

3 years ago

0 Hi, I Have A Question: How Can I Set Docker Image When Init A Clearml Task, I Don'T See Docker Option In Task.Init. I Saw A Docker Option In Task.Create But When I Create A Task With Task.Create And Docker Option => Task Couldn'T Run On Remote Agent.

Hi @<1749965229388730368:profile|UnevenDeer21> , I think this is what you're looking for
None

11 months ago

0 Hi Everyone! We Are Trying To Run Pipelines From Gitlab Ci Runners, But Are Faced With The Following Error When Performing

Hi PreciousParrot26 ,

Why are you running from gitlab runner - Are you interested in specific action triggers?

3 years ago

0 I Am Using Hydra. When Running Locally The Code Takes Into Consideration Any Hydra Override Arguments I Pass In The Command Line. But When I Run The Same Task In Remote (Using Clearml-Agent).... It Uses Only The Default Values. Is This Behaviour Reasonab

@<1546303277010784256:profile|LivelyBadger26> , it is Nathan Belmore's thread just above yours in the community channel 🙂

2 years ago

0 After Saving Models During Training I Cant Reuse The Same Task To Continue Training Is There Any Way To Continue Task Even Though There Are Models Saved? Alternatively Is There Any Way To Make Torch.Save Not Automatically Save The Model?

StaleButterfly40 , it looks like there might be a good solution for your request. In the previous link I provided, there is a parameter ' continue_last_task' that should work for you 🙂

3 years ago

0 Hello Everyone, While Calling Get_Local_Copy Of The Dataset From The Fileserver, I Get The Path To The Local Copy, But The Files Are Not Downloaded And The Folder Is Empty. Tell Me What Could Be The Problem. I Don'T Get Any Additional Errors Or Warnings.

Hi @<1524560082761682944:profile|MammothParrot39> , did you make sure to finalize the dataset you're trying to access?

2 years ago

0 Logger = Logger.Current_Logger() Logger.Report_Media( Title="Test", Series="Audio", Local_Path="/Path/To/File.Wav", Iteration=1, Max_History=-1 )

However, now when I go in the Results -> Debug Samples tab, the s3 credential window pops up. Every time that I refresh the page

RattyLouse61 , What version of ClearML are you running, I think this issue was solved in 1.3.0 release

3 years ago

0 Hi! I Have Some Clearml Agents On Gcp And Sometimes The Instance Seems To Reboot Making The Experiment Fail And All The Progress Is Lost. What Is The Best Way To Resume An Experiment?

Hey GrievingTurkey78 ,

Please take a look here : https://clear.ml/docs/latest/docs/references/sdk/task#taskinit

I think what you're looking for is this:
Task.init(.., continue_last_task=True )

Just search for this parameter for more more info 🙂

3 years ago

0 Another Question About The Aws Auto_Scaler, I Managed To Get The Scaler Service Running, It Listens To A Queue Called "Aws" (Yes, Very Imaginative), When I Queue A Simple Task I See That It'S Being Handled But The Task Is Stuck As Pending. When Checking T

Hi @<1612982606469533696:profile|ZealousFlamingo93> , how exactly are you running the autoscaler?
Is this what you're running?
None

one year ago

0 Hi Guys, I Have Problem Understanding To Set Requirements.Txt And Running Remotelty Using Clearml-Agent. So I Tried To Set Requirements, And Want To Execute Remotely. When In Draft Mode, The Installed Package Is Correct And Match Like Requirements.Txt, Bu

Hi @<1523701260895653888:profile|QuaintJellyfish58> , can you please provide a standalone snippet that reproduces this?

2 years ago

    from src.net import Classifier
ModuleNotFoundError: No module named 'src'

2 years ago

0 Hi All, My Name Is Evgeny From Corsound. I Have A Question. I Have A Dataset With Audio Files, In The Preview Bar I Can Select A File And Play It Inside An Iframe As It Has A Url. Now I'M Also Using Twilio, It Can Get A Url And Play It As A Recording. Is

Hi @<1714088832913117184:profile|MammothSnake38> , not sure I understand. Can you add a screenshot of how you currently play audio files?

one year ago

0 Hi There

I second what @<1822805241150574592:profile|ShinySparrow39> said 🙂

5 months ago

Also, how did you register the data?

one year ago

0 Hey, I'M Using Clearml Gcp Autoscaler And It Seems That

@<1808672054950498304:profile|ElatedRaven55> , what if you manually spin up the agent on the manually spun machine and then push the experiment for execution from there?

6 months ago

0 I Wonder If There Is Any Way To Sync Data On Cloud Storage (E.G S3 Or Minio) Using Clearml-Data Sync Command? Because I Don’T See Any Place In The Documentation Mention It, We Can Upload From Local Files But Not The Files On Cloud

Hi @<1603198153677344768:profile|ExasperatedSeaurchin40> , I think this is what you're looking for - None

2 years ago

0 Hi Guys, I Encountered A Very Frustrating Problem About Virtual Enviroment Management When I Use Clearml. I Use Virtualenv To Create A New Python Env And Installed All The Needed Python Pakcages In The Env. The Env Path Is

I think the 3rd one, let me know what worked for you

2 years ago

0 Pipelines Suddenly No Longer Appear In The Pipelines Tab, What Could/Should I Look Into? Edit: Using Latest Clearml (Agent, Server, Sdk), And Creating The Pipelines Via The Pipelinecontroller Sdk (

and if you revert it's all OK? Log wise there is nothing suspicious?

2 years ago

0 The Clearml Enterprise Plan Supports K8S Servicing Multiple Clearml Queues, As Well As Providing A Pod Template For Each Queue For Describing The Resources For Each Pod To Use

The chart already passes the --create-queue command line option to the agent, which means the agent will create the queue(s) it's passed. The open source chart simply doesn't allow you to define multiple queues in detail and provide override pod templates for them, however it does allow you to tell the agent to monitor multiple queues.
None

one year ago

0 Does Clearml Have A Way To Do Human In The Loop Activities As Part Of A Pipeline That I Might Have Missed?

Hi TrickySheep9 , can you be a bit more specific?

3 years ago

0 Hi, I Have A Question Regarding Optimization Task: I Want To Run A Standard Optimization Process And I Want To Tag All The Ran Tasks From The Optimization With A Common Tag And Also Set A Unique Tag For Each Task How Can I Do That?

What do you mean by verify? How are you currently running your HPO?

one year ago

0 Hi, I Was Wondering How Come My Api Calls Keeps Going Up While I'M Not Executing Any Tasks\Experiments? I Think It Is Related To The Fact That I Have A Worker That Is Running In The Background, And I Was Wondering How Many Api Calls A Worker Is Doing Per

By applications I mean the applications (HPO, Autoscalers,...). Regarding the web UI - it's sending API calls as you browse. You can open dev tools (F12) to see the requests going out (Filter by XHR in network tab)

2 years ago

0 I Everyone, How Are You Doing? I Started Using Clearml A Little Over A Month Ago And Recently Noticed That Where There Used To Be "Metrics", The Values Are Now All Going Under "Val". Does Anyone Know If Something Has Changed? The Yolo Metrics Used To Be U

Hi @<1835851148938973184:profile|BattySwan0> , are you hosting your own server or are you using app.clear.ml ?

3 months ago

0 Hey Guys! We Run Tasks Using Docker Mode Environment. The Docker Image We'Re Using Has Already All The Packages Installed On The System, But I Notice That Every-Time We Run A Task, It Tries To Install The Environment Packages Over Again. Is There A Way To

Hi @<1544853695869489152:profile|NonchalantOx99> , I think this is the environment variable you're looking for - CLEARML_AGENT_FORCE_SYSTEM_SITE_PACKAGES
None
You can also use agent.package_manager.system_site_packages: true in your clearml.conf

2 years ago

0 How To Make Sure That Clearml Agents Are Running Queue After Server Restart? Sometimes Our Worker Dies And We Manually Have To Run Settuping For Queue, We Run It In Docker Mode Too

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , you need add the agent command that you run into the bootup of your system

2 years ago

0 Hi, I Am Trying To Run Nemo With Clearml With 8 Gpus, But I Get 8 Different Tasks In The Clearml Page Instead Of Just One, Any Idea What Should I Do?

Hi @<1852158596431745024:profile|HappyRaccoon38> , what did you do? What steps did you take?

2 months ago

0 Hi Guys, I Was Wondering If I Can Change The Base Docker Image On My Agent And Use An Image That I Custom Built Now Inside My Agent'S Docker Images Library With All Its Python Library That Is Needed. If So, Does Anyone Have An Example Code I Can Run? I Wa

CluelessElephant89 , I've added screenshots. Tell me if those help 🙂

3 years ago

0 Hey Everyone, I'M New To Clear Ml, But My Company Is Looking At Rolling It Out On Our Eks Cluster. We'Ve Installed Everything Through The

Hi @<1841649351697371136:profile|PerplexedDog0> , I think what you're looking for is impersonation of the agent during execution. This can be achieved via the --use-owner-token flag when running the agent - None

3 months ago

0 Hi Everyone, Is There Any Way To Add Task_Types ? I Know Supported Values Are ‘Training’, ‘Testing’, ‘Inference’, ‘Data_Processing’, ‘Application’, ‘Monitor’, ‘Controller’, ‘Optimizer’, ‘Service’, ‘Qc’, ‘Custom’. I Have Just Used 'Custom' However I Want

Hi StraightParrot3 , as SuccessfulKoala55 suggested you could maybe use tags for this as well.

In regards to creating views - If you predefine a certain view locally on your browser (with the extra column) I think you can just copy paste the URL and it should include the custom column for anyone using this URL

3 years ago

0 Controlling Artifacts Logging

You can disable automatic model logging using auto_connect_frameworks in Task.init()
https://clear.ml/docs/latest/docs/references/sdk/task#taskinit

This however will also disable automatic reporting of scalers. You can also manually force the upload of the final model with
https://clear.ml/docs/latest/docs/references/sdk/model_outputmodel#class-outputmodel

3 years ago

Show more results