CostlyOstrich36

0 Questions, 4175 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4175

0 Does Anyone Know How To Setup “Web App Cloud Access” For Non-Aws Cloud Providers? Setting All The Fields “Bucket”, “Key”, “Secret”, “Aws Region” And “Host Endpoint” Has No Effect. Thus, Everytime An Experiment Is Deleted, Clearml Says That Artifacts Were

So you can download/view files on the cloud

3 years ago

0 Hi, I Have A Question. I Am Trying To Create A Pipeline Using The

None

You should check the status of that container

one year ago

0 Has Anyone Found A Workaround For The Bug?

A workaround can be to set up a local Minio server or upload to s3 directly, this way there shouldn't be a limit

3 years ago

0 Hey, Is Clearml Able To Manage (Delete) Files Outside Of The Fileserver, For Example On Some Shared Drive? I Consider Scenario Where Only Local File Path To The Model Is Stored To Avoid Sending Large Weights Files Over Http.

Hi @<1570220844972511232:profile|ObnoxiousBluewhale25> , I think the API server can delete things only from the files server currently. However the SDK certain has the capability to delete remote files

2 years ago

0 Hi, Can We Specify The Limit And Request Resource Differently For The Workers Spawned By The Clearml Agent? So Some Tasks May Require A Lot Of Ram, But Other Tasks Don'T. So I Don'T Them To All Request The Same Amount Of Resource To Run. Edit: My Clearml

Yes, I think that would be the best solution.

3 years ago

0 Hi All! I'M Struggling With A Specific Scenario, Maybe You Could Help. I Have 2 Machines Types (For Example Titan/A100) And 10 Types Of Models With A Generic Code (I Pass The Model Name As An Arg). I Want To Create A Task For Each Of The 20 Runs. That'S I

Hi @<1531807732334596096:profile|ObliviousClams17> , I think for your specific use case it would be easiest to use the API - fetch a task, clone it as many times as needed and enqueue it into the relevant queues.

Fetch a task - None
Clone a task - None
Enqueue a task (or many) - [None](https://clear.ml/docs/latest/docs/references/api/ta...

2 years ago

0 Hi Clearml, Does Clearml Orchestration Have The Ability To Break Gpu Devices Into Virtual Ones?

What is your use case?

3 years ago

0 Hi All, I Am Trying To Understand How The Communication Between Clearml Server And Clearml Agent Takes Place And What All Ports/Protocols Are Involved, If Both Are On Different Machines. As Per The Documentation Here -

Hi @<1587977852635058176:profile|FloppyTurtle49> , yes same would be applicable. Regarding communication: It is one way communication from the agent to the clearml server done directly to the API server - basically what is defined in clearml.conf

Hope this clears things up

2 years ago

0 We’Re Planning To Use Clearml Agent To:

Hi @<1560798754280312832:profile|AntsyPenguin90> , I think you would need to wrap the C++ code in python for it to work, but conceptually shouldn't be any special issues

2 years ago

0 Hi, I'M Logging Plots Using Clearml Sdk. The Logging Is Automatic By Running Matplotlib And Seaborn. One Of My Plots Is Sns.Barplot, In The Pycharm Run I Get All The Ticks Name But In The Clearml Dashboard Results It Is Without The Ticks Names. I'Ll Be Ha

Hi, can you provide an example of how you report them?

3 years ago

0 Hi, I Notice A New Behavuour With Clearml-Agent=1.1.0. When It Is Installing The Packages I Nrequirements.Txt, It Failed With.

SubstantialElk6 , can you please verify that you have all the required packages installed locally ? Also in your ~/clearml.conf what is the setting of agent.package_manager.system_site_packages

3 years ago

0 Hi Everyone How Can I Pass Manual Input During Git Action When The Command I Use Asking Me To Input Clearml Configuration. I'M Running 'Clearml-Init' Command On Git Action, How To Put The Configuration When It Ask For "Paste Copied Configuration Here: ",

MoodyCentipede68 , I'm sorry. I meant inject a preconfigured ~/clearml.conf . Or as Jake mentioned, just use environment variables 🙂

3 years ago

0 I'M Looking At How Triggers Work In Clearml. Is There An Example, Maybe With Clearml Data And A Dataset Being Uploaded Or Some Other Example?

VexedCat68 , what do you mean by trigger? You want some indication that a dataset whats published so you can move to the next step in your pipeline?

3 years ago

0 Hello Everybody, Did Anybody Experience Problem Where In Clearml Web Ui You Customize Columns (Remove Some, Add Metrics, Etc..) They Just Reset Randomly After Some Point? Sometimes On Every Page Refresh. It Gets Quite Annoying To Add Metrics All The Time

I understand. That's strange, column ordering etc should be stored in cookies per project. Maybe @<1523703436166565888:profile|DeterminedCrab71> , might have an idea

2 years ago

0 I Just Encountered A Really Frightening Bug. Best I Can Explain What Happened Was This: Data Scientist Created New Venv, Installed Clearml==1.11.0 Instead Of Clearml[S3]==1.11.1, And Upon Re-Running A Pipeline From Cli, The Entire Project "Disappeared" (W

Can you please add a stand alone code snippet that reproduces this?

Just to make sure I understand the flow - you run an experiment and create it inside project 'my_example'

Afterwards you run a pipeline and you specify the controller 'my_example'.

This will make 'my_example' into a hidden project

Am I getting it right?

2 years ago

0 What Is The Correct Way Of Setting Environment Variables For Agents Which Don'T Run In Docker Mode? Do They Simply Inherit From The Environment They Were Executed From? Is There Somewhere Explicit To Set These Vars?

What exactly are you looking to set up?

3 years ago

0 Hello Everyone! I'M Using S3 For My Model Saving. During Hyperparameter Optimization My New Tasks Get Very Long Names Due To Override Parameters And Uploading Path Becomes Something Like This "/Traffic Lights Classification/

MinuteGiraffe30 , Hi ! 🙂

What if you try to manually create such a folder?

3 years ago

0 Hi, I Would Like To Understand How I Can Set The Pip Cache Location For My Agent, I Thought That I Already Had The Right Setting With

Hi ClumsyElephant70 ,
What about
# pip cache folder mapped into docker, used for python package caching docker_pip_cache = ~/.clearml/pip-cache # apt cache folder mapped into docker, used for ubuntu package caching docker_apt_cache = ~/.clearml/apt-cache

3 years ago

0 Hi Everyone ! :) I'M Trying To Test The "One Click Reproducibility" Feature But It Keeps Failing. My Question Is On A High-Level: Is It Normal That This Happen, If Yes, What Are The Common Reasons That Make An Experiment Not One-Click Reproducible ?

I think this is what you're looking for

2 years ago

0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

Hi UnevenDolphin73 ,

I think you need to lunch multiple instances to use multiple creds.

3 years ago

0 I'M New To Using Datasets, If My Git Project Root Is

Can you please elaborate on what you mean?

2 years ago

0 Why Is Async_Delete Not Working?

Also, is it an AWS S3 or is it some similar storage solution like Minio?

one year ago

0 Hi, I Have A Question Regarding Clearml Datasets. In The Web Ui, What Causes The "Content" Tab To Show A List Of The Files In The Dataset? It Used To Show Automatically, But Recently It Now Has "No Data To Show" Even Though All Files Are Definitely In The

What version of the server are you running? What version of the SDK also?

one year ago

0 Hi All, I Have A Problem With Setting Up An Agent. I Set Up Local Server On Ubuntu Behind Proxy, It Seems To Work Correctly. I Can Access Web Ui And Set Up Agent On A Windows Machine Just Fine, But When I Try To Set Up Agent On Any Linux Machine It Fails

Hi, can you give the error that is printed out?

3 years ago

0 Hi Community, We'Re Trying To Move From App.Clear.Ml To A Self-Hosted Clearml Instance, And I Was Wondering If Anyone Figured Out A Way To Transfer Tasks From One To The Other. Specifically, I'D Like To Copy All Datasets (Which Internally Are Represente

Hi @<1618418423996354560:profile|JealousMole49> , I think you would need to pull all related to data via the API and then register it again through the API.

one year ago

0 Hi Everyone, Suddenly Since 1 Hour Ago I Cannot Show The Graphs In 'Scalars' Section (Under Results). When Pressing The Scalars Button, Clearml Shows A 'Wait Circle' And Then I Get The Message "Failed To Get Scalar Charts". The Same Problem Occurs With Re

Are you still having these issues? Did you check if it's maybe a connectivity issue?

2 years ago

0 Hi Team, I Need Some Help, I'M Working On A Pipeline And I Need To Clone A Remote Repository, Where Do I Have To Set The Credentials Of Bitbucket? Thanks A Lot For Your Help

I think this is what you're looking for:
None
None

one year ago

0 Hi, Question Regarding

Also, can you verify that you still have the clearml-agent process running? top / htop

3 years ago

0 Hi! Trying To Orchestrate A Pipeline On Multiple Agents For The First Time. I Am Setting Up The Pipeline From Functions And I Need The Individual Function Steps To Run From A Cloned Repository Due To Local Imports. The Pipeline Task Detects And Clones The

I think the controller and steps need to be in the same repository

one year ago

0 How Should I Edit The

Very similar to a task, a project has also a unique identifier - the ID (Although I think project names are also unique)

You can get the project ID either from UI (If you go to a specific project, the project ID will be in the url) or from the api as documented in:
https://clear.ml/docs/latest/docs/references/api/projects#post-projectsget_all
or from the sdk as documented here:
https://clear.ml/docs/latest/docs/references/sdk/task#taskget_project_id

Plug that project ID into the filter ...

3 years ago

Show more results