CostlyOstrich36

0 Questions, 4210 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4210

0 Ist It Possible To Move Artifacts From Local Storage To S3? Or Do I Have To Delete The Old One And Create A New One With A Location In S3?

You would also need to edit the links somehow that are connected to the task

3 years ago

0 Hi Guys ! I Am Using My Agent In Docker Mode (Everything Prepared For Experiments). I Am Facing Following Challenge. In My Code:

@<1523701181375844352:profile|ExasperatedCrocodile76> , I think you need to set agent.package_manager.system_site_packages: True
In clearml.conf

ClearML doesn't assume that you have all the necessary packages installed so it does need to have some sort of basis for the packages to install

2 years ago

0 Out Of A Sudden Without Any Trigger, Our Clearml Server (

Hi @<1523701842515595264:profile|PleasantOwl46> , do you see any errors in elastic or in mongo?

Also, any chance there is filtering to only user specific tasks/projects?

What happens if you send a link to an experiment between users?

2 years ago

0 I Installed Clearml Server According To The Instructions In The Clearml Document, In Server Ubuntu V24.04.02.

Hi @<1825341965806342144:profile|DisgustedJellyfish66> , you basically see a blank screen in the webUI? Can you check if there are any errors in the API server or web server containers?

6 months ago

0 Hey Guys, In A Fresh Self-Hosted Clearml Server I Have The Issue That I Cannot See Any Preview Images Of The Files In A Dataset. It Seems Like A Bug, But Maybe I Am Doing Something Wrong?

This is how I usually add visualization

#Report data preview
ds.get_logger().report_table(title="Data Sample", series="First Ten Rows", table_plot=data1[:10])
ds.upload()
ds.finalize()

2 years ago

0 Hi Is There A Way To View The Dataset Images

I asking because I used an older version of clearml, when it was named allegro and I remember that I was able to see all the dataset..

Is it possible you had the enterprise version at a previous position? I think you're talking about HyperDS

I notice the links doesn't have hash, do all the features of data versioning is also working when using links (and not actual image files)

Yes

9 months ago

0 Hello Everyone, Is There An Easy Way To Clone A Pipline And Execute It With New Parameters? I Know That There Is The Possibility With Task But With Pipelines I Haven'T Found Anything In The Documentation Yet. Thank You In Advance For Your Answer.

Hi @<1774245220934750208:profile|GleamingTiger28> , you basically need to build it in your code and expose it as parameters, please see the examples for reference - None

11 months ago

0 Hi, I Am Running Clearml Open Source Version On Eks Kubernetes And Trying To Set The Web Login Configurations As Described Here:

Hi BoredBluewhale23 ,

How did you configure the apiserver when you raised the EKS K8S cluster?

3 years ago

0 Hi, I Am Currently Trying To Train With

NonchalantDeer14 , Hi! Cool find! How do does it show in the UI when you execute remotely?

Do you have a small snippet to play with?

3 years ago

0 Hello, I'D Like To Ask Questions About Taskscheduler

ScaryBluewhale66 , Hi 🙂
Regarding your questions
I think you can just reset the task and enqueue it You can stop it either in the UI or programmatically I'm guessing the scheduler would show errors in it's log if for some reason it failed at something for some reason

3 years ago

0 Hello Everybody. I Have A Question About Autoscaler. I Have An Autoscaler That Is Started By A Python Script. When I Start The Task With Task.Enqueue('Queue') In My Laptop, Where Does The Worker Get The Whole Code? Does It Clone It From Github?

Hi @<1523704674534821888:profile|SourLion48> , yes and yes. It's all part of the docs - None

one year ago

0 Hello! In My Code I Use A Package That Writes Into Wav Files, Named Soundfile (Import Soundfile As Sf). On 'Conda List' There Are - Soundfile 0.10.3.Post1 Pysoundfile 0.10.3.Post1 Pyhd3Deb0D_0 Conda-Forge Libsndfile

Hi @<1571308003204796416:profile|HollowPeacock58> , do you have a standalone code snippet that reproduces this behavior?

2 years ago

0 Hi, Is There A Way To Forbid Uploading Datasets Into Fileserver Or To Make S3 Storage A Default Location For Datasets? As Far As I Know, The Only Way To Upload Dataset To The S3 Storage Is To Use

ContemplativeGoat37 , I'm curious about your implementation. Which method was more relevant - config file change or using an environment variable or are both useful?

3 years ago

0 Hi, A Google Update Led To Breaking Tensorflow Versions. This Requires To Downgrade Protobuf To <=3.20.1. Is There A Way To Make The Agent Ignore Installation Of Protobuf==4.21.1 And Install Above Instead? Before Running The Task Of Course. I Am Runnnig

AbruptWorm50 , please provide a log of the task 🙂

3 years ago

0 Hello, I’M Using

Yep

3 years ago

0 Hi All. In Self Hosted Clearml Suddenly Scalars Stopped To Be Shown In Scalars Tab. Any Ideas?

Hi @<1523701553372860416:profile|DrabOwl94> , can you check if there are some errors in the Elastic container?

2 years ago

0 Hello, I’M Using

Yep, makes sense ^^

3 years ago

0 I'D Like The Console In A Clearml Run To Show Only The Stdout/Stderr As It Does Now, But I'D Also Like Clearml To Capture Debug Level Logs. Is There An Easy Around This? It Would Be Nice If One Could E.G. Set

UnevenDolphin73 , what do you say, did it work?

3 years ago

0 Is There An Easy Way To Apply The Uncommitted Changes, Logged By Clearml, Locally To A Dev Environment?

Do you mean to copy paste the uncommitted changes section and apply it to some local environment regardless of ClearML?

3 years ago

0 Hi, I Tried To Deploy Clearml-Server On Ec2. I Followed The Instruction Written On This

Also, are you maybe somehow tunneled into the EC2 instance and therefor may be seeing it as localhost?

2 years ago

0 Hi, Anyone Know How To Report Scalars With Tenserflow? Thanks

If I'm not mistaken Task.get_last_iteration()
https://clear.ml/docs/latest/docs/references/sdk/task#get_last_iteration
reports the last iteration that was reported. However someone has to report that iteration. You either have to report it manually yourself during the script OR have something else like tensorflow/tensorboard do that reporting and ClearML should capture it

Does it make sense?

3 years ago

0 Hi Team, I Need Some Help, I'M Working On A Pipeline And I Need To Clone A Remote Repository, Where Do I Have To Set The Credentials Of Bitbucket? Thanks A Lot For Your Help

Hi @<1668427950573228032:profile|TeenyShells80> , you would need to configure it in the clearml.conf of the machine running the clearml-agent

one year ago

0 Hey Guys, I’M Trying To Install

I think I misunderstood your problem at the start. let me take another look 🙂

3 years ago

0 Hi, I Would Like To Understand How I Can Set The Pip Cache Location For My Agent, I Thought That I Already Had The Right Setting With

Because I think you need to map out the pip cache folder to the docker

3 years ago

0 What Is The Best Way To Set S3 As A Files Server? We Have A Clearml Deployment Without A Files Server, But After/During A Training Run Clearml.Metrics Always Fails Due To A Connection Error While Trying To Call <Url>:8081 (We Don'T Have 8081 Because Of

Hi @<1535069219354316800:profile|PerplexedRaccoon19> you can setup api.files_server in clearml.conf to point to your s3 bucket

one year ago

0 Hi There, I Am Intending To Work More Often With The Datasets, But Not Sure If There Is A Way To Retrieve Specific Files From A Uploaded Dataset. I Saw I Can Retrieve Chunks Of Data, But Not Sure How That Would Work With A Dataset Of Parquet Files. If I H

Since the "grand" dataset will inherit from the child versions you wouldn't need to have data duplications

3 years ago

0 Can I Get In Python The Name Of The Person Who Created A Given Task By Calling Some Method Of A Task?

UpsetTurkey67 , I'm not sure. I know that the UI uses the API so everything shown in the UI exists in the backend. So, I just played a bit in iPython with dir(task) to see what it offers 🙂

3 years ago

0 Hi All! I Am Trying To Run The Notebook From The Remote Server Using Aws. It Seems Like I Successfully Installed Clearml Using !Pip Install Clearml Command, But When I Am Trying To Run !Clearml-Init I Got The Following Error: /Bin/Bash: Clearml-Init: Comm

This looks more appropriate if the username itself is "ubuntu"

3 years ago

0 Hi! We'Re Using Clearml In Our Pipeline And Have A Question Regarding Datasets. Currently, We Export Training Data Directly From Clickhouse To S3 Using A Command Like:

Hi, I think this is what you're looking for - None

6 months ago

0 Hi Community, We Are Having An Issue Connecting Our

Do you have a custom certificate for SSL by chance? If this is the case please see the following:
https://github.com/allegroai/clearml/issues/7
The solution would be changing the following to false:
https://github.com/allegroai/clearml/blob/9624f2c715df933ff17ed5ae9bf3c0a0b5fd5a0e/docs/clearml.conf#L16

3 years ago

Show more results