CostlyOstrich36

0 Questions, 4173 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4173

0 Hi, I Have A Question About The Model Registry. Here'S My Situation: I'M Using K8S_Example And Struggling With Uploading A Model. Should Models Be Uploaded To The Fileserver, Or Should I Create Another S3 Bucket As Mentioned In The Documentation?

'True' should point to the files server

one year ago

Hi @<1742355077231808512:profile|DisturbedLizard6> , you can use the output_uri parameter of Task.init() to specify where to upload models.
None

one year ago

0 Hey, I Was Planning To Save The Best Trained Model And Get A Task Id For It, So I Could Use It Later As

DeliciousSeal67 , something along these lines:
task.upload_artifact('<ARTIFACT_NAME>', artifact_object=os.path.join('<FOLDER>', '<FILE_NAME>'))
So in your case it would be along the lines of
task.upload_artifact('trained_model', 'model_folder/best_mode.pt')

3 years ago

0 Hi Everyone, I Have A Problem With My

When does it happen, can you include full log?

3 years ago

0 Hi Everyone, I Have A Problem With My

Did you delete any specific cache manually?

3 years ago

0 Hi All, Is There A Way To Make Agents That Run As Root, To Execute The Code Tasks And Of Pipeline Steps, As The User That Executed The Pipeline Or Task Code Instead Of As Root?

@<1577468638728818688:profile|DelightfulArcticwolf22> , in addition to @<1523701087100473344:profile|SuccessfulKoala55> ’s answer, you have data management, orchestration (Integration with SLURM), pipelines, reports and much more.

As I mentioned, provisioning resources according to different groups - i.e. role based access controls are an enterprise feature.

I suggest you watch the onboarding videos on the ClearML Youtube channel - None

2 years ago

0 I Tried To Get Data From Dataset, But Agent Always Look On Localhost:8081. I Change Host In Clearml.Conf But Have Same Error. How Can I Change Host Of Clearml Fileserver?

@<1702492411105644544:profile|YummyGrasshopper29> , I suggest you take a look here - None

one year ago

0 Hi, What Is The Recommended Storage Capacity (How Many Gb) For The Self-Hosted Clearml Server Launched With An Ami? Is The Default Value Of 8Gb Is Good Enough? Thanks.

I'm assuming this is 8 gigs of ram?
I think it should suffice. To be entirely sure you can run one of the AMI's listed below and see it's specifications:
https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server_aws_ec2_ami/#latest-version

3 years ago

0 Why Is Async_Delete Not Working?

Also, is it an AWS S3 or is it some similar storage solution like Minio?

one year ago

0 Hey Guys, In A Fresh Self-Hosted Clearml Server I Have The Issue That I Cannot See Any Preview Images Of The Files In A Dataset. It Seems Like A Bug, But Maybe I Am Doing Something Wrong?

How about when you view it in the datasets view? Also what version of clearml package do you have?

2 years ago

0 Can I Somehow Disable The Popup “Welcome To Clearml” Window At Each Visit? After Closing And Refreshing The Site It Just Pops Up Again

EnormousWorm79 , are you working from different browsers / private windows?

3 years ago

0 Having A Problem Using Clearml-Data. When I Create Dataset And Get It Later Using Id, In Same Code File, It Works Normally. Now If I Later Try To Get That Dataset In File 2 In The Same Directory, I Get An Error Regarding State Or Something And Am Not Able

VexedCat68 , how is your ~/clearml.conf configured? And is there any chance you were having network problems at the time you tried to run it?

3 years ago

0 Hi, Clearml-Ui Does Not Show The Pipeline Even It Is Available. When I Click The Pipelines Section It Shows Me There Are Two Pipelines Like In Below But When I Click One Of Them I Can Not See The Any Pipeline. Anyone Can Help Me About This ?

Hi @<1657556312684236800:profile|ManiacalSeaturtle63> , can you please elaborate specifically on the actions you took? Step by step

one year ago

0 Hi, Is There A Way To Put Scalars On The Same Plot? For Example: I Train A Model Using Pytorch-Lightning And The Clearml Logger Automatically Logs Both Training And Validation Loss. I'M Used To Looking At These Graphs On The Same Plot But The Scalars View

Can you add a screenshot of how you see them currently?

2 years ago

0 Hello Everyone! I'M Trying To Add Functionality Where I Need To Rotate Artifacts. Psedocode:

Do you have a code snippet that reproduces this?

2 years ago

0 Hi Folks, Any Of You Has Experience In Deploying Clearml To Kubernetes Using Argocd? I Managed To Make It Run Pointing It To The Clearml-Charts-Repo, It Recognizes The Helm Chart And It Works. But I Am Struggling A Bit To Write My Own Definition To Make I

Hmmm maybe SuccessfulKoala55 can help 🙂

3 years ago

0 How Can I Download A Model Through Clearml File Server Like Other Artifacts? On The First Screenshow I Show Desired Path, On Thr Second Is Local Path Saved By Model Object.

Hi @<1623491856241266688:profile|TenseCrab59> , you need to mark output_uri = True in Task.init()

one year ago

0 Hi There, Our Team Started Using Clearml A Few Months Ago And We'Ve Recently Deployed An Aws Eks K8S Cluster With The Hopes Of Deploying A Clearml-Agent. I'Ve Been Able To Install The Agent On The Cluster Using:

@<1754676270102220800:profile|AlertReindeer55> , I think what @<1523701087100473344:profile|SuccessfulKoala55> means is that you can set the docker image on the experiment level itself as well. If you go into the "EXECUTION" tab of the experiment, in the container section you might see an image there

11 months ago

0 Hi, Stupid Questions.

You would need to implement this logic yourself. For example you expose a pipeline argument for the controller (These are the configurations you can control via the UI as well) and then basically have if logic in the controller code that will run/skip steps according to the step you'd like to start from.

Makes sense?

2 years ago

0 I'M New To Using Datasets, If My Git Project Root Is

Can you please elaborate on what you mean?

2 years ago

0 Hi All, Any Idea Why Spawned Trainings During Optimization Can End With The Following Message

CurvedHedgehog15 , isn't the original experiment you selected to run against is the basic benchmark?

3 years ago

0 Hi Everyone, I Am New To Clearml And Am Trying To Use Clearml Agent With A Docker Image For Run A Pipeline Remotely. My Agent Is Running And It Is Able To Pick Up The Tasks From The Queue. It Starts Running The Task Inside Docker. However, It Exits The T

What actions did you take exactly to get to this state?

one year ago

0 Hi, Forgive Me If This Was Asked Before In A Different Way, What’S The Recommended Way To Pass Different Git Credentials To An Agent Running On A Shared Machine (Meaning 2 People Are Queueing Different Jobs, Pulling From Different Git Remotes). Should I

Hi ExuberantParrot61 , if it's on the same machine you can use different configuration files. for example, when running the agent you can use --config-file <PATH_TO_USER_CONFIG_FILE>

3 years ago

0 Hello, I Have A Server With Several Gpus That I Wish To Use To Automatically Train Models. Clearml Seems Like The Perfect Tool For My Use Case But I Am Confused As To How I Can Communicate With The Agent Daemon Running On The Gpu Server. Do I Necessarily

You'll need ES/Mongo to run the ClearML server

3 years ago

0 Hi, I Want To Upgrade Clearml Server From 1.1 To 1.2 (Self Hosted). I Have The Following Setup:

on /data/

3 years ago

0 Hi, I Have An Issue When Running A Pipeline Controller Remotely In Docker. Basically I Have A Module That Reads A Config File Into A Dict And Calls The Pipeline Controller, Like

Hi @<1570220858075516928:profile|SlipperySheep79> , I think it depends on your code. Can you provide a self contained code snippet that reproduces this?

2 years ago

0 Hi, What Is The Best Way To Get The Agent To Install A Dependency From Github. I Have Tried This In This Sample Script:

Hi SkinnyPanda43 ,

Can you please add a log of the failure? I think if you add specific requirements manually it should override auto detection

2 years ago

0 I'M Looking At How Triggers Work In Clearml. Is There An Example, Maybe With Clearml Data And A Dataset Being Uploaded Or Some Other Example?

Yes, for an enqueued task to run you require an agent to run against the task 🙂

3 years ago

0 Hi, I Am Creating Task In My Jupyterlab Notebook. When I What To Mark The Task As Failed, My Kernel "Appears To Have Died".

What OS are you using?

3 years ago

0 Hi Everyone, I'M Quite New To Clearml , Just Started Self-Hosting It On Our Gke Using Helm Charts( Enabled Fixed Users, Using Clusterip Instead Of Nodeport ). I Have 2 Doubts .