Hi Is There Any Way To Store Large Model Weights In S3 But Still Using The Model Directory In Clearml (Just Like How We Store Datasets In S3 In Clearml), As If We Keep Storing Them In The File Server It Might Become Full.

Unanswered

Hi is there any way to store large model weights in s3 but still using the model directory in clearml (just like how we store datasets in s3 in clearml), as if we keep storing them in the file server it might become full.

  				
Posted 
	one day ago

					More
				  		
  Report
		
					UpsetWhale84
				
					0
					 × 1

Write your answer

8 Views

0 Answers

one day ago

8 hours ago

Hello Everyone! Is It Possible To Transfer Data (Datasets, Models) From One Clearml Instance To Another? How Can I Do This? I Store My Data In S3 And Clearml Tracks This Data. I Want To Migrate This Data From One Clearml Instance To Another, That Is, Tran

Hi, I Have A Question About The Model Registry. Here'S My Situation: I'M Using K8S_Example And Struggling With Uploading A Model. Should Models Be Uploaded To The Fileserver, Or Should I Create Another S3 Bucket As Mentioned In The Documentation?

Hi All, Quick Question About Clearml Datasets. Does Anyone Know If It Is Possible To Access (Could Just Be Paths To The Data In A Bucket) A Dataset Directly From S3, Instead Of Downloading A Local Copy? We Typically Store And Access Large Quantities Of

Hello Everybody, I Have A Quick Question, I Have Been Training Multiple Models And Have Reached A Point Where I Am Satisfied With A Model. How Do I Push My Model To S3 Server( Setup In The Clearml.Conf File)? Similar To What We Do When Pushing A Dataset

Hi, I Am Using Aws Autoscalaer To Train Model. I Have A Fair Large Dataset(400G) And The Data Is Private So I Can'T Really Store It In Clearml Dataset. Everytime When I Launch A Job, It'S Going To Take Very Long Time To Download The Data From S3. Is There

Hi, I Am Trying To Save My Trained Model Weights In S3 Bucket Instead Of Using Clearml Storage When Using Clearml-Task For Ml Training Remotely. I Tried To Use --Skip-Task-Init In Clearml-Task And Set Task.Init In My Scripts, But It Doesn'T Seem To Work.

Is There A Way I Can Upload An Ml Model (Raw, No Training Task) To S3 And Log It In The Models Section Of Clearml. I Succeeded With Storage Manager But Dont Know How To Make It Visible In Models Section. Also My Model Is Sometimes A Single File And Someti

We Just Had A Slight Problem - There Was A Double Space In S3 Checkpoint Name, But Clearml Ui Prints Them As One In The Model Description. If You Copy And Paste It, The Address Will Be Wrong