ClearML FAQ | Performance Of Project Overview

Answered

Performance Of Project Overview

Performance of project overview
We see some performance issues with the projects list in the Web UI. When there are lots of sub projects the server response from projects.get_all_ex grows to > 1 MB for us and takes a couple of seconds. Mainly because of the "sub_projects" field of each top level project in the response.
I did not dig deeper yet and just wanted to ask:
Are these performance issues known? Can we somehow work around it? Why does the sub project counter list all projects and not just the next child projects? It seems unnecessarily costly to list all leaves when you have a deeply nested tree of projects.
If preferred I will create a Github issue and dig a bit deeper.

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AdorableSheep95
				
					0
					 × 1

Votes Newest

Answers 2

Thanks
I created one in clearml-web. Let me know when I can help you there somehow
https://github.com/allegroai/clearml-web/issues/32

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AdorableSheep95
				
					0
					 × 1

Hi AdorableSheep95 , This is indeed a know issue, and we would appreciate a Git issue so we can track it (and fix it 🙂 )

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Write your answer

1K Views

2 Answers

2 years ago

one year ago

Tags

Similar posts

How Can I Tell Clearml To Ignore Certain Submodules Existing In The Project? My Projects Consists Of Multiple Git Submodules And It Is Rather Annoying That The Task Always Tries To Fetch All Submodules, When They Are Not Even Necessary. I Don'T Know How I

He Everyone! Is There An Option To Set Extra_Docker_Shell_Script For Project Or Experiment, Rather Than For Global User Configuration? I'M Working On Several Projects And Each Of Them Require Their Own Environment Which Couldn'T Be Set Up From Python.

Hello Everyone, I Am Hosting My Own Clearml Server And It Is Great. However, I Ran Into A Problem Where One Of My Projects Has Become "Hidden" And I Have No Idea How. This Has Created Some Issues Where I Can No Longer Pull From The Project. How Do I Unhid

Hi, Is There A Way To Move Existing Pipelines Between Projects? Use Case: I Want To Utilize The New Pipeline Grouping Option And View Them By Project Name. Thing Is, I Accidently Named A Few Of Them Wrongly And It Messes Up The Grouping. Of Course I Can

How Does Clearml Associate Projects/Experiments With Git Repos? Can I Think Of It As Clearml Project = Git Repo And Clearml Experiment = Git Commit? What About Git Branches - Is There Any Way To Organize Things Such That Separate Branches Are Easy To Trac

Hi Clearml, I Encountered This Issue Last Week: I Tried To Delete A Few Experiments From One Project (That I Archived Beforehand), An Error Message Appeared And I Found Out That Many Experiments Have Been Removed From All Of The Projects

Hello Everyone, I Have An Error During "Delete" Of Project Containing 66 Sub-Projects And 0 Experiments. Error:

Hi Team Clearml, I Am Using Ec2 Ami Running Server V1.6.0-213. The Storage Is Only ~20% Full, So No Shortage Of Space. I'M Having Difficulty Deleting Old Projects From The Ui And Getting The Following Error: "Error Can'T Delete Project". I'Ve Done

Hi All, Newbie Question Can I Take Some Models From The Models That I Have Uploaded On The Clearml Server Into My Project Such As A Notebook? And Can I Track The Performance Of Each Model That Has Been Deployed In Production, For Example A Notebook With M

Hello, I Have A Problem With Creating Projects Using "Get_Or_Create_Project". The Function Fails When The Project Already Exists. But The Name Of The Function Clearly Indicates That It Should Not Fail When The Project Already Exists. Follows Is The Messag