Hey There Have The Following Issue After Upgrading Server And Trains To 0.16:

Answered

hey there

Have the following issue after upgrading server and trains to 0.16:
Error 100 : General data error (TransportError(503, 'search_phase_execution_exception', 'Trying to create too many buckets. Must be less than or equal to: [10000] but was [11633]. This limit can be set by changing the [search.max_buckets] cluster level setting.'))Error appears when checking scalar plots. Randomly appeared after training for a while (it was ok for e.g. first epoch).

This seems to be coming from ES: https://discuss.elastic.co/t/search-max-buckets-limit-error-on-7-0-1/179989

  				
Posted 
	5 years ago

					More
				  		
  Report
		
					ElegantKangaroo44
				
					0
					 × 1

Votes Newest

Answers 34

AppetizingMouse58 Great, Thanks so much! You have done a great work.
Another question, how to configure elasticsearch to run as a cluster with 2 or more nodes on the same or different machine 😅

  				
Posted 
	5 years ago

					More
				  		
  Report
		
					SubstantialBaldeagle49
				
					0
					 × 1

Might be some other issue related to loading plots from elastic. Can you show the trains-apiserver log again after you received the error - there should be some more information there

  				
Posted 
	5 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

I have remake curl, this commad "sudo curl -L " https://github.com/docker/compose/releases/download/1.24.1/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compos" will work

  				
Posted 
	5 years ago

					More
				  		
  Report
		
					SubstantialBaldeagle49
				
					0
					 × 1

AppetizingMouse58

  				
Posted 
	5 years ago

					More
				  		
  Report
		
					SubstantialBaldeagle49
				
					0
					 × 1

Show more results

Write your answer

114K Views

34 Answers

5 years ago

one year ago