I Am Using Up Around 50K Api Calls For Like 12 Hours Of Training With Pytorch Lightning. What Is Using Up So Many Api Calls? I Am Not Logging Excessively Anything. I Am Also Using Gcp Autoscaler If That Affects Things.

Answered

I am using up around 50k api calls for like 12 hours of training with pytorch lightning. What is using up so many API calls? I am not logging excessively anything. I am also using GCP Autoscaler if that affects things.

  				
Posted 
	3 months ago

					More
				  		
  Report
		
					NastyBear13
				
					0
					 × 1

Votes Newest

Answers 4

At 1 call per second for 12 hours you'll get to numbers close to that. I think you could try increasing the flush threshold - None

  				
Posted 
	2 months ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Okay will try

  				
Posted 
	2 months ago

					More
				  		
  Report
		
					NastyBear13
				
					0
					 × 1

Hi Bruno,

Did that resolve your issue?
We are also struggling with excessively high API calls from PyTorch trainings.

  				
Posted 
	2 months ago

					More
				  		
  Report
		
					OddReindeer7
				
					0

Not really
I think also if you have GCP Autoscaler on that also affects your API calls

  				
Posted 
	2 months ago

					More
				  		
  Report
		
					NastyBear13
				
					0
					 × 1

Write your answer

294 Views

4 Answers

3 months ago

2 months ago