Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Clearml_Agent: Error: Command '['/Root/.Clearml/Venvs-Builds/3.8/Bin/Python', '-M', 'Pip', '--Disable-Pip-Version-Check', 'Install', '-R', '/Tmp/Requirements_Hhemiomd.Txt']' Died With <Signals.Sigkill: 9>.

clearml_agent: ERROR: Command '['/root/.clearml/venvs-builds/3.8/bin/python', '-m', 'pip', '--disable-pip-version-check', 'install', '-r', '/tmp/requirements_hhemiomd.txt']' died with <Signals.SIGKILL: 9>.

Hi I have been encountering this error intermittently with inconsistent conclusions...(I'm running a private server with its own workers) anyone knows what could be the actual cause and how can i resolve this?

  
  
Posted 2 years ago
Votes Newest

Answers 9


Well it sounds like it makes some sense. Try the following on the machine running the agent - In ~/clearml.conf
edit the following section:
agent.vcs_cache.enabled=False

  
  
Posted 2 years ago

What's the version of your ClearML-Agent?
Are all agents running on the same machine or is it spread out?

  
  
Posted 2 years ago

It intermittently reads the requirements.txt between my repo and the cache. Im wondering if there is anyway to circumvent the cache?

  
  
Posted 2 years ago

CostlyOstrich36 hmmm i doubt so, i'm the only one using the machine for this particular experiment at the moment.

  
  
Posted 2 years ago

CostlyOstrich36 I'm using clearml_agent v1.1.2 on multiple agents in the same machine

  
  
Posted 2 years ago

CostlyOstrich36 ahhh i suspect the error might be coming from using a cached repository? e.g. Using cached repository in "/root/.clearml/vcs-cache/<my repository> it seems like it is trying to install the requirements.txt that was cached but isnt available anymore and there are occasions where the installed packages do not reflect a complete list of what was specified in the repository's requirements.txt. Could this be a possibility for the error (either not detecting the complete list of packages or an entire cached requirements.txt file)?

  
  
Posted 2 years ago

It intermittently reads the requirements.txt between my repo and the cache

Can you please elaborate?

  
  
Posted 2 years ago

okay will try this. Thanks so much!

  
  
Posted 2 years ago

Do you have resource monitoring on that machine? Any chance that that something ran out of space or memory or cpu?

  
  
Posted 2 years ago
706 Views
9 Answers
2 years ago
one year ago
Tags