Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
What Is Being Stored Exactly In

What is being stored exactly in tmp by the clearml agent? I have a process that cleans the /tmp each day, and I now get messages like clearml_agent: ERROR: Could not open configuration file: /tmp/.clearml_agent.0_vphtjv.cfg

  
  
Posted 2 years ago
Votes Newest

Answers 16


I had to restart the agent and now everything is fine

  
  
Posted 2 years ago

Ohh... I would not delete them then ... 😞
Maybe kind of heuristics (files created a week ago can be deleted?!)

  
  
Posted 2 years ago

AgitatedDove14

  
  
Posted 2 years ago

if they're mission critical, but rather the clearml cache folder?

hmmm... they are important, but only when starting the process. any specific suggestion ?
(and they are deleted after the Task is done, so they are temp)

  
  
Posted 2 years ago

my question is how to recover, must i recreate the agents or there is another way?

Yes you have to recreate the Task (I assume they failed, no?!)

  
  
Posted 2 years ago

AgitatedDove14

hmmm... they are important, but only when starting the process. any specific suggestion ?
(and they are deleted after the Task is done, so they are temp)

Ah, then no, sounds temporary. If they're only relevant when starting the process though, I would suggest deleting them immediately when they're no longer needed, and not wait for the end of the task (if possible, of course)

  
  
Posted 2 years ago

I would suggest deleting them immediately when they're no longer needed,

This is the idea for the next RC, it will delete them after it is done using 🙂

  
  
Posted 2 years ago

Maybe they shouldn't be placed under /tmp if they're mission critical, but rather the clearml cache folder? 🤔

  
  
Posted 2 years ago

So how do I solve the problem? Should I just relaunch the agents? Because they can't execute jobs now

Are you running in docker mode ?
If so you can actually delete mapped files (they will still be available inside the docker), just make sure you delete them X hours after they were created, and you should be fine.
wdyt?

  
  
Posted 2 years ago

AgitatedDove14 UnevenDolphin73

  
  
Posted 2 years ago

Yeah the task failed

  
  
Posted 2 years ago

AgitatedDove14

  
  
Posted 2 years ago

I'll just exclude .cfg files from the deletion, my question is how to recover, must i recreate the agents or there is another way?

  
  
Posted 2 years ago

I have a process that cleans the 

/tmp

 each day,

WackyRabbit7 the files (configuration etc.) that are mapped into the containers are stored there.
They should clean themselves, that said, we have noticed that the services-mode skips this cleanup, and it will be solved on the next RC of clearml-agent.
Make sense ?

  
  
Posted 2 years ago

That's awesome, but my problem right now is that I have my own cronjob deleting the contents of /tmp each interval, and it deletes the cfg files... So I understand I must skip deleting them from now on

So how do I solve the problem? Should I just relaunch the agents? Because they can't execute jobs now

  
  
Posted 2 years ago

Not in docker mode

  
  
Posted 2 years ago
655 Views
16 Answers
2 years ago
one year ago
Tags