Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi! Our Clearml Server Keeps Crashing Because Of Some Weird Task With The

Hi! Our ClearML server keeps crashing because of some weird task with the = symbol in the ID. After restoring the database to the latest working state, it works for a while then crashes again, even if we don't run any tasks in the meanwhile. Moreover, now the task ID is different from the one from the first crash. Can anyone help to explain this strange behavior?

[2024-01-24 09:13:02,537] [9] [INFO] [clearml.apiserver.mongo.initialize] Pre-populating using /opt/clearml/db-pre-populate/nvidia.zip
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/opt/clearml/apiserver/server.py", line 10, in <module>
    AppSequence(app).start(request_handlers=RequestHandlers())
  File "/opt/clearml/apiserver/server_init/app_sequence.py", line 42, in start
    self._init_dbs()
  File "/opt/clearml/apiserver/server_init/app_sequence.py", line 113, in _init_dbs
    pre_populate_data()
  File "/opt/clearml/apiserver/mongo/initialize/__init__.py", line 46, in pre_populate_data
    _pre_populate(company_id=get_default_company(), zip_file=zip_file)
  File "/opt/clearml/apiserver/mongo/initialize/__init__.py", line 27, in _pre_populate
    PrePopulate.import_from_zip(
  File "/opt/clearml/apiserver/mongo/initialize/pre_populate.py", line 327, in import_from_zip
    cls._import(
  File "/opt/clearml/apiserver/mongo/initialize/pre_populate.py", line 944, in _import
    cls._import_events(f, company_id, task.user, task.id)
  File "/opt/clearml/apiserver/mongo/initialize/pre_populate.py", line 1120, in _import_events
    cls.event_bll.add_events(
  File "/opt/clearml/apiserver/bll/event/event_bll.py", line 382, in add_events
    raise errors.bad_request.EventsNotAdded(**errors_per_type)
apiserver.apierrors.errors.bad_request.EventsNotAdded: Events not added: Invalid task id 9ab4ae2bfee741b68a62f8988babf222=115
  
  
Posted 10 months ago
Votes Newest

Answers 2


Hi @<1523707653782507520:profile|MelancholyElk85> , what version of the apiserver are you using?

  
  
Posted 10 months ago

We found the issue. It will be fixed in the upcoming patch for the open-v1.14 release

  
  
Posted 10 months ago
540 Views
2 Answers
10 months ago
10 months ago
Tags
Similar posts