Hi @<1523707653782507520:profile|MelancholyElk85> , what version of the apiserver are you using?
We found the issue. It will be fixed in the upcoming patch for the open-v1.14 release
Hi! Our ClearML server keeps crashing because of some weird task with the =
symbol in the ID. After restoring the database to the latest working state, it works for a while then crashes again, even if we don't run any tasks in the meanwhile. Moreover, now the task ID is different from the one from the first crash. Can anyone help to explain this strange behavior?
[2024-01-24 09:13:02,537] [9] [INFO] [clearml.apiserver.mongo.initialize] Pre-populating using /opt/clearml/db-pre-populate/nvidia.zip
Traceback (most recent call last):
File "/usr/local/lib/python3.9/runpy.py", line 197, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/local/lib/python3.9/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/opt/clearml/apiserver/server.py", line 10, in <module>
AppSequence(app).start(request_handlers=RequestHandlers())
File "/opt/clearml/apiserver/server_init/app_sequence.py", line 42, in start
self._init_dbs()
File "/opt/clearml/apiserver/server_init/app_sequence.py", line 113, in _init_dbs
pre_populate_data()
File "/opt/clearml/apiserver/mongo/initialize/__init__.py", line 46, in pre_populate_data
_pre_populate(company_id=get_default_company(), zip_file=zip_file)
File "/opt/clearml/apiserver/mongo/initialize/__init__.py", line 27, in _pre_populate
PrePopulate.import_from_zip(
File "/opt/clearml/apiserver/mongo/initialize/pre_populate.py", line 327, in import_from_zip
cls._import(
File "/opt/clearml/apiserver/mongo/initialize/pre_populate.py", line 944, in _import
cls._import_events(f, company_id, task.user, task.id)
File "/opt/clearml/apiserver/mongo/initialize/pre_populate.py", line 1120, in _import_events
cls.event_bll.add_events(
File "/opt/clearml/apiserver/bll/event/event_bll.py", line 382, in add_events
raise errors.bad_request.EventsNotAdded(**errors_per_type)
apiserver.apierrors.errors.bad_request.EventsNotAdded: Events not added: Invalid task id 9ab4ae2bfee741b68a62f8988babf222=115
Hi @<1523707653782507520:profile|MelancholyElk85> , what version of the apiserver are you using?
We found the issue. It will be fixed in the upcoming patch for the open-v1.14 release