autoscaler 101 questions:
What is the best practice for managing credentials so that they don’t get saved in clearml webapp? When the https://clear.ml/docs/latest/docs/guides/services/aws_autoscaler/#running-the-clearml-aws-autoscaler wizard asks for “extra lines for the clearml.conf file” - what format does it expect? the easiest is just to paste the entire clearml.conf json, but I doubt this is what is expected and it’s not clear how to override specific properties
I tried pasting the entire clearml.conf json in the “extra lines”, and when I launch the autoscaler following the example, the logs of the autoscaler task (in DevOps project) show it fails to parse the configuration file.
2022-09-08 10:00:15 2022-09-08 07:00:15,582 - clearml.auto_scaler - INFO - 'i-04a7b2913b1af9a07' STARTUP LOG: [ 99.206556] cloud-init[19769]: +++ unset -f pathmunge 2022-09-08 10:00:15 2022-09-08 07:00:15,582 - clearml.auto_scaler - INFO - 'i-04a7b2913b1af9a07' STARTUP LOG: [ 99.205519] cloud-init[19769]: +++ unset i 2022-09-08 10:00:15 2022-09-08 07:00:15,582 - clearml.auto_scaler - INFO - 'i-04a7b2913b1af9a07' STARTUP LOG: [ 99.205252] cloud-init[19769]: ++++ alias 'which=alias | /usr/bin/which --tty-only --read-alias --show-dot --show-tilde' 2022-09-08 10:00:15 2022-09-08 07:00:15,683 - clearml.auto_scaler - INFO - 'i-04a7b2913b1af9a07' STARTUP LOG: [ 100.024890] cloud-init[19769]: clearml_agent: ERROR: Failed parsing /root/clearml.conf (ParseSyntaxException): (at char 7583, line:189, col:9) 2022-09-08 10:00:15 2022-09-08 07:00:15,683 - clearml.auto_scaler - INFO - 'i-04a7b2913b1af9a07' STARTUP LOG: [ 99.212410] cloud-init[19769]: + python -m clearml_agent --config-file /root/clearml.conf daemon --queue default --docker nvidia/cuda:10.1-runtime-ubuntu18.04 2022-09-08 10:00:15 2022-09-08 07:00:15,684 - clearml.auto_scaler - INFO - 'i-04a7b2913b1af9a07' STARTUP LOG: [ 100.129799] cloud-init[19769]: + exit 1