docker-compose I guess

If I do this it still autorecords the sklearn one

apparently it did not work

ahh, ok, well, I tried to find an example that I can extend but this was the only reference I found: https://github.com/allegroai/clearml/blob/ca384aa75c236e0a8af7c5dd85406a359c3eb703/clearml/model.py#L35

it worked!!!!

interesting if I run the script from the repo main directory with
python code/run.py
it still gives me the same error message

clearml.Repository Detection - WARNING - Can't get diff information for git repo in repo/code

this is a bit WIP but we save it with the design of the model:
` parameters = dict(self.parameters, model_type='XGBClassifier')
...

output_model.update_design(config_dict=parameters) `

if I swap it to Framework then it autocrecords both

also random tasks are popping up in the DevOps project in the UI

and then have a wrapper that gets the model data and selects which way to construct and deserialise the model class.
` def get_model(task_id, model_name):
task = Task.get_task(task_id)
try:
model_data = next(model for model in task.models['output'] if model.name == model_name)
except StopIteration as ex:
raise ValueError(f'Model {model_name} not found in: {[model.name for model in task.models["output"]]}')
filename = model_data.get_local_copy()
model_type =...

Yeah, I found it, thanks.

I also found that you should have a deterministic ordering before you apply a fixed seed random sampling or else you will have a lot of head-scratching and assertion errors...

now on to the next pain point:

This receives the payload from the server and turns it into something that can be fed to the model. This in out case depends on a data structure that is stored on the clearml server as an artifact. I need to communicate this to the class so it can pick it up and use it when called

That's because then I need to teach every DS how to use the ClearML api

I am running a script

yes, I do, I added a auxiliary_cfg and I saw it immediately both in CLI and in the web ui

Is it possible that the Prerocess class is the problem?

This is very different than from in the xgboost example:

Is there any restriction on what can be in preprocess.py?

Yes, this is exactly how I solved it at the end

https://github.com/allegroai/clearml-serving/blob/main/clearml_serving/preprocess/preprocess_template.py

I am not sure I want to do that

but I am one level lower than top. so:

~/work/repo is the main repo dir

~/work/repo/code/run.py and I am running python run.py in ~/work/repo/code

OSS version

wait

yeah

git status gives correct information

This was not something I was expecting to break.

If you enable nbdime globally and switch virtual environments, then git diff will fail.

clearml==1.7.1

use_current_task is False by default, let me see if this helps