Ok it’s here? https://github.com/allegroai/clearml/blob/master/clearml/backend_interface/task/task.py#L1352

Now do Task.current_task() and it creates a new task

To confirm, if i have fresh venv with no dependency installed except clearml

I have a requirements.txt file in root, and a script at scripts/script1.py

The script1.py does task.init(), execute_remotely and then imports few dependenceies

Now I run python scripts/script1.py

And it should pick up the installed packages correctly?

Think I will have to fork and play around with it 🙂

I am not running in Docker mode

forking and using the latest code fixes the boto issue at least

I am doing Task.init but it’s not adding expected libraries imported in the script or from requirements.txt

Do we support GPUs in a) docker mode b) k8s glue?

AgitatedDove14 is it possible to get the pipeline task running a step in a step? Is task.parent something that could help?

Yeah, when doing:

task.set_base_docker( "nvidia/cuda:11.4.1-cudnn8-runtime-ubuntu20.04", docker_setup_bash_script=script, )

The helm chart installs a agentservice, how is that related if at all?

Gitlab has support for S3 based cache btw.

Yeah please if you can share some general active ones to discuss both algos and engineering side

With the human activity being a step where some manual validations, annotations, feedback might be required

Is Task.current_task() creating a task?

As in run a training experiment, then a test/validation experiment to choose best model etc etc and also have a human validate sample results via annotations all as part of a pipeline

I would prefer controlled behavior than some available version being used. Here triggered a bunch of jobs that all went fine and even evaluations were fine and then when we triggered a inference deploy it failed

Thanks

Looks like Task.current_task() is indeed None in this case. Bit of log below where I print(Task.current_task()) as first step in the script

Environment setup completed successfully Starting Task Execution: None

Any idea why the Pipeline Controller is Running despite the task passing?

It completed after the max_job limit (10)

Awesome

irrespective of what I actually have installed when running the script?

Ok i did a pip install -r requirements.txt and NOW it picks them up correctly

Thoughts AgitatedDove14 SuccessfulKoala55 ? Some help would be appreciated.

Can you point me at relevant code in ClearML for the autoconnect so that I can understand exactly what's happening

Nope, that doesn’t seem to be it. Will debug a bit more.

Essentially - 1. run a task normally. 2. clone 3. edit to have only those two lines.

Question - since this is a task, why is Task.currnet_task() None?

But that itself is running in a task right?

pipeline code itself is pretty standard