Found it.
https://clear.ml/docs/latest/docs/guides/clearml-task/clearml_task_tutorial/
The second example here, executing a local script. I think that was it. Thank you for the help.
https://clear.ml/docs/latest/docs/references/sdk/task#taskenqueue
Is this what you're looking for?
Also you can enqueue it through the API
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksenqueue
Basically, as soon as I get the trigger that a new dataset has been published, I want to pass the dataset id to the script as an cli argument and pass the code to the agent
So the api is something new for me. I've already seen the sdk. Am I misremembering sending python script and requirements to run on agent directly from the cli? Was there no such way?
I'll try to see how to use the sdk method you just shared
I recall being able to pass a script to the agent using the command line along with a requirements file.
I know how to enqueue in using the UI. I'm trying to do it programatically.
VexedCat68 , this is really simple ! 🙂
Add from clearml import Task and task=Task.init() to your script Run the script In the UI: Clone the experiment by right clicking it and selecting clone (or from the hamburger menu) Enqueue experiment in UI: Right click on the experiment and select enqueue 🙂