Found it.
https://clear.ml/docs/latest/docs/guides/clearml-task/clearml_task_tutorial/
The second example here, executing a local script. I think that was it. Thank you for the help.
Basically, as soon as I get the trigger that a new dataset has been published, I want to pass the dataset id to the script as an cli argument and pass the code to the agent
VexedCat68 , this is really simple ! 🙂
Add from clearml import Task and task=Task.init() to your script Run the script In the UI: Clone the experiment by right clicking it and selecting clone (or from the hamburger menu) Enqueue experiment in UI: Right click on the experiment and select enqueue 🙂
I recall being able to pass a script to the agent using the command line along with a requirements file.
I know how to enqueue in using the UI. I'm trying to do it programatically.
So the api is something new for me. I've already seen the sdk. Am I misremembering sending python script and requirements to run on agent directly from the cli? Was there no such way?
https://clear.ml/docs/latest/docs/references/sdk/task#taskenqueue
Is this what you're looking for?
Also you can enqueue it through the API
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksenqueue
I'll try to see how to use the sdk method you just shared