I know how to enqueue in using the UI. I'm trying to do it programatically.
I recall being able to pass a script to the agent using the command line along with a requirements file.
VexedCat68 , this is really simple ! 🙂
Add from clearml import Task
and task=Task.init()
to your script Run the script In the UI: Clone the experiment by right clicking it and selecting clone (or from the hamburger menu) Enqueue experiment in UI: Right click on the experiment and select enqueue 🙂
Found it.
https://clear.ml/docs/latest/docs/guides/clearml-task/clearml_task_tutorial/
The second example here, executing a local script. I think that was it. Thank you for the help.
Basically, as soon as I get the trigger that a new dataset has been published, I want to pass the dataset id to the script as an cli argument and pass the code to the agent
I'll try to see how to use the sdk method you just shared
https://clear.ml/docs/latest/docs/references/sdk/task#taskenqueue
Is this what you're looking for?
Also you can enqueue it through the API
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksenqueue
So the api is something new for me. I've already seen the sdk. Am I misremembering sending python script and requirements to run on agent directly from the cli? Was there no such way?