Hello everyone, Quick question regarding the API - what would be the best way to trigger a new run of an existing pipeline with an API call?
9 months ago
Nice one. How is he funding this?
Best way imo is to set-up ClearML Server on a cloud machine (or go for paid, hosted, Enterprise version) and use the machines with RTX6000 as ClearML agents that will run pipelines (once you set them up - isn't a simple job for serious things, dockerized workflows etc.). Make sure the pay is good, prepare a strategy and plan for this and you can at least get some insanely valuable experience in this interesting-boss-job.
PS: Do you know what was the price for each RTX and where he got them from?
When I was setting up the ClearML agent it asked for a default storage path, which I pointed to s3 and it works as expected.
clearml-agent init
# Default Task output_uri. if output_uri is not provided to Task.init, default_output_uri will be used instead.
sdk.development.default_output_uri="s3:..."
Is this what you have in mind?