Reputation
Badges 1
383 × Eureka!Hey TimelyPenguin76 - i am just using the helm chart and haven’t done any setup on top of that. the agentservices is running as is from the helm chart
Ah ok. Kind of getting it, will have to try the glue mode
What happens if I do blah/dataset_url ?
Would like to get to the Maturity Level 2 here
Without some sort of automation on top feels a bit fragile
It might be better suited than execute remotely for your specific workflow
Exactly
I get other things from the project like the dataset
AgitatedDove14 - any thoughts?
What could those triggers be?
GrumpyPenguin23 both in general and clearml 🙂
or atleast a way to register these
Which would also mean that the system knows which datasets are used in which pipelines etc
Is there a good way to get the project of a task?
do not limit the clone on execute_remotely,
Yes
How is clearml-session intended to be used?
More interested in some way for doing this ssytem wide
It’s a task, it’s running in context of a project, but I don’t have a way to get the project name
barebones, can a step in a pipeline refer to a previous step by name and get it?
I am going to be experimenting a bit as well, will get back on this topic in a couple of weeks 🙂
I am using the clearml-agent from pypi version
Is there some doc or relevant code on exactly what's happening? The behaviour has been random
AgitatedDove14 - is my understanding right that we have to call pipe.wait() ?
Essentially, if I have a dataset on which I am performing transformations and then creating other downstream datasets