Where should i put this line? inside the pipeline function?

thanks

I am getting this error:
clearml.task - WARNING - Requirement ignored, Task.add_requirements() must be called before Task.init()

no, it work if the tag exist and i do other change to the task. but if the task does not have the task and I just add the tag the event is not trigger.

I just use:
dataset = Dataset.create( dataset_name=dataset_name, dataset_project=dataset_project, # parent_datasets=[d1], )

Thanks, (works when using sdk 1.4.1)

Hi SuccessfulKoala55
Yes, it seems version v1.6.2rc0 solved the problem.

I try to install package from our github

I do not remember exactly all the steps we did, but with the help of clearml team we found solution by adding:
Task.add_requirements((…)outside the pipeline code

where my configuration is to use gcp storage with gs://…..

Thanks

not getting any error when uploading.
I use “add_external_files” so it is not really uploading the file just the dataset info

Thanks for your help

ok,
just a small question, is the parameter “defaultContainerImage” tell the glue agent which image to use for the spawned agent ?

I use the decorators method and there is no “packages” param to the pipeline decorator, i added it to the task decorator “packages” param but it didn’t help

When updating task with that tag the event is triggered but on the first time adding the tag it does not work.

thanks

Thanks David,
Yes, I have the issue in pipelines and I use the decorators method for the pipelines.
The pipeline include scripts from several files.
If I put the import in the pipeline main file it works, but if the import is in another file (which is imported by the pipeline main file) it does not work.
The import is needed in one of the tasks (which is also on a different file) - I tried put ting the import on the top of the task file and also inside the task method but it didn’t work.
Also...

no problem, you and your team are very responsive and help us a lot.

Hi,
res is None but the trigger works when doing other changes so i guess it was added.

Hi

Works locally but not when running inside agent.
I found that adding the:
Task.add_requirements('protobuf', '<=3.20.1')before the pipeline decorator it works

Hi,
issue: https://github.com/allegroai/clearml/issues/714

Immediately after i use “add_external_files” i see it changed the original file link and removed from it the “ gs://bucket_name ”

I just downgraded to 1.7.2, will wait for the fix.
Thanks for the workaround.

For now we store only one file in a dataset.

for now we used fixed number of cpu agents but it will be better if it was dynamic with glue agent

Not sure I understand, you are saying I should not create user credentials and add them in values.yaml at secret.credentials.apiserver and secret.credentials.tests. ?

but the system account key and secret can’t be the same for every installation, no? i need to generate specific one for my installation, no?

I will check it and update you