Related to that,
Is it possible to do Dataset.add_external_files() with source_url and destination_url being two separate azure storage containers?

@<1556812486840160256:profile|SuccessfulRaven86> , you can specify different containers in clearml.conf

How to set that up inside clearml.conf or something else to know which credentials to load?

Yep got it working thanks.

Great, and can we specify an environment variable of ClearML that directly updates the clearml.conf file regarding the azure config or do something similar. I do not want to ask every engineer of my team to modify its clearml.conf file? @<1523701070390366208:profile|CostlyOstrich36> Thanks

you should be able to test your credential first using something like rclone or azure-cli

@<1556812486840160256:profile|SuccessfulRaven86> , I think this is because you don't have the proper permissions 🙂