Hello. In which YAML files for Kubernetes and where should I specify the AWS file_server and credentials for clearml-agent so that when running tasks remotel...
11 months ago
SlipperyRaven39
1
Question,
4
Answers
Active since 15 December 2023
Last activity
11 months ago
Reputation
0
Badges 1
4 × Eureka!
0
Hello.
In Which Yaml Files For Kubernetes And Where Should I Specify The Aws File_Server And Credentials For Clearml-Agent So That When Running Tasks Remotely In The Queue, The Artifacts Are Saved In The S3 Bucket?
@<1523702000586330112:profile|FierceHamster54> Should we write to some other chat?
11 months ago
0
Hello.
In Which Yaml Files For Kubernetes And Where Should I Specify The Aws File_Server And Credentials For Clearml-Agent So That When Running Tasks Remotely In The Queue, The Artifacts Are Saved In The S3 Bucket?
Hello @<1523702000586330112:profile|FierceHamster54>
We specified credantials of s3 bucket in clearml.fileserverSecret and clearml.fileserverKey in values.yml of clearml and specified adress of s3 bucket in fileServerUrlReference in values.yml of clearml-agent.
When we run the task remotely we get an error:
clearml.storage - ERROR - Failed creating storage object s3:// Reason: Missing key and secret for S3 storage access ( s3://)
clearml.metrics - WARNING - Failed uploading to s3:// ...
11 months ago
0
Hello.
In Which Yaml Files For Kubernetes And Where Should I Specify The Aws File_Server And Credentials For Clearml-Agent So That When Running Tasks Remotely In The Queue, The Artifacts Are Saved In The S3 Bucket?
@<1523702000586330112:profile|FierceHamster54> sorry, we got the same error ((
from clearml import Task
task = Task.init(project_name='example', task_name='task template')
task = Task.current_task()
task.setup_aws_upload(bucket="bucket",
host="host:port",
key="key",
secret="secret",
multipart=True, secure=False,verify=True)
task.execute_remotely(queue_name='default')
task.upload_artifact("list...
11 months ago