Hi @<1562610699555835904:profile|VirtuousHedgehong97> , I think you can mount some shared folder between the ec2 instances to use as cache. ClearML hashes data so it can know if what it has in it's cache is relevant or not.
Answered
Hi, Is There Any Way To Mount An S3 Bucket To Worker Nodes For Some Specific Use Cases Like Data Streaming? If So, How Does Clearml Tackle Data Versioning?
Hi, is there any way to mount an S3 bucket to worker nodes for some specific use cases like data streaming? if so, how does ClearML tackle data versioning?
990 Views
1
Answer
one year ago
one year ago
Tags