Hi @<1523701070390366208:profile|CostlyOstrich36> , I took a look at the CLI & SDK documentation for the Dataset class, but it didn't look like I had an option to control the preview. Am I looking at the wrong place? Apologies if I missed something from the documentation.
Hi @<1523701132025663488:profile|SlimyElephant79> , to answer your questions:
-
Does ClearML store any dataset outside of this S3 storage (and local storage) for preview or compression purposes?Some preview data might be stored inside mongodb (if it's a table for example). This of course can be disabled so no data/previews are exposed to the ClearML backend.
-
Are any data packets related to model or data versioning routed through the API server? (We are pretty confident it shouldn't, but just want to be sure from a security standpoint)Nothing is ever routed via the API server. Actions are always performed by the SDK and the backend only stores references to the data i.e. links