Hello! Is there any way to use original files in cleaml datasets ? I have batch of tar archives and want to create dataset from them, however clearml compresses them. I tried to use compression = None , but it didnt help
dataset.upload(verbose=True, output_url='
', compression = None,chunk_size = -1 )
Hi @<1523702307240284160:profile|TeenyBeetle18> , if they are already on GS then you can use add_external_files to log them.
None
What do you think?
Seems like it does not let to use ability of clearml to track and version datasets. I mean, I can't create next version of dataset from dataset with external files
