Hi @<1664079296102141952:profile|DangerousStarfish38> , you would need to download the dataset to local using get_local_copy
I suggest going through the docs:
None
@<1523701070390366208:profile|CostlyOstrich36>
I have a follow-up question for the first question.
I initiated a task, did get_local_copy of a dataset,
and then I executed and finished the task (training).
From web UI, I don't see any information saying that the task and dataset are related or linked.
What should I do to connect or link those two or find the information about it?
Hi @<1664079296102141952:profile|DangerousStarfish38> , regarding your first question - You need to finalize the dataset.
Regarding the second, my suggestion would be to expose the selected dataset via a hyperparameter. One example would be through argparser
@<1523701070390366208:profile|CostlyOstrich36>
Actually, I've got another questions about dataset!
I tried add_external_files from AWS S3 as a simple test.
And in web UI, it says it's been uploading for 16hours now.
The zip file I tried to upload is under 50MB.
Is something wrong here?
Also, I'm wondering if I could add files that are not "zipped" files, for example a directory containing various files.