The thing is, even on the community server, not all the datasets have automatic previews. So for the same code/dataset, some of the runs have previews and some of them don't.
@<1523701168822292480:profile|ExuberantBat52> Do you have pandas installed on your machine?
This is strange. Exactly same code works for me. What version of clearml are you using? What version is your server?
What if you add images to the dataset? Can you see them being previewed? @<1523701168822292480:profile|ExuberantBat52>
ProudElephant77 , I think you might need to finalize the dataset for it to appear
CostlyOstrich36 I have used ds.get_logger().report_image() in a loop in order to upload all the images from the dataset as previews. Then I called flush() , which returned True . However, the images are still not shown. Any ideas - how could I debug that?
I have been using them for a while, they've always had autopreviews.
I don't think datasets don't have visualization out of the box, you need to add these previews manually. Only HyperDatasets feature from the Scale & Enterprise versions truely visualizes all the data.
According to your code snippet there isn't any visualization add on top of the dataset
@<1523701070390366208:profile|CostlyOstrich36> It looks like this:
I am using the latest version clearml server and I am using version 1.9.1 for the sdk.
Here is the code that I am currently using:
if __name__ == "__main__":
# create clearml data processing task
dataset = Dataset.create(
dataset_name="palmer_penguins",
dataset_project="palmer penguins",
dataset_tags=["raw"]
)
dataset_path = "data/raw/penguins.csv"
# add the downloaded files to the current dataset
dataset.add_files(path=dataset_path)
# upload data to clearml server
dataset.upload(verbose=True)
# close the dataset
dataset.finalize(verbose=True)
This is a simple dummy example that I use for testing deployments of clearml server
Here is the output that I would expect:
Yes, I am using a virtualenv that has pandas and clearml installed.
How about when you view it in the datasets view? Also what version of clearml package do you have?