@<1523701070390366208:profile|CostlyOstrich36> It looks like this:
Looping in @<1523703436166565888:profile|DeterminedCrab71> & @<1523701435869433856:profile|SmugDolphin23> for visibility
Thanks a lot, I will have a look at that!
Actually, datasets should have an automatic preview...
CostlyOstrich36 Do you have any idea how I could debug that?
This is strange. Exactly same code works for me. What version of clearml are you using? What version is your server?
The thing is, even on the community server, not all the datasets have automatic previews. So for the same code/dataset, some of the runs have previews and some of them don't.
@<1523701070390366208:profile|CostlyOstrich36> I am facing the same issue:
{"meta":{"id":"90841d05dfb1431a8d9dfc6bfdb39f9e","trx":"90841d05dfb1431a8d9dfc6bfdb39f9e","endpoint":{"name":"events.debug_images","requested_version":"2.23","actual_version":"2.7"},"result_code":200,"result_subcode":0,"result_msg":"OK","error_stack":"","error_data":{}},"data":{"metrics":[]}}
CostlyOstrich36 WebApp: 1.9.1-312 • Server: 1.9.1-312 • API: 2.23
Can you please paste the response from events.debug_images
?
@<1523701070390366208:profile|CostlyOstrich36> Hi John, I have posted that in the screenshot above. Isn't that what you meant?
The above output is on the clearml community server
So I added the snippet above to the code,
and now the preview for the first 10 rows shows up. However, the automatic preview is still not working.
I am using the latest version clearml server
and I am using version 1.9.1
for the sdk.
Here is the code that I am currently using:
if __name__ == "__main__":
# create clearml data processing task
dataset = Dataset.create(
dataset_name="palmer_penguins",
dataset_project="palmer penguins",
dataset_tags=["raw"]
)
dataset_path = "data/raw/penguins.csv"
# add the downloaded files to the current dataset
dataset.add_files(path=dataset_path)
# upload data to clearml server
dataset.upload(verbose=True)
# close the dataset
dataset.finalize(verbose=True)
This is a simple dummy example that I use for testing deployments of clearml server
Here is the output that I would expect:
I have been using them for a while, they've always had autopreviews.
I am currently running the scripts on WSL ubuntu
Please check what you get for events.debug_images
in network section of developer tools (F12) when trying to view the preview in the dataset
@<1523701168822292480:profile|ExuberantBat52> , did you add debug samples in a similar fashion? What version of the clearml
sdk are you using? Also what server?
I don't think datasets don't have visualization out of the box, you need to add these previews manually. Only HyperDatasets feature from the Scale & Enterprise versions truely visualizes all the data.
According to your code snippet there isn't any visualization add on top of the dataset
Above is the response for the events.debug_images
CostlyOstrich36 Unfortunately that didn't helped 😞
ProudElephant77 , can you please add a code snippet of what you did?
ProudElephant77 , I think you might need to finalize the dataset for it to appear
` from clearml import Dataset
IMG_PATH = "/home/mfb/Temp/sample-ds/50-ok.jpg"
Create dataset and add sample image
ds = Dataset.create(dataset_name="Test", dataset_project="Dataset-Test")
ds.add_files(path=IMG_PATH)
ds.upload()
Add and report image
logger = ds.get_logger()
logger.report_image("image", "sample image", iteration=0, local_path=IMG_PATH)
logger.flush()
Finalize the dataset
ds.finalize() `
Yes, I am using a virtualenv that has pandas and clearml installed.