HarebrainedBear62 this is what I have.
clearml-data will store all the files for you, and version the entire thing, make is a breeze to abstract the dataset from the code. Querying data is available using Apache Drill (though currently it is still not built into the platform, but we are planning to get there soon) Since this is Image based data/meta-data, I know the paid tier of ClearML, has n additional dedicated data management solution specifically for images, with full ability to query meta-data and view images.See above, I would contact the Allegro people regrading (3) I think this would be the best fit.
wdyt?

We have separate label files for each image

So what will you query ?

Thanks AgitatedDove14 thanks for the info. Sure we can take a look later.

Hi HarebrainedBear62
What's the type of data ?

I see, let me check something 🙂

Images

Type of objects / Resolution /name of images

Where do you store those ?