I have a question about clearml-data , from what I observed (I just started playing with it) it internally stores a compressed representation of a dataset. D...
2 years ago
Hi there! Is there any way to boost creating SHA2 hashes during clearml-data add ? It uses only one CPU core, could I use multiprocessing somehow?
2 years ago
Another qn, is clearml-data analogous to a feature-store
2 years ago
Hey, I tried to use clearml-data with PascalVOC2007 and something weird happened: $ wget -q $ tar xf VOCtrainval_06-Nov-2007.tar $ cd VOCdevkit/VOC2007 $ ls ...
2 years ago
Hi, I'm trying to deploy clearml server to my local ubuntu. Every process works fine but when I'm trying to access to clearml-fileserver (by clearml-data cre...
2 years ago
Hi, I tried to make a clearml Dataset using the clearml-data and MNIST but I always get a 413 Request Entity Too Large We have our own ClearML deployment on ...
3 years ago
Does anyone know if you can export a dataset (ML) directly from a database to the clearml-data Or have to export out as csv first ?
3 years ago
Hi, I have this issue with clearml datasets. Do you know hot to solve it? (vslam38) quetalasj@quetalasj-Swift-SF514-51:~/PycharmProjects/vslam-experiment$ cl...
3 years ago
I am currently running a Clearml-server and have few questions about Dataset management. https://clear.ml/docs/latest/docs/getting_started/ds/best_practices#...
3 years ago
Hi quick question. If i use clearml-data to upload a dataset to a remote folder which is mounted at, say, /mnt/something/data, when i use Dataset.get_local_c...
3 years ago
clearml-data - incremental changes and hashing on per-file basis? Hi! In our team, we are now also looking at clearml-data . The integration with cloud backi...
3 years ago
Hi, i'm running the following and encountering some SSL errors. SSL_CERT_FILE=ca.crt clearml-data upload --id 12314jhg42342j4j --storage clearml.storage - ER...
Hi, is there a way I can supply credentials to clearml-data (cli and python) without going thru the ClearML.conf?
3 years ago
Hi! trying to create a dataset (we’re running it on an on-prem clearml server), I run the following command: clearml-data add --files data_20210613/and get t...
3 years ago
Hi, I'm trying to upload my dataset via clearml-data CLI, but I'm facing this error: Pending uploads, starting dataset upload to Uploading compressed dataset...
3 years ago
I read that clearml-data stores only the difference between versions. Is this only working for text files or also for big files like medical imaging?
3 years ago
Hello everyone! Maybe can guide me to the documentation for this. I want to access existing artifacts, e.g. model weights, that I saved during a task. I want...
3 years ago
Is setting up ClearML server on same machine that is supposed to be our GPU worker a good idea? I wanted to have every dataset locally using clearml-data CLI...
3 years ago
I found the following config parameter (related to clearml-data I guess?): sdk.storage.cache.size.cleanup_margin_percent ( integer ) The percentage of cache ...
3 years ago
Hi, i am trying to use clearml-data to upload my data to S3, which is password protected. How should i indicate the credentials after i set --storage s3://.....
3 years ago
Hi, i am trying to understand clearml-data and only found this piece of article explaining it. https://github.com/allegroai/clearml/blob/master/docs/datasets...
3 years ago
I can't seem to find documentation on clearml-data except this: https://github.com/allegroai/clearml/blob/master/docs/datasets.md Is there more somewhere? Do...
3 years ago
I suppose the Data Management & Lineage (is similar to clearml-data in the open source version) and if so, what is this Hyperdatasets function (Not really ge...
3 years ago
Hello Community, I had a query regarding clearml-data , can the dataset be queried against some metadata using UI and/or CLI ?
3 years ago
Hi, I have a question about clearml-data . It looks the CLI remembers "previously created/accessed dataset". Where is that information saved? Or how can I re...
3 years ago
Quick question on the clearml-data package, Can I add files to a dataset from google storage instead of having to download them?
3 years ago