Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
ShortElephant92
Moderator
9 Questions, 20 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

20 × Eureka!
0 Votes
7 Answers
521 Views
0 Votes 7 Answers 521 Views
Hi, Relating To The
Hi, relating to the Dataset SDK, is there a way to add_external_files with a very large number of urls that are not in the same S3 folder without running int...
one year ago
0 Votes
2 Answers
693 Views
0 Votes 2 Answers 693 Views
Hello, For Datasets, Is There An Explanation Somewhere As To How The Debug Samples Are Created? I'M Not Entirely Sure Which Permission It Uses If The Dataset Is Stored In A Private Bucket
Hello, for Datasets, is there an explanation somewhere as to how the Debug Samples are created? I'm not entirely sure which permission it uses if the dataset...
one year ago
0 Votes
2 Answers
536 Views
0 Votes 2 Answers 536 Views
Hey Everyone! When Adding Files To A Dataset, Is There A Way To
Hey everyone! When adding files to a dataset, is there a way to avoid storing it on the clearml-server too? I am currently also storing it in a defined exter...
one year ago
0 Votes
3 Answers
533 Views
0 Votes 3 Answers 533 Views
Hello, Another Question
Hello, another question 😅 , does the Open Source version of ClearML-Server support SSO for authentication?
one year ago
0 Votes
7 Answers
617 Views
0 Votes 7 Answers 617 Views
Hello! When Trying To Use Clearml Datasets With Google Cloud Storage With The Authorized User Credentials It Will Fail And Say Some Fields Are Missing From The Json. This Isn'T An Issue If The User Is Using A Service Account Json Key, Is A Service Account
Hello! When trying to use ClearML Datasets with Google Cloud Storage with the authorized user credentials it will fail and say some fields are missing from t...
one year ago
0 Votes
5 Answers
629 Views
0 Votes 5 Answers 629 Views
Hi, Is There A Way To Restrict Users Uploading Their Dataset Data To The Server'S File_Server Instead Of An External Location? Specifically Since The Image Is 100Gb I Think And We Might Be Dealing With Far More Data Than That. This Is As A Clearml-Server
Hi, is there a way to restrict users uploading their Dataset data to the server's file_server instead of an external location? Specifically since the image i...
one year ago
0 Votes
7 Answers
554 Views
0 Votes 7 Answers 554 Views
Hi, Is It Possible To Migrate A Dataset From A Self Hosted Clearml Solution To The Clearml Hosted Solution?
Hi, is it possible to migrate a dataset from a self hosted ClearML solution to the ClearML hosted solution?
one year ago
0 Votes
2 Answers
635 Views
0 Votes 2 Answers 635 Views
Hello, Are There Any Network Requests That Go From The Self-Hosted Solution To Clearml The Company (For Analytics Use, Etc.)?
Hello, are there any network requests that go from the self-hosted solution to ClearML the company (for analytics use, etc.)?
one year ago
0 Votes
3 Answers
572 Views
0 Votes 3 Answers 572 Views
Hello, As An Admin Of My Own Clearml-Server, Can I Revoke Api Tokens? Thank You!
Hello, as an Admin of my own ClearML-Server, can I revoke API tokens? Thank you!
one year ago
0 Hi, Relating To The

If the solution is to create a PR I can definitely do that too!

one year ago
0 Hi, Relating To The

AgitatedDove14 I have tried that case, however if you go in the implementation you can see what actually happens is a for loop that will continuously call the method. This is a problem because it will update my external state.json file over 100k times, and the cloud provider will block my requests after around 40 😅

one year ago
0 Hi, Relating To The

The use case is that we want a dataset of over 100k S3 images and they are scattered all over our bucket due to how we organise those images. If I send an array of URLs as the source_url it will eventually fail after around 40 due to the GCS rate limit for updating the state.json .

one year ago
0 Hi, Relating To The

I am adding a 100k S3 images that are not in the same folder and I can't move them in S3. So I have an list of S3 links, not a folder unfortunately.

one year ago
0 Hello, For Datasets, Is There An Explanation Somewhere As To How The Debug Samples Are Created? I'M Not Entirely Sure Which Permission It Uses If The Dataset Is Stored In A Private Bucket

Thank you SmugDolphin23 !

one year ago
0 Hey Everyone! When Adding Files To A Dataset, Is There A Way To

Thank you CostlyOstrich36 !

one year ago
0 Hello, Another Question

Just saw on the Pricing page that it does not

one year ago
0 Hello, Another Question

Thanks AgitatedDove14 !

one year ago
0 Hello, As An Admin Of My Own Clearml-Server, Can I Revoke Api Tokens? Thank You!

Yes I am, I found a way by modifying the user in MongoDB. Is there another way?

one year ago
0 Hello! When Trying To Use Clearml Datasets With Google Cloud Storage With The Authorized User Credentials It Will Fail And Say Some Fields Are Missing From The Json. This Isn'T An Issue If The User Is Using A Service Account Json Key, Is A Service Account

I opened a PR for it, it has a bug attached to it too: https://github.com/allegroai/clearml/pull/841

one year ago
0 Hello! When Trying To Use Clearml Datasets With Google Cloud Storage With The Authorized User Credentials It Will Fail And Say Some Fields Are Missing From The Json. This Isn'T An Issue If The User Is Using A Service Account Json Key, Is A Service Account

For context, the google cloud storage SDK allows an authorized user credentials. This makes it a bit awkward for our developers already using their creds.

one year ago
0 Hello! When Trying To Use Clearml Datasets With Google Cloud Storage With The Authorized User Credentials It Will Fail And Say Some Fields Are Missing From The Json. This Isn'T An Issue If The User Is Using A Service Account Json Key, Is A Service Account

Hi AgitatedDove14 I found the possible bug, I'll open a PR for it and we can discuss! It has to do with how we pass credentials to the GCS client.

one year ago
0 Hello! When Trying To Use Clearml Datasets With Google Cloud Storage With The Authorized User Credentials It Will Fail And Say Some Fields Are Missing From The Json. This Isn'T An Issue If The User Is Using A Service Account Json Key, Is A Service Account

The error in question:
2022-12-01 17:33:03,687 - clearml.storage - ERROR - Failed creating storage object gs://<my_bucket> Reason: Service account info was not in the expected format, missing fields token_uri, client_email.

one year ago
0 Hi, Is There A Way To Restrict Users Uploading Their Dataset Data To The Server'S File_Server Instead Of An External Location? Specifically Since The Image Is 100Gb I Think And We Might Be Dealing With Far More Data Than That. This Is As A Clearml-Server

Oh sweet! Is there instructions on how to disable the fileserver service?

one year ago
0 Hi, Is There A Way To Restrict Users Uploading Their Dataset Data To The Server'S File_Server Instead Of An External Location? Specifically Since The Image Is 100Gb I Think And We Might Be Dealing With Far More Data Than That. This Is As A Clearml-Server

Thank you SuccessfulKoala55 !

one year ago
0 Hi, Is It Possible To Migrate A Dataset From A Self Hosted Clearml Solution To The Clearml Hosted Solution?

AgitatedDove14 I just wanted to come back to the thread to let you know you can just copy the /opt/clearml/data and /opt/clearml/config over from the one VM to another and it worked fine!

one year ago
0 Hi, Is It Possible To Migrate A Dataset From A Self Hosted Clearml Solution To The Clearml Hosted Solution?

That would only work for the data itself no? I don't know how I would be able to get the description and name?

one year ago
0 Hi, Is It Possible To Migrate A Dataset From A Self Hosted Clearml Solution To The Clearml Hosted Solution?

If I ever write one I'll add it to the examples

one year ago
0 Hi, Is It Possible To Migrate A Dataset From A Self Hosted Clearml Solution To The Clearml Hosted Solution?

Yeah I can write a script to transfer it over, I was just wondering if there was a built in feature. I am just asking as it would be possible in the future we go from self hosted to hosting with ClearML and how we would transfer our currently existing datasets. All good though!

one year ago
0 Hello, Are There Any Network Requests That Go From The Self-Hosted Solution To Clearml The Company (For Analytics Use, Etc.)?

Thank you AgitatedDove14 !

one year ago