Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
OutrageousSheep60
Moderator
27 Questions, 111 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

103 × Eureka!
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Hi, Is it possible to run ffmpeg within clearml server as a multi processing (as in this example ?) assuming that the ffmpeg will run using a subprocess comm...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi, I've added external links to the a dataset In the UI I can see that the dataset has the property of Link count with the correct number. But where can I s...
2 years ago
0 Votes
19 Answers
1K Views
0 Votes 19 Answers 1K Views
Hi, I'm trying to run clearml-agent in docker mode - however I'm having trouble saving the artifacts. 2022-08-25 05:06:21,820 - clearml.storage - ERROR - Fai...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Hi,
Hi, What would be the correct way to check the hash of a file before using https://clear.ml/docs/latest/docs/references/sdk/dataset/#add_files ? is there a b...
2 years ago
0 Votes
11 Answers
1K Views
0 Votes 11 Answers 1K Views
Hi, We have recently upgraded to > WebApp: 1.6.0-213 • Server: 1.6.0-213 • API: 2.20 I have some issues: I'm trying to delete a project - and although I don'...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi Another issue regarding dataset whenever preview ing the dataset (which is in a parquet tabular format) the browser automatically downloads a copy of the ...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi i'm trying to finalize a dataset, but although the finalize(auto_upload=True) completes successfully (see image) - But the dataset is still in an uploadin...
one year ago
0 Votes
5 Answers
1K Views
0 Votes 5 Answers 1K Views
Hi, We are trying to understand when the auto-logging parameters configuration. from the https://github.com/allegroai/clearml/blob/master/examples/frameworks...
3 years ago
0 Votes
9 Answers
2K Views
0 Votes 9 Answers 2K Views
Hi, We have a use case that we would like to upload a local folder into the cloud AS-IS - without compressing or breaking it up into chunks. I tried running ...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi, Is there a way to instantiate a clearml-task while providing it a Dockerfile that it needs to build prior to executing the task? I know that there is a a...
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Hi Community, We are having an issue connecting our clearml server via code When I connect via a web browser - there is no problem . When trying to connect v...
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi, working with clearml 1.6.4 what is the correct way to list all the dataset s within a specific project ?
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi, I have a question regarding the Dataset UI (chart helm version 4.1.3 )- WebApp: 1.6.0-213 • Server: 1.6.0-213 • API: 2.20. In order to create a Dataset y...
2 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
Hi, I'm setting a USER PROPERTIES using the following code task.set_user_properties(MY_THRESHOLD={"type": int, "value": 0.85}, )Whet is the correct way to re...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Question: How can we run a task in a docker container without having to configure it manually? Assumptions with ClearML Agent: To run an experiment using Cle...
one year ago
0 Votes
24 Answers
1K Views
0 Votes 24 Answers 1K Views
Hi, Question regarding clearml-agent How do we delete a daemon? There is an option to stop a daemon service - but what is the method to delete a specific wor...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Hi, Newbe question in ClearML Data Assuming my files are already in a bucket on the cloud - What would be the best practice to create a dataset and register ...
2 years ago
0 Votes
17 Answers
1K Views
0 Votes 17 Answers 1K Views
Hi, I'm following the instructions for https://clear.ml/docs/latest/docs/guides/ide/remote_jupyter_tutorial . after > Launch interactive session [Y]/n? y I"m...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi, I'm running Dataset.list_datasets() (Version: 1.6.4) and I can't see all the Datasets that I see in the GUI. Any suggestions?
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Hi We are getting the following error when we are trying to run a task on our on premis clearml-agent ( version 1.3.0) cloning: git@github.com:XXXX/sample.re...
2 years ago
0 Votes
23 Answers
1K Views
0 Votes 23 Answers 1K Views
Hi, We have started to use clearml using the https://clear.ml/docs/latest/docs/deploying_clearml/upgrade_server_kubernetes_helm , and trying to understand ho...
gcp
3 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi, I'm looking for an example show how clearml dataset is consumed by sklearn pipeline or pytorch datapipe. e.g. since pytorch uses torch datasets, can we w...
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Hi, I'm running clearml==1.8.4rc0 When creating a Dataset with the following code - the dataset that is created includes ALL the files within the bucket and ...
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Hi, Question regarding the command > clearml-agent list Were do you define the company and user that is running the Worker ? Looking at the https://clear.ml/...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi, How can I get the remote URI of a Dataset (assuming it is GS or S3). Do I need to combine the get_default_storage() with something? Since some datasets a...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hi, Is there a way to add the sdk https://clear.ml/docs/latest/docs/configs/clearml_conf#sdkgooglestorage parameters when setting the https://github.com/alle...
3 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
Hi, What would be the best way to save a pandas.DataFrame as an https://allegro.ai/clearml/docs/rst/references/clearml_python_ref/task_module/task_task.html?...
3 years ago
0 Hi I'M Trying To Finalize A Dataset, But Although The

upgrading to 1.12.1 didn't help
I think the issue is that when I create the dataset - i used

use_current_task=True,

If I change it to

use_current_task=False,

then it finalizes

one year ago
0 Hi, Question Regarding

Well it seems that we have similar https://github.com/allegroai/clearml-agent/issues/86
currently we are just creating a new worker and on a separate queue

2 years ago
0 Hi, What Would Be The Best Way To Save A Pandas.Dataframe As An

CostlyOstrich36 - but we will use any method that will allow us to save the files as parquet.
We are not yet using clearml Dataset - i'm not sure if this is a solution

3 years ago
0 Hi, I'M Following The Instructions For

AgitatedDove14 -
I also tried to https://github.com/allegroai/clearml-session
running the session within docker but got the same error

clearml-session --docker

--git-credentials

(there is a typo in git - --git-credent ila s -> --git-credent ials)
and still got the same error

clearml_agent: ERROR: Can not run task without repository or literal script in script.diff

2 years ago
0 Hi, Is There A Way To Add The Sdk

TimelyPenguin76 - do you have any suggestions?

3 years ago
0 Hi, I'M Trying To Run

i've doubled checked the Path- and it is correct

2 years ago
0 Hi, I'M Trying To Run

How do you do so?
can't find it under
clearml-agent daemon -h

2 years ago
0 Hi We Are Getting The Following Error When We Are Trying To Run A Task On Our On Premis

Hi SweetBadger76 -
I'm I misunderstanding how this tests worker runs?

2 years ago
0 Hi, I'M Trying To Run

Thx - it worked!
BTW - maybe it worth while to add this comment in the ClearML Agent daemon documentation - that when ever you update the clearml.conf you need to
clearml-agent daemon --stop recreate all the daemonclearml-agent daemon ....

2 years ago
0 Hi, I'M Following The Instructions For

I'm checking the possibility of our firewall between the clearml-agent machine and the local computer running the session

2 years ago
0 Hi, I'M Following The Instructions For

Hi AgitatedDove14
OK - the issue was the firewall rules that we had.

Now both of the jupyter lab and vscode servers are up.

But now there is an issue with the Setting up connection to remote session

After the

Environment setup completed successfully
Starting Task Execution:
ClearML results page:

https://app-clearml.XXXX/projects/XXXXXXXXXX/output/log

There is a WARNING

clearml - WARNING - Could not retrieve remote configuration named 'SSH'...

2 years ago
0 Hi, We Have Started To Use Clearml Using The 

Feeling that we are nearly there ....
One more question -
Is there a way to configure Clearml to store all  the  artifacts    and the  Plots   etc. in a bucket instead of manually uploading/downloading the artifacts from within the client's code?
Specifying the output_uri in Task.init saves the the checkpoints, what about the rest of the outputs?
https://clear.ml/docs/latest/docs/faq#git-and-storage

3 years ago
0 Hi Another Issue Regarding Dataset

CostlyOstrich36 do you need any additional information?

2 years ago
0 Hi Another Issue Regarding Dataset

here is a video of the steps

2 years ago
0 Hi, Question Regarding The Command

ClearML key/secret provided to the agent

When is this provided? Is this during the build ?

2 years ago
0 Hi, Question Regarding

CLEARML-AGENT version 1.2.2

2 years ago
0 Hi, Is There Any Way To Upload Data To A Clearml Dataset Without Compression At All? I Have Very Small Text Files That Make Up A Dataset And Compression Seems To Take Most Of The Upload Time And It Provide Almost No Benefits W.R.T Size

Hi HugeArcticwolf77
I'v run the following code - which uploads the files with compression, although compression=None

ds.upload(show_progress=True, verbose=True, output_url='

', compression=None)
ds.finalize(verbose=True, auto_upload=True)

Any idea way?

2 years ago
0 Hi, We Have A Use Case That We Would Like To Upload A Local Folder Into The Cloud

In order to create a webdataset we need to create tar files -
so we need to unzip and then recreate the tar file.
Additionally when the files are in GCS in the raw format you can easily review them with the preview (e.g. a wav file can be directly listened within the GCP console - web browser).
I think the main difference is that I can see a value of having access to the raw format within the cloud vendor and not only have it as an archive

2 years ago
0 Hi, Question Regarding

Distributor ID: Ubuntu
Description: Ubuntu 20.04.4 LTS
Release: 20.04
Codename: focal

2 years ago
0 Hi, I'M Trying To Run

google.storage { credentials = [ { bucket: "clearml-storage" project: "my-project" credentials_json: "/path/to/creds.json" }, ] }No - just emulating - it is more of /home/... /creds.json

2 years ago
0 Hi, We Have Started To Use Clearml Using The 

But this is not on the pods, isn't it? We're talking about the python code running from COLAB or locally...?

correct - but where is the clearml.conf file?

3 years ago
0 Hi, Question Regarding

Strange
I ran
clearml-agent daemon --stopand after 10 min I ran
clearml-agent listand I still see a worker

2 years ago
0 Hi, Question Regarding The Command

Looking in the repo I was not able to see an example - only reference to https://github.com/allegroai/clearml/blob/b9b0a506f35a414f6a9c2da7748f3ec3445b7d2d/docs/clearml.conf#L13 - I just need to add company.id or user.id in the credential dict?

2 years ago
0 Hi, I'M Trying To Run

Btw -after updating clearml.conf do I need to restart the agent?
I can't see the additional tab under https://clearml.slack.com/archives/CTK20V944/p1658199530781499?thread_ts=1658166689.168039&cid=CTK20V944 , and I reran the task and got the same error

2 years ago
0 Hi, Is It Possible To Run

@<1523701205467926528:profile|AgitatedDove14> -
I'm getting the following error when running the following code within the mp_worker

command = ["ffmpeg","-i",f"{url}","-vcodec","libx264", "output.mp4"]
subprocess.run(command, stderr=subprocess.STDOUT)

TypeError: fork_exec() takes exactly 21 arguments (17 given)

Any suggestions?

2 years ago
0 Hi, Question Regarding

not sure I understand
running
clearml-agent listI get
`
workers:

  • company:
    id: d1bd92...1e52b
    name: clearml
    id: clearml-server-...wdh:0
    ip: x.x.x.x
    ... `
2 years ago
Show more results compactanswers