Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
10 Answers
2K Views
0 Votes 10 Answers 2K Views
More clarification on documentation (ClearML Data): > Dataset changes are stored using differentiable storage, meaning a version will store the change-set fr...
3 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Does the ClearML team still post updates in this channel when new ClearML versions come out? If not, what's the easiest way to keep track of various release ...
3 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
Also ubuntu 18.04 is losing support so everything in the image needs an update…
2 years ago
0 Votes
17 Answers
2K Views
0 Votes 17 Answers 2K Views
If I clone a task, I suppose all artifacts are not cloned with it, even if they are registered, right?
3 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Does ClearML exposes (even temporarily) the contents of e.g. sdk.aws.s3 to the relevant environment variables (i.e. AWS_SECRET_ACCESS_KEY )? Specifically, if...
3 years ago
0 Votes
10 Answers
2K Views
0 Votes 10 Answers 2K Views
Is there any way in the WebUI to search by task name? I see the search bar only goes through projects
3 years ago
0 Votes
13 Answers
2K Views
0 Votes 13 Answers 2K Views
We use environment variables in our clearml.conf , but those might only be available later down the line (after dotenv.load_dotenv is called). When those env...
3 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
... and yet another πŸ˜„ When using the UI with regex to search for experiments, due to the greedy nature of the search, it consistently pops up the "ERROR Fet...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
What could cause a queue to be recreated automatically? I experimented with the autoscaler with queue name foo , got it working, closed the autoscaler, delet...
3 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
What privileges/IAM role would the AWS autoscaler need?
3 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
If, for starters, I'd only like to use ClearML for logging purposes (that is, experiments run locally, and I report metrics, graphs, etc to ClearML). Do I st...
3 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
Any easy way to ensure the pipline (tasks + controller) are not hidden in the projects UI? EDIT: Apparently not; for the time being I created this https://gi...
2 years ago
0 Votes
18 Answers
2K Views
0 Votes 18 Answers 2K Views
What would be the best way to approach this flow? We have a configuration file that defines e.g. the project name to use in ClearML, alongside other experime...
3 years ago
0 Votes
16 Answers
2K Views
0 Votes 16 Answers 2K Views
We’re running clearml-agent on k8s and I first noticed some warnings from the pod about Python 3.6..? > /usr/lib/python3/dist-packages/secretstorage/dhcrypto...
2 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
I encountered a weird edge case with the AWS Auto-scaler, wondering if there are any solutions or if this is a known issue. Something as follows happened: Th...
3 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
The remote workers seem to insist on using old git credentials, even after I stopped them, updated the conf file, and restarted them using it. Are the creden...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
Getting a weird error on local setup for ClearML Server: 2022-03-30 08:07:07,932 - clearml.Task - ERROR - Action failed <500/0: tasks.get_all/v1.0 (mongo:270...
3 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
Weird encounter on macOS (local execution, rerunning after it failed - worked normally): Traceback (most recent call last): File "/Users/.../repositories/......
3 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
If we use a poetry queue and do not specify the agent.package_manager.poetry_version , will ClearML install/update anything? Asking because there are some is...
2 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
Is there a way to generate usage stats and reports for queues? For example, how often is a queue used, how much CPU does the queue consume when it's used, et...
3 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Are the docs broken? https://clear.ml/docs/latest/docs/release_notes/ver_1_7 gives me this
3 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
Soooo… the tooltip for some buttons in the WebUI hides the actual buttons πŸ€” Any quick fixes?
2 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Is there any way (or are there any plans) to include some view for datasets in the WebUI? One that is detached from the generating task?
3 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
3 years ago
0 Votes
9 Answers
2K Views
0 Votes 9 Answers 2K Views
Hey! Probably missed something, but I recently upgraded to 1.1.1, and I've just noticed that png artifacts are not displayed in the preview. Is this intentio...
4 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
One more follow-up still; we're trying to run non-GPU scaler, and I've finally sorted out subnet and security groups issues, only to run into this: Executing...
3 years ago
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
⚠️ ClearML version 1.8.1 had "fix" for the deferred init which introduces a bug btw, I've opened None to highlight this.
2 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Is there a way to force ClearML to first parse the config file, before running Task.init ? We’re relying in some code that the credentials in clearml.conf ar...
2 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Does ClearML have any suggestions on GPU and non-GPU AMIs for the AutoScaler? The two default ones in the documentation are either: Non-existent (too old) - ...
3 years ago
0 Votes
30 Answers
2K Views
0 Votes 30 Answers 2K Views
Is it possible to avoid the clearml-agent for local installations, and have the file server automatically use an S3 bucket? I've found https://clearml.slack....
3 years ago
Show more results questions
0 Pipelines Suddenly No Longer Appear In The Pipelines Tab, What Could/Should I Look Into? Edit: Using Latest Clearml (Agent, Server, Sdk), And Creating The Pipelines Via The Pipelinecontroller Sdk (

When I use the APIClient to fetch the tags for the project, I get an empty collection of system tags:

<projects.GetProjectTagsResponse: {
    "tags": [],
    "system_tags": []
}>
2 years ago
0 How Do I Stop A Zombie Agent?

Aw you deleted your response fast CostlyOstrich36 xD

Indeed it does not appear in ps aux so I cannot simply kill it (or at least, find it).
I was wondering if it's maybe just a zombie in the server API or similar

3 years ago
0 What Happens To File That Are Downloaded To A Remote_Execution Via Storagemanager? Are They Removed At The End Of The Run, Or Does It Continuously Increases Disk Space?

And yes, our flow would break anyway with the internal references within the yaml file. It would be much simpler if we could specify the additional files

3 years ago
0 Our Mac Users Are Having Some Issues. They Have Their Respective ~/Clearml.Conf, And Yet They Get: Clearml 1.1.5

I'm not sure; the setup is not unique to Mac.
Each user has their own .env file which is given to the code entry point, and at some point will be loaded with dotenv.load_dotenv() .
The environment variables are not set in code anywhere, but the clearml.conf uses them directly.

3 years ago
0 Hi There, I Used

JitteryCoyote63 yes exactly, sorry, I forgot to add the Task.get_task in my response. That's exactly what we do πŸ˜…

3 years ago
0 Clearml 1.3.2 I'M Running

I have selected the correct project indeed

3 years ago
0 We Use Environment Variables In Our

Would it also be loaded on e.g. Task.running_locally() ?

3 years ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

I can't seem to manage the first way around. If I select tasks in different projects, I don't get the bottom bar offering to compare between them

3 years ago
0 We’Re Running Clearml-Agent On K8S And I First Noticed Some Warnings From The Pod About Python 3.6..?

(in the current version, that is, we’d very much like to use them obviously :D)

2 years ago
0 Can Steps Be Removed From Pipelines, And/Or Can Pipelines Be Generally Modified Other Than Adding Steps To Them?

Yeah I will probably end up archiving them for the time being (or deleting if possible?).

Otherwise (regarding the code question), I think it’s better if we continue the original thread, as it has a sample code snippet to illustrate what I’m trying to do.

one year ago
0 Is There An Autoscaler Equivalent For K8S? That Is, A Service That Will Launch Pods Based On Incoming Requests?

Perfect, thanks for the answers Valeriano. These small stuff are missing from the documentation, but I now feel much more confident in setting this up.

2 years ago
3 years ago
0 For Some Reason The Agent Is Now Trying To Use Python 2.7 All Of A Sudden, Any Idea Why?

Yes; I tried running it both outside venv and inside a venv. No idea why it uses 2.7?

3 years ago
3 years ago
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

AgitatedDove14 The keys are there, and there is no specifically defined user in .gitmodules :
[submodule "xxx"] path = xxx url =I believe this has to do with how ClearML sets up the git credentials perhaps?

3 years ago
0 Hi Everyone, Quick Question Regarding Minio And Logging:

It is. Let me see what else I have set up for MinIO in configs, one moment

3 years ago
0 What Happens To File That Are Downloaded To A Remote_Execution Via Storagemanager? Are They Removed At The End Of The Run, Or Does It Continuously Increases Disk Space?

Am I making sense ?

No, not really. I don't see how task.connect_configuration interacts with our existing CLI? Additionally, the documentation for task.connect_configuration say the second argument is the name of a file, not the path to it? So something is off

3 years ago
0 Is There An Autoscaler Equivalent For K8S? That Is, A Service That Will Launch Pods Based On Incoming Requests?

We’re using karpenter (more magic keywords for me), so my understanding is that that will manage the scaling part.

2 years ago
0 When Using

Generally the StorageManager seems a bit slow, even a simple StorageManager.list(...) on a local path seems to take a long time

4 years ago
0 What Happens To File That Are Downloaded To A Remote_Execution Via Storagemanager? Are They Removed At The End Of The Run, Or Does It Continuously Increases Disk Space?

I guess it's mixed. If #340 is resolved, then this initializer task will be a no-op: detach, and init-close new tasks as needed.

3 years ago
4 years ago
0 How Can I Send A Composed Chunk Of Code For Remote Execution

So maybe summarizing (sorry for the spam):

  • Pipelines:- Pros: Automatic upload and serialization of input arguments
  • Cons: Clutter, does not support classes, cannot inject code, does not recognize environment when run from e.g. IPython- Tasks:- Pros: Tidier and matches original idea, recognizes environment even when run from IPython
  • Cons: Does not support classes, cannot inject code, does not automatically upload input arguments
one year ago
0 Can One Compare Experiments/Tasks From Different Projects? Edit: I Mean, I Can Manually Navigate To Some

Unfortunately I can't take a photo of not being able to compare tasks by navigating around the WebUI...

Does that clarify the issue CostlyOstrich36 ?

3 years ago
0 Is It Possible To Avoid The Clearml-Agent For Local Installations, And Have The File Server Automatically Use An S3 Bucket? I'Ve Found

~ is a bit weird since it's not part of the package (might as well let the user go through clearml-init ), but using ${PWD} works! πŸ‘ πŸ‘

(Though I still had to add the CLEARML_API_HOST and CLEARML_WEB_HOST ofc, or define them in the clearml.conf)

3 years ago
Show more results compactanswers