Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
UnevenDolphin73
Moderator
106 Questions, 749 Answers
  Active since 10 January 2023
  Last activity one month ago

Reputation

0

Badges 1

662 × Eureka!
0 Votes
30 Answers
581 Views
0 Votes 30 Answers 581 Views
Since v1.4.0, our StorageManager.download_folder(..., local_folder='./') is failing - we've had to revert back to 1.3.2. I saw the changelist includes a fix ...
one year ago
0 Votes
26 Answers
573 Views
0 Votes 26 Answers 573 Views
I have some code that launches ML tasks and it accepts a YAML file, .env file and various CSVs. What would be the best way to upload these to a clearml task ...
2 years ago
0 Votes
9 Answers
600 Views
0 Votes 9 Answers 600 Views
Hey! Probably missed something, but I recently upgraded to 1.1.1, and I've just noticed that png artifacts are not displayed in the preview. Is this intentio...
2 years ago
0 Votes
10 Answers
590 Views
0 Votes 10 Answers 590 Views
Is there anywhere in the web UI where one can see the clearml server version running? I keep getting "version 1.1.1 is now available" even though I'm pretty ...
2 years ago
0 Votes
23 Answers
560 Views
0 Votes 23 Answers 560 Views
When using StorageManager.download_folder , I get the following error: Traceback (most recent call last): File "/home/idan/.clearml/venvs-builds/3.7/lib/pyth...
2 years ago
0 Votes
0 Answers
571 Views
0 Votes 0 Answers 571 Views
I have a project filled with failed attempts at onboarding to clearml by now πŸ˜…
2 years ago
0 Votes
8 Answers
642 Views
0 Votes 8 Answers 642 Views
Any plans to add support for MultiIndex tables? That comma-separation feels a bit odd. (Also this shows up in plots while in the scalars tab I actually have ...
2 years ago
0 Votes
30 Answers
600 Views
0 Votes 30 Answers 600 Views
I'm trying to set up some initial experiments within our stack, but when I use the execute_remotely task, I get this error: clearml_agent: ERROR: Failed gett...
2 years ago
0 Votes
3 Answers
540 Views
0 Votes 3 Answers 540 Views
side question - any plans to include native support for lgbm ?
2 years ago
0 Votes
2 Answers
552 Views
0 Votes 2 Answers 552 Views
Can one delete individual tasks from the WebUI?
2 years ago
0 Votes
7 Answers
521 Views
0 Votes 7 Answers 521 Views
Is there a way to generate usage stats and reports for queues? For example, how often is a queue used, how much CPU does the queue consume when it's used, et...
one year ago
0 Votes
4 Answers
654 Views
0 Votes 4 Answers 654 Views
There seems to be an error if a project name has spaces (at least at the top-level name). I created a project called internal tests (with the space), and it ...
one year ago
0 Votes
3 Answers
559 Views
0 Votes 3 Answers 559 Views
Is there any way (or are there any plans) to include some view for datasets in the WebUI? One that is detached from the generating task?
2 years ago
0 Votes
18 Answers
557 Views
0 Votes 18 Answers 557 Views
What would be the best way to approach this flow? We have a configuration file that defines e.g. the project name to use in ClearML, alongside other experime...
one year ago
0 Votes
6 Answers
633 Views
0 Votes 6 Answers 633 Views
I encountered a weird edge case with the AWS Auto-scaler, wondering if there are any solutions or if this is a known issue. Something as follows happened: Th...
one year ago
0 Votes
2 Answers
600 Views
0 Votes 2 Answers 600 Views
Are the docs broken? https://clear.ml/docs/latest/docs/release_notes/ver_1_7 gives me this
one year ago
0 Votes
6 Answers
653 Views
0 Votes 6 Answers 653 Views
Can I run an autoscaler listening to a regular queue (i.e. combine autoscaling with on premise machines)? Or does it run the danger of creating an EC2 instan...
one year ago
0 Votes
28 Answers
646 Views
0 Votes 28 Answers 646 Views
one year ago
0 Votes
7 Answers
551 Views
0 Votes 7 Answers 551 Views
In the pipeline examples, components have the following note: > # notice all package imports inside the function will be automatically logged as # required p...
one year ago
0 Votes
0 Answers
611 Views
0 Votes 0 Answers 611 Views
The remote workers seem to insist on using old git credentials, even after I stopped them, updated the conf file, and restarted them using it. Are the creden...
2 years ago
0 Votes
3 Answers
673 Views
0 Votes 3 Answers 673 Views
Also (unrelated), I noticed that after the upgrade to ClearML Server 1.2.0, the AWS (MinIO) credentials are not saved/used. It keeps asking for them whenever...
2 years ago
0 Votes
4 Answers
575 Views
0 Votes 4 Answers 575 Views
Can I shutdown specific workers somehow? Running clearml-agent .... --stop just iterates over all the local workers and shuts them down one by one
2 years ago
0 Votes
7 Answers
644 Views
0 Votes 7 Answers 644 Views
Can we report a pandas table with styling to be retained in the WebUI? It would be nice to report e.g. df.style.background_gradient(cmap='coolwarm', axis=Non...
2 years ago
0 Votes
6 Answers
550 Views
0 Votes 6 Answers 550 Views
The comparison page seems to resize the experiments so that all tags will fit in the screen, but then the experiments are pretty much impossible to compare
2 years ago
0 Votes
30 Answers
580 Views
0 Votes 30 Answers 580 Views
For some reason the agent is now trying to use Python 2.7 all of a sudden, any idea why? πŸ€” I see the following in the task's console output: New python exec...
2 years ago
0 Votes
30 Answers
610 Views
0 Votes 30 Answers 610 Views
Our Mac users are having some issues. They have their respective ~/clearml.conf, and yet they get: ClearML 1.1.5 Traceback (most recent call last): ... File ...
2 years ago
0 Votes
13 Answers
569 Views
0 Votes 13 Answers 569 Views
We use environment variables in our clearml.conf , but those might only be available later down the line (after dotenv.load_dotenv is called). When those env...
2 years ago
0 Votes
29 Answers
631 Views
0 Votes 29 Answers 631 Views
We're trying to use the AWS autoscaler and have managed to get it up and running with spinning up instances. However, it does not seem to pull any of the tas...
2 years ago
0 Votes
3 Answers
696 Views
0 Votes 3 Answers 696 Views
What privileges/IAM role would the AWS autoscaler need?
2 years ago
0 Votes
10 Answers
543 Views
0 Votes 10 Answers 543 Views
More clarification on documentation (ClearML Data): > Dataset changes are stored using differentiable storage, meaning a version will store the change-set fr...
2 years ago
Show more results questions
0 Is There A Way To Interface With Clearml Agent (Cli?) To Handle Model Repositories And Data Versioning (But So, Not Experimentation, Tight Integration, Pipelining, Etc)?

If everything is managed with a git repo, does this also mean PRs will have a messy metadata file attached to them?

3 years ago
0 We Have Configured The Aws Credentials In The Remote Worker'S

I mean, I see these are defined here https://github.com/allegroai/clearml-agent/blob/master/clearml_agent/definitions.py

But I do not see where an EnvironmentConfig.set() is called...

one year ago
one year ago
0 We Have Configured The Aws Credentials In The Remote Worker'S

Thanks SuccessfulKoala55 , I made https://github.com/allegroai/clearml-agent/issues/126 as a suggestion.

Do you have any thoughts on how to expose these... manually?
It does so already for environment variables that prefixed with CLEARML_ , so it would be nice to have some control over that.

one year ago
0 Trying To Run Aws Autoscaler With

But to be fair, I've also tried with python3.X -m pip install poetry etc. I get the same error.

one year ago
0 Trying To Run Aws Autoscaler With

Ultimately we're trying to avoid docker in AWS autoscaler (virtualization on top of virtualization seems redundant), and instead we maintain an AMI for a faster boot sequence.
We had no issues when we used pip , but now when trying to work with poetry all these issues came up.
The way I understand poetry to work, is that it is expected there is one system-wide installation that is used for virtual environment creation and manipulation. So at least it may be desired that the ...

one year ago
0 Trying To Run Aws Autoscaler With

Now my extra_vm_bash_script looks like so:
` deactivate
apt-get install -y gfortran libopenblas-dev liblapack-dev libpq-dev python-is-python3 python3-pip python3-dev proj-bin libgraphviz-dev graphviz graphviz-dev libgdal-dev
apt-get install software-properties-common -y
add-apt-repository ppa:deadsnakes/ppa -y
apt update
apt install python3.7 python3.8 python3.9 python3.7-distutils python3.8-distutils python3.9-distutils python3.10-distutils python3.7-dev python3.8-dev python3.9-dev pyt...

one year ago
0 Trying To Run Aws Autoscaler With

SuccessfulKoala55 no that did not solve the issue 😞

one year ago
0 Trying To Run Aws Autoscaler With

Still crashing, I think that may not be the correct virtual environment to edit πŸ€”
It's the one created later down the line

one year ago
0 Trying To Run Aws Autoscaler With

I also tried adding gent.package_manager.system_site_packages = true to ensure these virtual environments have access btw, still no avail

one year ago
0 Trying To Run Aws Autoscaler With

Sure SuccessfulKoala55 , and thanks for looking into it.

As an alternative (for now, or in general), we could consider reverting back to pip. The issue we encounter is that we have a monorepo, so frozen requirements should specify relative paths, but pip freeze does not seem to do that, so ClearML also fails in pip mode

one year ago
0 Trying To Run Aws Autoscaler With

I've tried also e.g. setting gent.package_manager.priority_packages = ["poetry"] , and/or agent.package_manager.poetry_version = ">1.2.0" , and other flags, but these affect only the main /clearml_agent_venv environment, and not the one actually generated by the clearml-agent when executing the task

one year ago
one year ago
0 Soooo… The Tooltip For Some Buttons In The Webui Hides The Actual Buttons

I tried that, unfortunately it does not help 😞

one year ago
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

TimelyPenguin76 I added pip install --update clearml-agent to the extra_vm_bash_script for the autoscaler, that should at least guarantee the latest clearml agent is used on the instance, right?

one year ago
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

Sounds like a nice idea 😁
Follow-up; any ideas how to avoid PEP 517 with the auto scaler? πŸ€” Takes a long time to build the wheels

one year ago
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

I'm using some old agent I fear, since our infra person decided to use chart 3.3.0 πŸ˜•
I'll try with the env var too. Do you personally recommend docker over the simple AMI + virtual environment?

More complete log does not add much information -
Cloning into '/root/.clearml/venvs-builds/3.10/task_repository/xxx/xxx'... fatal: could not read Username for ' ': terminal prompts disabled fatal: clone of ' ` ' into submodule path '/root/.clearml/venvs-builds/3.10/task_repository/...

one year ago
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

We have a read-only user with personal access token for these things, works seamlessly throughout and in our current on premise servers... So perhaps something missing in the autoscaler definitions?

one year ago
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

That was a good idea, unfortunately did not help too much, but I think I may have a found a work around, thanks!

one year ago
0 One More Follow-Up Still; We'Re Trying To Run Non-Gpu Scaler, And I'Ve Finally Sorted Out Subnet And Security Groups Issues, Only To Run Into This:

That's enabled; I was aiming if there are flags to add to pip install CLI, such as --no-use-pep517

one year ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

It does, but I don't want to guess the json structure (what if ClearML changes it or the folder structure it uses for offline execution?). If I do this, I'm planning a test that's reliant on ClearML implementation of offline mode, which is tangent to the unit test

one year ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

Yes exactly that AgitatedDove14
Testing our logic maps correctly, etc for everything related to ClearML

one year ago
0 Is There Any Testing Suite That Ships With Clearml? If We'D Like To Make Some Unit Tests For Our Code?

This is with:
Task.set_offline_mode(True) task = Task.init(..., auto_connect_streams=False)

one year ago
one year ago
Show more results compactanswers