Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
ManiacalLizard2
Moderator
28 Questions, 194 Answers
  Active since 05 June 2023
  Last activity 12 days ago

Reputation

0

Badges 1

82 × Eureka!
0 Votes
15 Answers
532 Views
0 Votes 15 Answers 532 Views
Is there a way to tell the agent to use a specific venv pre installed ? Like the one already installed in the developer PC and the agent is running inside th...
9 months ago
0 Votes
1 Answers
528 Views
0 Votes 1 Answers 528 Views
Hi team, how to you use MicroMamba and pip together with ClearML ?
10 months ago
0 Votes
1 Answers
538 Views
0 Votes 1 Answers 538 Views
From the python code point of view, how do you detect if it is running locally or via clearml-agent ?
8 months ago
0 Votes
3 Answers
597 Views
0 Votes 3 Answers 597 Views
Hi. We have Task that generate trained model in pth but our downstream pipeline is using omnx file and an custom generated yaml file. Currently, when the tra...
10 months ago
0 Votes
0 Answers
572 Views
0 Votes 0 Answers 572 Views
9 months ago
0 Votes
1 Answers
550 Views
0 Votes 1 Answers 550 Views
Is there a way for clearml to assign semantic version to model automatically like mlfow does?
11 months ago
0 Votes
4 Answers
609 Views
0 Votes 4 Answers 609 Views
I had a good look at all the introduction video on youtube and had some questions. Context: if we are going to deploy and maintain ClearML servers our self i...
11 months ago
0 Votes
5 Answers
511 Views
0 Votes 5 Answers 511 Views
7 months ago
0 Votes
4 Answers
715 Views
0 Votes 4 Answers 715 Views
What are project default output ? That the default output_uri set on the server side ? Can I use azure blob storage ?
11 months ago
0 Votes
2 Answers
605 Views
0 Votes 2 Answers 605 Views
Experiment Environment Containers Tutorial : I create a docker image with: $ clearml-agent build --id d8162747eb2d4453bba9778851d1e120 --docker --target new_...
11 months ago
0 Votes
11 Answers
216 Views
0 Votes 11 Answers 216 Views
How to use ZScaler (or custom certificate) with ClearML ? I installed the ZScaler certificate into the OS system. curl is happy with it. boto3 too but then c...
4 months ago
0 Votes
5 Answers
112 Views
0 Votes 5 Answers 112 Views
I have weird issue with clearml agent: when queue a job for a second time on the same agent, it get Executing task id [43cc0c9e1f794f53a148bde3fff03cc9]: rep...
one month ago
0 Votes
3 Answers
108 Views
0 Votes 3 Answers 108 Views
Hi, I am using mmpretain and wondering how do ClearML integrate with it ? I used: Runner( ..., visualizer=dict(type='Visualizer', vis_backends=[dict(type='Cl...
one month ago
0 Votes
2 Answers
167 Views
0 Votes 2 Answers 167 Views
Just want to post it here before raising a github issue: there seems to be a regression bug since clearml 1.13.0 where out training in GPU is 2x slower in ou...
2 months ago
0 Votes
10 Answers
599 Views
0 Votes 10 Answers 599 Views
Another questions related to requirements.txt We use pip install with git commit. Eg: mylib @ When I do task.add_requirements("requirements.txt") I get # Pyt...
11 months ago
0 Votes
6 Answers
224 Views
0 Votes 6 Answers 224 Views
Hi, We have an agent running inside a Nvidia official container. The agent seems to see the GPU driver but the GPU count is 0 When I join that container, nvi...
2 months ago
0 Votes
1 Answers
423 Views
0 Votes 1 Answers 423 Views
Hi, with a given task ID, how do I get all the information of the tab "INFO" in the Python SDK ? I struggle to find that in the doc None
7 months ago
0 Votes
5 Answers
276 Views
0 Votes 5 Answers 276 Views
Hi, in our use case, we use multiple github repo from our organization as dependent package. The issue is that github allow only one uniq ssh deploy key per ...
4 months ago
0 Votes
2 Answers
586 Views
0 Votes 2 Answers 586 Views
Do you have a documentation about how ClearML detect required python package ? In my case, I use mamba env and clearml seems to be mis-detect some packages ....
11 months ago
0 Votes
4 Answers
523 Views
0 Votes 4 Answers 523 Views
8 months ago
0 Votes
1 Answers
583 Views
0 Votes 1 Answers 583 Views
Security issue: I have deployed a clearml server on prem with docker. I set the user credential in /opt/clearml/config/apiserver.conf That work fine: you nee...
11 months ago
0 Votes
18 Answers
690 Views
0 Votes 18 Answers 690 Views
11 months ago
0 Votes
4 Answers
167 Views
0 Votes 4 Answers 167 Views
@<1523701087100473344:profile|SuccessfulKoala55> I just saw the new release of the agent 1.8.1 : None > Fix git pulling on cached invalid git entry. On error...
13 days ago
0 Votes
2 Answers
604 Views
0 Votes 2 Answers 604 Views
We have deployed our own ClearML server in Azure. We have 2 separate address for the api and web server. Both serving at port 443 In the local PC config file...
9 months ago
0 Votes
8 Answers
577 Views
0 Votes 8 Answers 577 Views
Also from the python sdk, is there a way to specify the clearml.conf file to use ? Like the equivalent of --config-file for cleaml-agent ?
8 months ago
0 Votes
9 Answers
691 Views
0 Votes 9 Answers 691 Views
I am struggling a bit to understand the use case of a pipeline: Let say you have step1 -> step2 -> step3 What is the point to use pipeline feature versus hav...
11 months ago
0 Votes
10 Answers
834 Views
0 Votes 10 Answers 834 Views
How to tell clearML server to use cloud storage (Azure)? I have a clearML server deployed with docker-compose. As per instruction here , I added the file /op...
11 months ago
0 Votes
4 Answers
525 Views
0 Votes 4 Answers 525 Views
clearnl failed to detect custom packages livsdk installed from git. I have a dev venv where I start initial clearml task. In this dev venv, I have custom pac...
9 months ago
0 How To Tell Clearml Server To Use Cloud Storage (Azure)? I Have A Clearml Server Deployed With Docker-Compose. As Per Instruction

do you mean having the ClearML FileServer store on azure blob instead of on the local drive?

Yes, that is what I wanted.

If so, that's not possible. You can however point the fileserver data folder to some mounted folder - if you have something that can create a mount from a filesystem folder to azure blob, it will work (the file server will always treat it as a local file system)

Thanks for confirming that it's the only solution. 👍

11 months ago
0 Another Questions Related To

is task.add_requirements("requirements.txt") redundant ?
Is ClearML always look for a requirements.txt in the repo root ?

11 months ago
0 Another Questions Related To

and in the train.py , I have task.add_requirements("requirements.txt")

11 months ago
0 Another Questions Related To

Ok. Found the solution.
The importance is to use this:

Task.add_requirements("requirements.txt")
task = Task.init(project_name='hieutest', task_name='foo',reuse_last_task_id=False)

And not:

task = Task.init(project_name='hieutest', task_name='foo',reuse_last_task_id=False)
task.add_requirements("requirements.txt")
11 months ago
11 months ago
0 Security Issue: I Have Deployed A Clearml Server On Prem With Docker. I Set The User Credential In

Nevermind: None

By default, the File Server is not secured even if Web Login Authentication has been configured. Using an object storage solution that has built-in security is recommended.

My bad

11 months ago
0 Experiment Environment Containers Tutorial : I Create A Docker Image With:

even it's just a local image ? You need a docker repository even if it will only be local PC ?

11 months ago
0 How To Tell Clearml Server To Use Cloud Storage (Azure)? I Have A Clearml Server Deployed With Docker-Compose. As Per Instruction

Hi.
How do you tell the server to use my azure storage instead of local drive, on the host machine ? Isn't it by setting azure.storage in /opt/clearml/config/clearml.conf ?

11 months ago
0 Is There A Way To Tell The Agent To Use A Specific Venv Pre Installed ? Like The One Already Installed In The Developer Pc And The Agent Is Running Inside That Same Pc?

So I tried:

CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=/data/hieu/opt/python-venv/fastai/bin/python3.10
clearml-agent  daemon  --queue no_venv

Then enqueue a cloned task to no_venv
It is still trying to create a venv (and fail):

[...]
tag = 
docker_cmd = 
entry_point = debug.py
working_dir = apple_ic
created virtual environment CPython3.10.10.final.0-64 in 140ms
  creator CPython3Posix(dest=/data/hieu/deleteme/clearml-agent/venvs-builds/3.10, clear=False, no_vcs_ignore=False, gl...
9 months ago
0 Is There A Way To Tell The Agent To Use A Specific Venv Pre Installed ? Like The One Already Installed In The Developer Pc And The Agent Is Running Inside That Same Pc?

Found a trick to have empty Installed package:
clearml.Task.force_requirements_env_freeze(force=True,requirements_file="/dev/null")
Not sure if this is the right way or not ...

9 months ago
0 Also From The Python Sdk, Is There A Way To Specify The Clearml.Conf File To Use ? Like The Equivalent Of

I understand for cleaml-agent
What I mean is that I have 2 self deployed server. I want to switch between the 2 config when running the code locally, not inside the agent

8 months ago
0 I Have A Docker Container That Have Clearml-Agent Running Inside In Normal Mode. The Agent Take On A Task And Execute It Fine. I Just Want To Somehow Log The Docker Image Version That The Agent Is Running Inside. I Start My Container With Something Like:

from what I understand, the docker mode were designed for apt based image and also running as root inside the container.
We have container that are not apt based and running not as root
We also do some "start up" that fetch credentials from Key Vault prior running the agent

7 months ago
0 Also From The Python Sdk, Is There A Way To Specify The Clearml.Conf File To Use ? Like The Equivalent Of

can you make train1.py use clearml.conf.server1 and train2.py use clearml.conf2 ?? In which case I would be intersted @<1523701087100473344:profile|SuccessfulKoala55>

8 months ago
0 Hello, I'M Trying To Use The Agent To Orchestrate Tasks - Our Install Is Quite Complicated And I'Ve Wrapped It All Up With The Code In A Docker Container; Is There A Way To Get The Agent To Just Run A Command In The Container Rather Than Try To Build/Inst

in my case, I set eveything inside the container, including the agent and not using docker mode altogether.
When my container start, it start the agent inside it in "normal" mode

7 months ago
7 months ago
Show more results compactanswers