Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
BoredHedgehog47
Moderator
27 Questions, 213 Answers
  Active since 10 January 2023
  Last activity 11 months ago

Reputation

0

Badges 1

212 × Eureka!
0 Votes
16 Answers
1K Views
0 Votes 16 Answers 1K Views
When I try to create experiment in the UI all I see is this dialogue
2 years ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
How do I create an experiment where I can set the github repository/branch name/script path like this example shows?
2 years ago
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
Hey all, I'm testing the usage of SETUP SHELL SCRIPT in the experiment window. I added a simple command but did not see it in the console. The task did execu...
2 years ago
0 Votes
14 Answers
1K Views
0 Votes 14 Answers 1K Views
Does ClearML have the ability to run a single experiment across multiple nodes/GPUs in a k8 cluster?
2 years ago
0 Votes
13 Answers
1K Views
0 Votes 13 Answers 1K Views
apiserver: service: type: ClusterIP configuration: additionalConfigs: apiserver.conf: | auth { fixed_users { enabled: true pass_hashed: false users: [ { user...
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
Where I can change this host name using the helm charts? I got this error when my task is fetching a dataset. 2022-09-23 15:09:45,318 - clearml.storage - ERR...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
In order for a new worker to come online in my k8 cluster, do I need to have an EC2 startup script init the agent/config, and then start the daemon? Do I hav...
2 years ago
0 Votes
0 Answers
1K Views
0 Votes 0 Answers 1K Views
Hey everyone, I'm trying to add a test user to the api server config. Here is a snippet form my values.yaml file. Do I have this formatted correctly? I'm not...
2 years ago
0 Votes
2 Answers
1K Views
0 Votes 2 Answers 1K Views
If I leave WORKING DIRECTORY empty in the experiment configuration (in the UI), will that use the git project root by default?
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Also is this the image that is used for experiments? https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml-agent/values.yaml#L38-L39
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
What does this log message mean ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start ?
2 years ago
0 Votes
14 Answers
1K Views
0 Votes 14 Answers 1K Views
Hey all, is there any reason the python sdk clearml would cause subprocess issues? I'm calling returncode = Popen(cmd).wait() and getting File "/usr/lib64/py...
2 years ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
In my git repo, I have a setup.py , how would I run pip install -e . rather than using --packages or --requirements
2 years ago
0 Votes
17 Answers
1K Views
0 Votes 17 Answers 1K Views
or is it just the ubuntu official image https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml-agent/values.yaml#L59
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
I'm trying to configure the glue agent to use AWS ECR via helm charts. Below is my configuration. It is not pulling the image though, it is failing with K8S ...
2 years ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
2 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
If I have an AWS key/secret for an IAM user, what is the best way to pass in these credentials so the task docker container has credentials generated for usa...
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Is there any additional configuration needed for PYTHONPATH to be setup properly in the clearml agent? I'm getting python import errors from the root directo...
2 years ago
0 Votes
8 Answers
1K Views
0 Votes 8 Answers 1K Views
When I run clearml-data close on an 84mb file, I get the following response 413 Request Entity Too Large 413 Request Entity Too Large nginxYet the file is st...
2 years ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
Is there any examples of mounting an AWS EFS mount to a self hosted k8 agent deploy? https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearm...
2 years ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
In a nutshell, what do I need for the clearML agent to scale EC2 nodes in the k8 cluster, in terms of helm configuration? I assume AWS credentials, is there ...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
Why am I getting a 403 from file server when the k8 glue agent is initializing ?
2 years ago
0 Votes
18 Answers
1K Views
0 Votes 18 Answers 1K Views
I'm new to using datasets, if my git project root is myProject and I expect file.json to be at the root level, how do I accomplish this?
2 years ago
0 Votes
7 Answers
1K Views
0 Votes 7 Answers 1K Views
Was there any changes to clearML python SDK in the past 24 hours?
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
When I run an experiment (self hosted), I only see scalars for GPU and System performance. How do I see additional scalars? I have "tensorboard": { "enabled"...
2 years ago
0 Votes
30 Answers
1K Views
0 Votes 30 Answers 1K Views
When I do Dataset.get why does the SDK use clearml.storage - ERROR - Could not download http://files.clearml.myhost.com vs using what is defined on the agent...
2 years ago
0 Votes
31 Answers
56K Views
0 Votes 31 Answers 56K Views
When my remote task is installing the python dependencies --packages requests for example, is there any caching "magic" that is done by the k8 agent? Or is i...
2 years ago
0 In Order For A New Worker To Come Online In My K8 Cluster, Do I Need To Have An Ec2 Startup Script Init The Agent/Config, And Then Start The Daemon? Do I Have To Do This Manually Is This A Better Way?

No I'm not tracking. I'm pretty new to k8s so this might be beyond my current knowledge. Maybe if I rephrase my goals it may make more sense. Essentially I want to enqueue an experiment, pick a queue (gpu), and have a gpu ec2 node provisioned upon that, lastly the experiment is then initialized on that new gpu ec2 and executed. When the work is completed, I want the gpu ec2 node to terminate after x amount of time.

2 years ago
0 When I Do

When I deployed the webserver, I changed the value https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml/values.yaml#L36 to be the public file server URL. Then in the UI, I copied the blob from the settings/API keys. Which had the public URLs. After that I did my data uploads which worked fine as they used public URLs. The problem is due to tight security on this k8 cluster, the k8 pod cannot reach the public file server url which is associated with the dataset.

2 years ago
0 When I Try To Create Experiment In The Ui All I See Is This Dialogue

Gotcha, and the agent default runtime mode is docker correct? So I could install all my system dependencies in my own docker image?

2 years ago
0 Hey All, I'M Testing The Usage Of

yes makes sense. So I wouldnt be able to setup the PYTHONPATH via the setup script?

2 years ago
0 When I Do

IMO, the dataset shouldnt be tied to the clearml.conf URLs that it was uploaded with, as that URL could change. It should respect the file server URL the agent has.

2 years ago
0 Hey All, Is There Any Reason The Python Sdk

{"asctime": "2022-09-28 18:45:55,353", "levelname": "INFO", "name": "root", "module": "ldc_train_end_to_end", "threadName": "MainThread", "message": "Training classifier with command:\npython -m sfi.imagery.models.bbox_predictorv2.train ./sfi/imagery/models/training/train_config.json", "filename": "ldc_train_end_to_end.py", "funcName": "train_model"} File "/usr/lib64/python3.7/site.py", line 177 file=sys.stderr) ^ SyntaxError: invalid syntax

2 years ago
0 When My Remote Task Is Installing The Python Dependencies

If you look lower, it is there '/home/npuser/.clearml/venvs-builds/3.7/task_repository/commons-imagery-models-py'

2 years ago
0 When My Remote Task Is Installing The Python Dependencies

When I run this line locally, it works fine
from sfi.imagery.models.chip_classifier.eval import eval_chip_classifier

2 years ago
0 When My Remote Task Is Installing The Python Dependencies

Seems like it has everything I would need

2 years ago
0 When My Remote Task Is Installing The Python Dependencies

` PYTHONPATH: /home/npuser/.clearml/venvs-builds/3.7/task_repository/commons-imagery-models-py/sfi:/home/npuser/.clearml/venvs-builds/3.7/task_repository/commons-imagery-models-py:/home/npuser/.clearml/venvs-builds/3.7/task_repository/commons-imagery-models-py/sfi/imagery/models/training::/home/npuser/.clearml/venvs-builds/3.7/task_repository/commons-imagery-models-py/sfi:/usr/lib64/python37.zip:/usr/lib64/python3.7:/usr/lib64/python3.7/lib-dynload:/home/npuser/.clearml/venvs-builds/3.7/lib6...

2 years ago
0 Where I Can Change This Host Name Using The Helm Charts? I Got This Error When My Task Is Fetching A Dataset.

Figured this out, the value is parsed from my local clearml.conf file

2 years ago
0 I'M New To Using Datasets, If My Git Project Root Is

Could I simply just reference the files by name and pass in a string such as ~/.clearml/my_file.json

2 years ago
0 When I Do

I suppose a short term hack would to just edit the /etc/hosts file and redirect the public url to k8 dns url?

2 years ago
0 I'M New To Using Datasets, If My Git Project Root Is

so it caches to ~/.clearml/ any files that are under the same project name?

2 years ago
0 When I Do

I don't know how to get past this? My k8 pods shouldn't need to reach out to the public file server URL.

2 years ago
0 Why Am I Getting A 403 From File Server When The K8 Glue Agent Is Initializing ?

I just opened a shell with the api and tried to curl my files URL, and the curl just hangs. no response

2 years ago
0 When I Do

If you submit your task using the CLI does it still work?

2 years ago
0 When My Remote Task Is Installing The Python Dependencies

This is to address the PYTHONPATH issues

2 years ago
Show more results compactanswers