Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
OddShrimp85
Moderator
33 Questions, 58 Answers
  Active since 10 January 2023
  Last activity one month ago

Reputation

0

Badges 1

52 × Eureka!
0 Votes
8 Answers
350 Views
0 Votes 8 Answers 350 Views
Hi, I am running clearml agent using SDK. When I run a remote job on this clearml agent, the venv setup is totally based on my requirements.txt instead of ad...
5 months ago
0 Votes
7 Answers
483 Views
0 Votes 7 Answers 483 Views
11 months ago
0 Votes
3 Answers
431 Views
0 Votes 3 Answers 431 Views
Hello, may i ask if there is a means to export dataset in one ClearML setup and import to another ClearML setup?
11 months ago
0 Votes
6 Answers
253 Views
0 Votes 6 Answers 253 Views
Hi, is there a way to list all agents running in a host, I do not find relevant one in clearml-agent -h.
2 months ago
0 Votes
3 Answers
319 Views
0 Votes 3 Answers 319 Views
Hello, is there a way to pull dataset from a local hdd when using pipeline as function?
6 months ago
0 Votes
4 Answers
492 Views
0 Votes 4 Answers 492 Views
one year ago
0 Votes
7 Answers
301 Views
0 Votes 7 Answers 301 Views
Hi, is there a way to pull clearml datasets to a mounted pv instead of the pod's local directory.
3 months ago
0 Votes
2 Answers
413 Views
0 Votes 2 Answers 413 Views
Hi, anyone experiencing issue with clearml-serving create ? Got error Traceback (most recent call last): File "c:\python38\lib\runpy.py", line 194, in _run_m...
11 months ago
0 Votes
2 Answers
519 Views
0 Votes 2 Answers 519 Views
Hello guys, I understand we can add some scripts for clearml-agent to execute prior to the task. Is it possible to add scripts to run after the task?
11 months ago
0 Votes
2 Answers
456 Views
0 Votes 2 Answers 456 Views
one year ago
0 Votes
1 Answers
404 Views
0 Votes 1 Answers 404 Views
2 years ago
0 Votes
4 Answers
478 Views
0 Votes 4 Answers 478 Views
Hello all, i am trying to make clearml store the output(model) to minio by setting the output_uri. task = Task.init(project_name='MNIST', task_name='Tensorfl...
2 years ago
0 Votes
3 Answers
304 Views
0 Votes 3 Answers 304 Views
Hi, I was trying to install clearml agent using helm chart but my k8s version is not compatible. I have am older k8s version. Is there anywhere I could get a...
6 months ago
0 Votes
6 Answers
446 Views
0 Votes 6 Answers 446 Views
2 years ago
0 Votes
6 Answers
350 Views
0 Votes 6 Answers 350 Views
6 months ago
0 Votes
4 Answers
391 Views
0 Votes 4 Answers 391 Views
Hi guys, I have my experiment running on setup A. However I need these experiments params and output in setup B for comparison. Both setup are not linked. An...
2 years ago
0 Votes
1 Answers
408 Views
0 Votes 1 Answers 408 Views
Hello, I have some problem with my k8s glue. May I know do we need to set --gateway-address args if we are going through an ingress?
2 years ago
0 Votes
3 Answers
543 Views
0 Votes 3 Answers 543 Views
hi, i am trying to upload my dataset to s3 that is secured with https. I can do it when my s3 server is http. example below. Can someone share a sample on ho...
9 months ago
0 Votes
1 Answers
344 Views
0 Votes 1 Answers 344 Views
Is there somewhere that I can find more elaborated steps to get vscode work with clearml sessions?
7 months ago
0 Votes
4 Answers
500 Views
0 Votes 4 Answers 500 Views
Hello, there is a means to export / import Task using Task.export_task, Task.import_task. Is there a way to preserve the task id when we bring this task from...
11 months ago
0 Votes
2 Answers
445 Views
0 Votes 2 Answers 445 Views
I have uploaded Dataset in clearml with output_uri=s3::80 . Can I ask if we do not include aws.s3.host=:80 in clearml.conf, I.e. port 80, when your task call...
9 months ago
0 Votes
5 Answers
393 Views
0 Votes 5 Answers 393 Views
Hello guys, not sure if this is the right place to ask about clearml serving. May i know if an updated readme will be released soon? I did not manage to get ...
2 years ago
0 Votes
1 Answers
426 Views
0 Votes 1 Answers 426 Views
Hello, I see there are two different classes for clearml-dataset i.e. Dataset and DatasetVersion. May I know why there is a need for both when there are larg...
11 months ago
0 Votes
3 Answers
230 Views
0 Votes 3 Answers 230 Views
Hi did anyone encounter gpu monitoring failed getting GPU reading, switching off GPU monitoring error on remote task pod? I am on latest sdk and clearml serv...
2 months ago
0 Votes
2 Answers
418 Views
0 Votes 2 Answers 418 Views
2 years ago
0 Votes
2 Answers
450 Views
0 Votes 2 Answers 450 Views
hi, may i ask if there is a good way to get the details under ClearML Task "Info" tab (output as json/python dict) using python codes?
11 months ago
0 Votes
4 Answers
326 Views
0 Votes 4 Answers 326 Views
5 months ago
0 Votes
2 Answers
214 Views
0 Votes 2 Answers 214 Views
Hi may I know is there a way to get the dataset_id from the dataset object? I cannot find an api for it
one month ago
0 Votes
2 Answers
523 Views
0 Votes 2 Answers 523 Views
Hi all, would like to ask what's the difference between creating pipeline from tasks, functions or decorators?
one year ago
0 Votes
15 Answers
390 Views
0 Votes 15 Answers 390 Views
Hello guys, I am deploying my own clearml server in k8s. the pods are running well. But when I access the webserver, I do not have option to create credentia...
2 years ago
Show more results questions
0 Hi Guys, I Have My Experiment Running On Setup A. However I Need These Experiments Params And Output In Setup B For Comparison. Both Setup Are Not Linked. Anyway For Me To Copy The Outputs And Load It In Setup B Clearml?

Ah I think I was not very clear on my requirement. I was looking at porting project level, not entire clearml data over. Is it possible instead?

2 years ago
0 Hi Guys, I Have Been Pondering How Does Clearml Generate The "Installed Packages" List. I Triggered My Training Through Machine A (With Some Python Packages) And The Actual Training Is Done In A Docker Container (With Both Global Packages + Packages Insta

Hello CostlyOstrich36 I am facing an issue now. basically i installed all necessary python packages in my docker image. But somehow, the clearml-agent does not seems to be able to detect these global packages. I don't see them in the "installed packages". Any advice?

2 years ago
0 Hi Guys, I Have Been Pondering How Does Clearml Generate The "Installed Packages" List. I Triggered My Training Through Machine A (With Some Python Packages) And The Actual Training Is Done In A Docker Container (With Both Global Packages + Packages Insta

Example i build my docker image using a image in docker hub. In this image, i installed torch and cupy packages. But when i run my experiment in this image, the packages are not found.

Yes, I ran the experiment inside.

2 years ago
0 Hi We Have Had Some Crashes On Clearml Server And It Was Caused By Clearml Uploading The Models Into Clearml Server (By Default). Is It Possible To Have An Overriding Config So Clients Can Never Upload To Clearml Server Itself As Default?

SuccessfulKoala55 i tried comment off fileserver, clearml dockers started but it doesn't seems to be able to start well. When I access clearml via webbrowser, site cannot be reached.

Just to confirm, I commented off these in docker-compose.yaml.

apiserver:
command:
- apiserver
container_name: clearml-apiserver
image: allegroai/clearml:latest
restart: unless-stopped
volumes:
- /opt/clearml/logs:/var/log/clearml
`...

one year ago
0 Any Plans To Add Unpublished State For Clearml-Serving?

Not exactly sure yet but I would think user tag for deployed make sense as it should be a deliberated user action. And additional system state is required too since a deployed state should have some pre-requitise system state.

I would also like to ask if clearml has different states for a task, model, or even different task types? Right now I dun see differences, is this a deliberated design?

one year ago
0 Any Plans To Add Unpublished State For Clearml-Serving?

I guess we need to understand the purpose of the various states. So far only "archive, draft, publish". Did I miss any?

one year ago
0 Hi Guys, I Am Trying To Use Clearml Pipelines By Function. May I Know The Correct Way To Pass Model/Files From One Tasks To Next? I Realised Pickle May Not Work Sometimes. Also, Some Steps May Require Complete Set Of Files Before It Should Starts, Is Th

Thanks. The examples uses upload_artifact which stores the files in output_uri. What if I do not want to save it but simply pass to next step, is there a way to do so?

5 months ago
0 I Have Uploaded Dataset In Clearml With

Hi @<1523701070390366208:profile|CostlyOstrich36> , basically

  • I uploaded dataset using clearml Datasets. The output_uri is pointed to my s3, thus the dataset is stored in s3. My s3 is setup with http only.
  • When I retrieve the dataset for training, using Dataset.get() , I encountered ssl cert error as the url to retrieve data was https://<s3url>/... instead of s3://<s3url>/... which is http. This is weird as the dataset url is without https.
  • I am not too sure why and I susp...
9 months ago
0 Hello! I'Ve Set Sdk.Aws.S3.Verify To False, But Im Still Getting [Ssl: Certificate_Verify_Failed]. I'Ve Added Two Prints, One For

I not very sure tbh. Just want to see if this is useful....

I got SSL error few days back and I solved it by adding cert to /etc/ssl/certs and perform update-ca-certificates .

export REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt

Add this. Note that verify might not work with sdk.aws.s3.verify but sdk.aws.s3.credentials . Pls see the attached image.

Example:
aws {
s3 {
credentials: [
{
` ...

9 months ago
0 Hello, Is There A Way To Pull Dataset From A Local Hdd When Using Pipeline As Function?

When I run as regular remote task it works. But when I run as a step in pipeline, it cannot access the same folder in my local machine.

6 months ago
0 Hello, Is There A Way To Pull Dataset From A Local Hdd When Using Pipeline As Function?

Just to add, when I run the pipeline locally it works as well.

6 months ago
0 Hi Did Anyone Encounter

Yes. The training working well with cuda

2 months ago
0 Hi, Is There A Way To Pull Clearml Datasets To A Mounted Pv Instead Of The Pod'S Local Directory.

I have yet to figure out how to do so, would appreciate if u could give some guidance

3 months ago
0 Hi, Is There A Way To Pull Clearml Datasets To A Mounted Pv Instead Of The Pod'S Local Directory.

@<1523701205467926528:profile|AgitatedDove14> when my codes get the clearml datasets, it stores in the cache e.g. /$HOME/.clearml/cache....

I wanted it to be in a mounted PV instead, so other pods (in same node) who needed same datasets can use without pulling again.

3 months ago
0 Hi, Is There A Way To Pull Clearml Datasets To A Mounted Pv Instead Of The Pod'S Local Directory.

By the way, will downloading still happen if the datasets is available in the cache folder? Any specific settings to add to Dataset.get_local_copy()?

3 months ago
0 Hello, For Deployment Of Clearml Server In K8S, We Need To Label Just One Node App=Clearml And Also Set The Daemon.Json. Wouldn'T This Make Clearml Server Tie To This Node Only And If This Node Fails, Clearml Server Will Not Work. Any Advice? Similarly

Hi SuccessfulKoala55 Thanks for pointing me to this repo. Was using this repo.

I didn't manage to find in this repo that if we still require to label the node app=clearml, like what was mentioned in the deprecated repo. Although from the values.yaml, the node selector is empty. Would u be able to advise?

How is the clearml data handled now then? Thanks

2 years ago
0 Hi, I Was Trying Out The Clearml Pipelines From Task. I Had 2 Tasks That Have Run Successfully As Clearml Task. One Of The Tasks Has Dependency On External Python File. I.E. I Have Used From <External File> Import Methoda In My First Task. It Executed Fin

Hi CostlyOstrich36 I have run this task locally at first. This attempt was successful.

When I use this task to run in a pipeline (task was run remotely), it cannot find the external package. This seems logical but I not sure how to resolve this.

11 months ago
0 Hi, I Was Trying Out The Clearml Pipelines From Task. I Had 2 Tasks That Have Run Successfully As Clearml Task. One Of The Tasks Has Dependency On External Python File. I.E. I Have Used From <External File> Import Methoda In My First Task. It Executed Fin

Ok. Can I check that only the main script was stored in the task but not the dependent packages?

I guess the more correct way is to upload to some repo where the remote task can still pull from it?

11 months ago
Show more results compactanswers