Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
WorriedSwan6
Moderator
9 Questions, 19 Answers
  Active since 22 July 2024
  Last activity 3 months ago

Reputation

0

Badges 1

17 × Eureka!
0 Votes
8 Answers
707 Views
0 Votes 8 Answers 707 Views
Hi everyone, I'm experiencing an issue with ClearML running on K8S. After upgrading the ClearML server helm chart from version 7.11.5, I'm seeing the followi...
6 months ago
0 Votes
0 Answers
375 Views
0 Votes 0 Answers 375 Views
Hey, can someone help me setup the configuration to use minio? I have been trying to solve this puzzle for a few hours now. I have minio in my k8s on prem, w...
2 months ago
0 Votes
2 Answers
956 Views
0 Votes 2 Answers 956 Views
Hey, anyone know how to add a step with private repo? running this code: pipe.add_function_step( name='step3-test3', repo="https://${git_pass}@github.com/my-...
one year ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
Hey, how can we control the pod of PipelineController not use the gpu? according to the documentation, the The pipeline controller lives as long as the pipel...
one year ago
0 Votes
10 Answers
510 Views
0 Votes 10 Answers 510 Views
3 months ago
0 Votes
2 Answers
409 Views
0 Votes 2 Answers 409 Views
Hey channel. We are thinking about using clearml Dataset to store the data and use versioning. Does anyone know if the versioning are incremental, and if it ...
3 months ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hey, can someone help with using parameter in the pipeline? According to the documentation: pipe.add_parameter( name='pickle_url', description='url to pickle...
one year ago
0 Votes
3 Answers
579 Views
0 Votes 3 Answers 579 Views
Hey, I have clearml install on-prem k8s. Anyonw know how can I backup the data , in case of DR? I do not care for username \ passwords \ pipeline settings, b...
4 months ago
0 Votes
1 Answers
418 Views
0 Votes 1 Answers 418 Views
3 months ago
0 Hey, How Can We Control The Pod Of Pipelinecontroller Not Use The Gpu? According To The Documentation, The

Hey @<1729671499981262848:profile|CooperativeKitten94> yes, it did! 🙂
I thank you for the support.

one year ago
0 Hey, How Can We Control The Pod Of Pipelinecontroller Not Use The Gpu? According To The Documentation, The

I must add I do not see anything in the helmchart for using templateOverrides

one year ago
0 Hey, How Can We Control The Pod Of Pipelinecontroller Not Use The Gpu? According To The Documentation, The

And as it turnout, cannot specify multiply queues:

-- ClearML queue this agent will consume. Multiple queues can be specified with the following format: queue1,queue2,queue3

queue: default
gives an error

one year ago
0 Hey, How Can We Control The Pod Of Pipelinecontroller Not Use The Gpu? According To The Documentation, The

@<1729671499981262848:profile|CooperativeKitten94> Running the following conf:

  queue:
    services-tasks:
      templateOverrides:
        resources: 
          requests:
            nvidia.com/gpu: "1"
          limits:
            nvidia.com/gpu: "1"
    services: 
      templateOverrides:
        resources: 
          requests:
            nvidia.com/gpu: "0"
          limits:
            nvidia.com/gpu: "0"


  apiServerUrlReference: "
"
  fileServerUrlReference: "
``...
one year ago
0 Hey, How Can We Control The Pod Of Pipelinecontroller Not Use The Gpu? According To The Documentation, The

@<1729671499981262848:profile|CooperativeKitten94> thank you! I will try and will update : ))

one year ago
0 Hey Channel. We Are Thinking About Using Clearml Dataset To Store The Data And Use Versioning. Does Anyone Know If The Versioning Are Incremental, And If It Is Possible To Restore An Older Verions?

Hey @<1523701070390366208:profile|CostlyOstrich36>
About the versioning, so if I have dataset A with 100pic, say 10MB.
And I create a new dataset B with 50image say 5MBbut as the dataset B as parent.
Will dataset B size add 15MB to the PVC, or only 5MB?

Same Q if it is the same dataset and new version.

Ignore the Q about restoring. thx

3 months ago
0 Hey, Anyone Know How To Add A Step With Private Repo? Running This Code:

Hey, ignore the above please -> I had a typo in the secret key name

one year ago
0 Any Tips On Debugging Worker Graphs Not Showing Up? Seems To Be Some Js Errors In The Console That May Be Related. Running Localhost Against 1.16.1 Images

@<1689446563463565312:profile|SmallTurkey79> are you using the community edition with helm?
I am having the same issue here.

one year ago
0 Anyonw Know How Can I Make Clearml Server Serving File Urls With External Domain, And Not The Internal Kubernetes Cluster Hostnames? Runnin Both The Server And Agents In K8S On-Prem, The Url Giving Is Not Reachable Because It Try To Present It As The Url

sure, here:

clearml:
  defaultCompany: "bialek"
  cookieDomain: "bialek.dev"

nameOverride: "clearml"
fullnameOverride: "clearml"

apiserver:
  existingAdditionalConfigsSecret: "eso-clearml-users"  
  additionalConfigs:
    clearml.conf: |
      agent {
        file_server_url: 

      }
  service:
    type: ClusterIP
  ingress:
    enabled: true
    ingressClassName: "bialek-on-prem"
    hostName: "clearml-api.bialek.dev"
    tlsSecretName: "tls-clearml-apiserver"
    anno...
3 months ago
0 Hey, Can Someone Help With Using Parameter In The Pipeline? According To The Documentation:

Hey @<1523701087100473344:profile|SuccessfulKoala55>
The relevant log from the pipeline shows:

error: pathspec 'origin/${pipeline.branch}' did not match any file(s) known to git
Repository cloning failed: Command '['git', 'checkout', 'origin/$%7Bpipeline.branch%7D', '--force']' returned non-zero exit status 1.

and I believe this is because the params cannot be injected in such a way, not sure if this is a bug or normal behaviour.
I am able to to use it like so:

pipe.add_par...
one year ago
0 Hi Everyone, I'M Experiencing An Issue With Clearml Running On K8S. After Upgrading The Clearml Server Helm Chart From Version 7.11.5, I'M Seeing The Following Errors: In The Agent:

Hey @<1798887585121046528:profile|WobblyFrog79> , yes testing this locally it does seems to solve the issue, thank you.
I will test it in our env.

On a different issue, have you any solution on how to make the agent listen to multiply queues?
On the helm it is written :

  # -- ClearML queue this agent will consume. Multiple queues can be specified with the following format: queue1,queue2,queue3

But this does not work as the agent will read them all as one queue

6 months ago
0 Hey, I Have Clearml Install On-Prem K8S. Anyonw Know How Can I Backup The Data , In Case Of Dr? I Do Not Care For Username \ Passwords \ Pipeline Settings, But The Data From All The Tasks Is Important For Us

Hey @<1523701070390366208:profile|CostlyOstrich36> , thx for the reply.
Can you advice if you think this will be the right path to go:

  • Mongodb backup via mongodump to s3,
  • Elasticsearch Install the S3 repository plugin and create a snapshot.The above can be triggered with cronjob once a week.

On restore to a fresh cluster, I will install clearml helm chart, and:

  • Mongodb will download the file from S3 and use mongorestore
  • Elasticsearch will download the snapshot from s3 and use:
4 months ago
0 Anyonw Know How Can I Make Clearml Server Serving File Urls With External Domain, And Not The Internal Kubernetes Cluster Hostnames? Runnin Both The Server And Agents In K8S On-Prem, The Url Giving Is Not Reachable Because It Try To Present It As The Url
root@master:/home/bialek# kubectl -n clearml describe po clearml-webserver-847d7c947b-hfk57   
Name:             clearml-webserver-847d7c947b-hfk57
Namespace:        clearml
Priority:         0
Service Account:  clearml-webserver
Node:             clearml-server/secretip
Start Time:       Sun, 04 May 2025 08:42:17 +0300
Labels:           app.kubernetes.io/instance=clearml-webserver
                  app.kubernetes.io/name=clearml
                  pod-template-hash=847d7c947b
Annotation...
3 months ago
0 Hey, How Can We Control The Pod Of Pipelinecontroller Not Use The Gpu? According To The Documentation, The

Hey @<1523701070390366208:profile|CostlyOstrich36>
Can you explain this point a bit more?
In the helmchart of the agent I configure like so:
...

agentk8sglue:
  extraEnvs: 
  - name: AWS_ACCESS_KEY_ID
    valueFrom:
      secretKeyRef:
        name: aws-access-key-id
        key: AWS_ACCESS_KEY_ID
  - name: AWS_SECRET_ACCESS_KEY
    valueFrom:
      secretKeyRef:
        name: aws-secret-access-key
        key: AWS_SECRET_ACCESS_KEY
  - name: K8S_GLUE_MAX_PODS
    value: '1'
  - name:...
one year ago
0 Anyonw Know How Can I Make Clearml Server Serving File Urls With External Domain, And Not The Internal Kubernetes Cluster Hostnames? Runnin Both The Server And Agents In K8S On-Prem, The Url Giving Is Not Reachable Because It Try To Present It As The Url

Hey @<1729671499981262848:profile|CooperativeKitten94> , but this is internal domain, which cause an issue with the SSL when trying to upload data to the server:

2025-05-07 18:36:22,421 - clearml.storage - ERROR - Exception encountered while uploading HTTPSConnectionPool(host='clearml-file.bialek.dev', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certif...
3 months ago
0 Any Tips On Debugging Worker Graphs Not Showing Up? Seems To Be Some Js Errors In The Console That May Be Related. Running Localhost Against 1.16.1 Images

@<1523701087100473344:profile|SuccessfulKoala55> is this feature block by community edition maybe ?

one year ago