Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
PleasantOwl46
Moderator
21 Questions, 74 Answers
  Active since 10 January 2023
  Last activity 8 days ago

Reputation

0

Badges 1

64 × Eureka!
0 Votes
0 Answers
644 Views
0 Votes 0 Answers 644 Views
Hey ClearML community We are managing multiple ClearML servers for many teams and we come to the point that we must cleanup and delete old tasks Based on cle...
8 months ago
0 Votes
3 Answers
518 Views
0 Votes 3 Answers 518 Views
Hey everyone With recent changes in Dockerhub policy, very soon we will lose our ability for pull docker.io images ClearML open-source version have Elasticse...
8 months ago
0 Votes
1 Answers
432 Views
0 Votes 1 Answers 432 Views
can I upgrade from clearml-server 1.17 to 2.0 directly, or do I need to upgrade to 1.17.1-554 first?
5 months ago
0 Votes
2 Answers
994 Views
0 Votes 2 Answers 994 Views
using fixed users and hashed password I'd like to change the username and name fields (without changing the password) how painful is this process? how will e...
one year ago
0 Votes
12 Answers
581 Views
0 Votes 12 Answers 581 Views
does anyone have working example of how to properly use pagination with ClearML REST API? I'm trying to use projects.get_all to get an json with all my proje...
8 months ago
0 Votes
18 Answers
2K Views
0 Votes 18 Answers 2K Views
Hey everyone, not sure exactly when it started to happen but I get unexpected behavior with task.init jobs with same project/tasks name are not overwritten -...
2 years ago
0 Votes
3 Answers
603 Views
0 Votes 3 Answers 603 Views
Hey team I can see last clearml-server released on August, when new release going public? I'm going to upgrade our env and prefer to update after upcoming ne...
7 months ago
0 Votes
1 Answers
882 Views
0 Votes 1 Answers 882 Views
is there a way to get list of users from the API?
one year ago
0 Votes
1 Answers
411 Views
0 Votes 1 Answers 411 Views
I noticed when I restore entire ClearML app (tar and untar /opt/clearml/data to new server) I do not see my previous token under workspace-configuration , fo...
6 months ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hi there ClearML experts I've been trying to delete heavy project (with ~4K experiments) using the API and getting the following error: curl \ --header "Cont...
3 years ago
0 Votes
9 Answers
1K Views
0 Votes 9 Answers 1K Views
out of a sudden without any trigger, our ClearML server ( version 1.13.0-373 ) showing only tasks/projects that belongs to logged-in user e.g if a user don't...
one year ago
0 Votes
15 Answers
1K Views
0 Votes 15 Answers 1K Views
Hi all we have set nginx in front of ClearML and signed with our own self-signed certs I'm trying to modify the cleanup_service to fit some of our needs (run...
one year ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
we have an nginx container in front of ClearML, functions use sort of " SSL reverse proxy" we are seeing this errors with jobs that are trying to upload some...
one year ago
0 Votes
3 Answers
1K Views
0 Votes 3 Answers 1K Views
Hey ClearML experts is there a way to copy entire exp. including results/scalars/plots? right click > clone creates a duplicate of the exp. , only with it's ...
one year ago
0 Votes
10 Answers
1K Views
0 Votes 10 Answers 1K Views
does anyone had experience with running ClearML in secure machine with iptables configured? I had allowed traffic in the ports ClearML is using but still the...
one year ago
0 Votes
4 Answers
1K Views
0 Votes 4 Answers 1K Views
Hey all I see this error repeating constantly, and my metrics are not updated, what does it mean? 2024-01-07 03:41:09,676 - clearml.Metrics - ERROR - Action ...
one year ago
0 Votes
5 Answers
69 Views
0 Votes 5 Answers 69 Views
Hey team some bug I noticed what I don't know how to tackle I have a project with active tasks from the main Projects page I can see it has 56 tasks under my...
9 days ago
0 Votes
4 Answers
504 Views
0 Votes 4 Answers 504 Views
is there a way to obtain the user id without the REST API? somewhere in the UI that users can obtain this?
8 months ago
0 Votes
2 Answers
778 Views
0 Votes 2 Answers 778 Views
Hey everyone anyone had experience with installing clearml-server on Openshift? I assume some modifications requires comapred to vanilla k8s installation (in...
10 months ago
0 Votes
2 Answers
792 Views
0 Votes 2 Answers 792 Views
How does ClearML handle running jobs while server is down? We saw some mismatches between what ClearML logged with the actual iteration, in time periods whil...
11 months ago
0 Votes
4 Answers
948 Views
0 Votes 4 Answers 948 Views
8 months ago
0 To Continue The Above Thought, How Do I Get A User'S Name From The User'S Id, But Through The Rest Api? Specifically I'D Like To Know How To Get This Object
      {
        "id": "c2e33466fd9de1a0d2be8d803ad4fbed",
        "company": "d1bd92a3b039400cbafc60a7a5b1e52b",
        "name": "John Doe",
        "family_name": "John",
        "given_name": "Doe",
        "created": "2024-09-24T06:13:59.956000+00:00"
      }

this is how the object looks like

8 months ago
0 To Continue The Above Thought, How Do I Get A User'S Name From The User'S Id, But Through The Rest Api? Specifically I'D Like To Know How To Get This Object

yep that was my approached with no luck so far
hopefully someone from the ClearML dev team can give their input on this

8 months ago
0 To Continue The Above Thought, How Do I Get A User'S Name From The User'S Id, But Through The Rest Api? Specifically I'D Like To Know How To Get This Object

correct, but!
I wrote a script that pulls tasks and limit for user
so I'm looking for users to knows their own id in advance

8 months ago
0 Hi, How Do I Enable Ssl With Our Self-Hosted Clearml-Server ?

I built an basic nginx container
` FROM nginx

COPY ./default.conf /etc/nginx/conf.d/default.conf

COPY ./includes/ /etc/nginx/includes/

COPY ./ssl/ /etc/ssl/certs/nginx/ copied the signed certificates and the modified nginx deafult.conf `

the important part is to modify the compose file to redirect all traffic to nginx container
` reverse:
container_name: reverse
image: reverse_nginx
restart: unless-stopped
depends_on:
- apiserver
- webserver
- fil...

2 years ago
0 Hi Everyone, Does Anyone Have Any Pointers On How To Make The Clearml-Server Web Service Secure Using Ssl By Setting Up Nginx? I Have Played Around With It A Bit In Relation To Getting A Jupyterhub Setup Working Over Https, However, I Think That Was Mor

Hi VivaciousPenguin66
thanks for sharing, giving it a try now

after you set up webserver to point to 443 with HTTPS, what have you done with rest of http services clearml is using?

does weberver with 8080 remained accessible and your are directing to it in your ~clearml.conf ?
what about apiserver and file server? (8008 & 8081)

3 years ago
0 Hi All We Have Set Nginx In Front Of Clearml And Signed With Our Own Self-Signed Certs I'M Trying To Modify The

I have tried some small task only uploads single file

logger = task.get_logger()
img = Image.open(f"./1_model.png").convert("RGB")
logger.report_image(title=f"cfg_0", series="Model", iteration=1, image=img)

ended with:

Retrying (Retry(total=0, connect=5, read=5, redirect=5, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)'))': /
202...
one year ago
0 Does Anyone Have

the way I do pagination is wrong
@<1523701070390366208:profile|CostlyOstrich36> might throw some champions tip over here 🙂

8 months ago
0 Does Anyone Have

OK I got everything to work
I think this script can be useful to other people and will be happy to share

@<1523701070390366208:profile|CostlyOstrich36> is there some repo I fork and contribute?

8 months ago
0 Does Anyone Have

I know the 500 limit and using it

but my while loop keeps pulling the same 500 ... and running endless

8 months ago
0 Does Anyone Have
offset = 0
limit = 500
all_data = []

while True:
    params = {
        'offset': offset,
        'limit': limit
    }
    
    response = requests.get(url, headers=headers, params=params,verify=False)
    
    data = response.json()
    projects = data['data']['projects']

    print(f"pulled {len(projects)} projects.")

    if len(projects) == 0:
        print("no project found - exiting ...")
        break    
    
    all_data.extend(projects)
    offset += limit

print(f"pulled {le...
8 months ago
0 Does Anyone Have

ohhh severe error here 🙂
I was mixed between other API I worked on .. and did not read carefully the right flag

simple adding page to the body did the work
thanks again @<1724235687256920064:profile|LonelyFly9>

8 months ago
0 Hi All We Have Set Nginx In Front Of Clearml And Signed With Our Own Self-Signed Certs I'M Trying To Modify The

@<1523701435869433856:profile|SmugDolphin23> working! here is what I have on Fedora/RHEL

  • copy certs to /etc/pki/ca-trust/source/anchors/
  • update-ca-trust
one year ago
0 Hey Everyone With Recent Changes In Dockerhub Policy, Very Soon We Will Lose Our Ability For Pull

you are correct and thank you for the reply @<1523701070390366208:profile|CostlyOstrich36>
going forward, I assume the clearml-server open-source releases will be continue to be released in Docker Hub

8 months ago
0 Hey Everyone With Recent Changes In Dockerhub Policy, Very Soon We Will Lose Our Ability For Pull

we will probably end up pulling the images from docker.io and pushing those to our container registry

8 months ago
0 Out Of A Sudden Without Any Trigger, Our Clearml Server (
app.component.ts:138 ERROR TypeError: Cannot read properties of null (reading 'id')
    at projects.effects.ts:60:56
    at o.subscribe.a (switchMap.js:14:23)
    at p._next (OperatorSubscriber.js:13:21)
    at p.next (Subscriber.js:31:18)
    at withLatestFrom.js:26:28
    at p._next (OperatorSubscriber.js:13:21)
    at p.next (Subscriber.js:31:18)
    at filter.js:6:128
    at p._next (OperatorSubscriber.js:13:21)
    at p.next (Subscriber.js:31:18)

and I see also when trying to...

one year ago
0 Out Of A Sudden Without Any Trigger, Our Clearml Server (

I didn't saw anything useful in elasic/mongo/api
I do significany slowness to query also my experiments

no filtering for sure

if I send link to task, sometimes it loads and sometimes it's stuck
image

one year ago
0 Hey Clearml Experts Is There A Way To Copy Entire Exp. Including Results/Scalars/Plots? Right Click > Clone Creates A Duplicate Of The Exp. , Only With It'S Configuration, Without It'S Results

to be honest, the use case is mostly convenience
when people train ~5000+ experiments, all saved in few sub folders with long string as experiment name

before publishing a paper for example, we want to move copy small numbers of successful training to separate location and share it with other colleagues/management

I'd guess the alternative can be
changing the name of the successful training under the existing sub folder
using move instead of clone
anything else?

one year ago
0 Hi There Clearml Experts I'Ve Been Trying To Delete Heavy Project (With ~4K Experiments) Using The Api And Getting The Following Error:

AgitatedDove14 indeed there are few sub projects
do you suggest to delete those first?

3 years ago
0 How Does Clearml Handle

@<1523701070390366208:profile|CostlyOstrich36> unfortunately, this is not the behavior we are seeing
same exact issue happen tonight
on epoch number 53 ClearML were shut down, the job did not continue to epoch 54 and eventually got killed with watchdog timer

11 months ago
0 Hey Team I Can See Last Clearml-Server Released On August, When New Release Going Public? I'M Going To Upgrade Our Env And Prefer To Update After Upcoming New Release

@<1523701070390366208:profile|CostlyOstrich36> sorry for not being clear enough
when is next version of clearml-server will be released? I can see last version is from August, is there any ETA for new release in upcoming 1-2 month?

7 months ago
0 Hey All I See This Error Repeating Constantly, And My Metrics Are Not Updated, What Does It Mean?

looking into ES index events-training_stats_scalar-d1bd92a3b039400cbafc60a7a5b1e52b

docs.count docs.deleted store.size pri.store.size
2118131043     29352476    265.1gb        265.1gb

sounds we're hitting some ES limitation?

one year ago
0 Hey All I See This Error Repeating Constantly, And My Metrics Are Not Updated, What Does It Mean?

unfortunately I couldn't fix this
the ES state in hectic, can't delete anything
clearml is still live, read-only mode, all existing indices are readable
new jobs can't write to this clearml server

one year ago
0 Hey Clearml Experts Does Anyone Working Example How Can Use The Sdk To Delete Tasks, Where Tasks I'Ds Will Come From Static List Of Id'S I'M Generating A Json File With List Of Tasks, Review Them Then I Want To Delete Them In Batch Something Similar To

thanks @<1523701070390366208:profile|CostlyOstrich36>
I've done this successfully using the API already
as for the sdk option - in which format should I provide the list of tasks/projects to the sdk?

for
only_fields=["id", "name","created","status_changed","status", "user"], :

output example

{'id': '02a3f5929cf246138994c9243a692219', 'name': 'docfm_v7_safe_32gpu80g_11Jan24_4w', 'created': datetime.datetime(2024, 1, 11, 9, 54, 33, 406000, tzinfo=tzutc()), 'status_changed': dateti...
8 months ago
0 Hey Clearml Experts Does Anyone Working Example How Can Use The Sdk To Delete Tasks, Where Tasks I'Ds Will Come From Static List Of Id'S I'M Generating A Json File With List Of Tasks, Review Them Then I Want To Delete Them In Batch Something Similar To

so I have large json, with list of task id's
which I want to delete in bulk

API is doable

how about the sdk? how do I provide a list of tasks id's to for deletion

from the cleanup example:

        for task in tasks:
            try:
                deleted_task = Task.get_task(task_id=task.id)
                deleted_task.delete(

how do I set tasks , while coming from known list of task id's

8 months ago
0 Out Of A Sudden Without Any Trigger, Our Clearml Server (

not sure it's same use case but I will begin to ask around people
if you have any other hint/way how to query mongo and look for potential culprit - will be glad to hear

one year ago
0 Out Of A Sudden Without Any Trigger, Our Clearml Server (

I think there are some experiments that are messing up mongodb
this logs unusual in clearml-mongo logs:

{"t":{"$date":"2023-09-19T12:15:50.685+00:00"},"s":"I",  "c":"COMMAND",  "id":51803,   "ctx":"conn73","msg":"Slow query","attr":{"type":"command","ns":"backend.model","command":{"distinct":"model","key":"project","query":{"$and":[{"$or":[{"company":{"$in":["d1bd92a3b039400cbafc60a7a5b1e52b",null,""]}},{"company":{"$exists":false}}]},{"user":{"$in":["197aea8467d3f471fc0db98b57ed80fa"]...
one year ago
Show more results compactanswers