Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
DilapidatedParrot58
Moderator
42 Questions, 205 Answers
  Active since 10 January 2023
  Last activity 2 years ago

Reputation

0

Badges 1

186 × Eureka!
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Clearml-Init Doesn'T Ask For Ports, And Our Server Exposes Ports That Are Different From Default Ones. It Would Be Great To Have An Option To Change Default Ports For Api, File And Web Servers, Otherwise Initialization Fails With Wrong Creds Error
clearml-init doesn't ask for ports, and our server exposes ports that are different from default ones. it would be great to have an option to change default ...
3 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Some Random Weird Feature Suggestions For The Future 1) It Would Be Great If You Could Export Key Experiment Data As Html Or Pdf Report 2) It Would Also Be Quite Nice To Have An Opportunity To Discuss Experiments In Trains Without Leaving The Web App 3)
some random weird feature suggestions for the future 1) it would be great if you could export key experiment data as html or pdf report 2) it would also be q...
5 years ago
0 Votes
0 Answers
2K Views
0 Votes 0 Answers 2K Views
Hey Guys, Do You Have Any Tutorials Or Examples Of Intergration With Dvc?
hey guys, do you have any tutorials or examples of intergration with dvc?
5 years ago
0 Votes
8 Answers
2K Views
0 Votes 8 Answers 2K Views
Yo Clearml Folks! How To Force-Reinstall Package From Github In Installed Packages? Tried Different Strategies (Using @Commit_Id, Versioning, Flag --Force-Reinstall), And It Keeps Saying That Requirement Is Already Satisfied (Old Version Of The Package Is
yo clearml folks! how to force-reinstall package from github in Installed Packages? tried different strategies (using @COMMIT_ID, versioning, flag --force-re...
4 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
Hey Guys, Is There A Ready Script That Can Delete All Models From S3 (Or Other Storage) That Are Related To Deleted Or Archived Experiments?
hey guys, is there a ready script that can delete all models from S3 (or other storage) that are related to deleted or archived experiments?
4 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
Hey Guys, Do You Have Any Plans To Add Functionality To Export Training Config With All Hyperparameters To The Different Formats, Such As Training Command Line Command, Yaml, Etc.?
hey guys, do you have any plans to add functionality to export training config with all hyperparameters to the different formats, such as training command li...
5 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
I'M Getting A Lot Of Errors When Running Cleanup Service
I'm getting A LOT of errors when running cleanup service Failed deleting the following URIs - script fails to delete image and text files ERROR - Failed dele...
3 years ago
0 Votes
4 Answers
2K Views
0 Votes 4 Answers 2K Views
Feature Request: Clearml Prints Github Token In The Log, When There Is "Repository Not Found" Error. It Would Be Nice If Could Hide It
feature request: ClearML prints GitHub token in the log, when there is "repository not found" error. it would be nice if could hide it
4 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
Any Chance Storagemanager Could Re-Download Files Only If Their Size Is Different From File In Cache (As An Option)?
any chance StorageManager could re-download files only if their size is different from file in cache (as an option)?
4 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Here I Am Again... Can'T Find How To Create A Custom Queue
here I am again... can't find how to create a custom queue
5 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Feature Request: We Have Several Servers With Multiple Gpus, And Atm We Have To Manually Check Which Gpu Has Enough Memory Before Queuing Each Experiment Into The Right Queue. It Would Be Cool If We Could Set Required Gpu Memory Parameter For Each Experim
feature request: we have several servers with multiple GPUs, and atm we have to manually check which GPU has enough memory before queuing each experiment int...
4 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
I’M Interested In Learning More About Internals Of Clearml Server - For Example, How Elasticsearch, Mongodb, And Redis Are Used Internally. Are There Any Materials Available?
I’m interested in learning more about internals of ClearML Server - for example, how ElasticSearch, MongoDB, and Redis are used internally. are there any mat...
3 years ago
0 Votes
10 Answers
2K Views
0 Votes 10 Answers 2K Views
What Is The Right Way To Increase Number Of Retries When Using
what is the right way to increase number of retries when using StorageManager.get_local_copy?
3 years ago
0 Votes
8 Answers
2K Views
0 Votes 8 Answers 2K Views
Downloading Output Artifacts From S3 By Clicking On The Download Button Next To Model Url Was Great, But Since We Moved From Aws To Yandex.Cloud, This Feature Doesn'T Work. Any Chance You Could Support Other Cloud Providers?
downloading output artifacts from S3 by clicking on the download button next to Model URL was great, but since we moved from AWS to Yandex.Cloud, this featur...
3 years ago
0 Votes
6 Answers
2K Views
0 Votes 6 Answers 2K Views
We Have A Use Case Where An Experiment Consists Of Multiple Docker Containers. For Example, One Container Works On Cpu Machine, Preprocesses Images And Puts Them Into Queue. The Second One (Main One) Resides On Gpu Machine, Reads Tensors And Targets From
we have a use case where an experiment consists of multiple docker containers. for example, one container works on CPU machine, preprocesses images and puts ...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
Hey Guys, A Question About Monthly Worker_Stats Indices Each Of Them Takes Up About 1Gb For Us. Do We Really Need To Keep All Of Them? Is There Any Way To Free Up The Space?
hey guys, a question about monthly worker_stats indices each of them takes up about 1gb for us. do we really need to keep all of them? is there any way to fr...
5 years ago
0 Votes
25 Answers
2K Views
0 Votes 25 Answers 2K Views
I'M Probably Stupid, But How Do I Specify Worker Name? Usecase - I Want To Create Two Workers Using The Same Gpu, And New Worker Just Overwrites The Old One
I'm probably stupid, but how do I specify worker name? usecase - I want to create two workers using the same GPU, and new worker just overwrites the old one
5 years ago
0 Votes
16 Answers
2K Views
0 Votes 16 Answers 2K Views
Yo Guys, I'M Getting
yo guys, I'm getting Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=None)) after connection broken by 'ConnectTimeoutError(, 'Connection to O...
5 years ago
0 Votes
13 Answers
2K Views
0 Votes 13 Answers 2K Views
It Would Be Nice To Group Experiments Within Projects Use Cases:
it would be nice to group experiments within projects use cases: hyperparameter sweep (10 experiments with different learning rate) finetuning models (for ex...
3 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
Step 3 Task (
Step 3 Task ( https://github.com/allegroai/trains/blob/master/examples/pipeline/step3_train_model.py ) - Loads the processed data (from Step 2) and clearml a...
4 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
Hey Guys, I Am Trying To Plan What I Need To Do In Order To Efficiently Use Clearml With Spot Instances 1) Detecting When Spot Instance Is Down And Experiment Is Aborted 2) Extracting S3 Address Of The Latest Checkpoint From Clearml Api 3) Starting New E
hey guys, I am trying to plan what I need to do in order to efficiently use ClearML with spot instances 1) detecting when spot instance is down and experimen...
4 years ago
0 Votes
5 Answers
2K Views
0 Votes 5 Answers 2K Views
Is There Any Way To Post Slack Alerts For The Frozen Experiments? (Eg, After Server Restart They Sometimes Get Stuck In Running Mode, Or
is there any way to post Slack alerts for the frozen experiments? (eg, after server restart they sometimes get stuck in Running mode, or https://github.com/p...
4 years ago
0 Votes
14 Answers
2K Views
0 Votes 14 Answers 2K Views
Hey Guys The First Time I'M Seeing This Behavior I'M Adding A New User To /Opt/Trains/Config/Apiserver.Conf And Restarting The Containers. All Old Users Are Able To Log In, But Not The New One (Invalid User/Password Combination). Any Ideas?
hey guys the first time I'm seeing this behavior I'm adding a new user to /opt/trains/config/apiserver.conf and restarting the containers. all old users are ...
5 years ago
0 Votes
3 Answers
2K Views
0 Votes 3 Answers 2K Views
Hey Guys, Thanks For Creating Slack Workspace, That'S Really Cool. Question - Are We Missing Smth Or Is Currently Not Possible To Pass S3 Credentials Via Env Variables? We Forked Trains And Added A Simple Fix (
hey guys, thanks for creating Slack workspace, that's really cool. question - are we missing smth or is currently not possible to pass S3 credentials via env...
5 years ago
0 Votes
16 Answers
2K Views
0 Votes 16 Answers 2K Views
Anyone Having Problems With Clearml Slowing Down Pytorch Experiments? Auto_Connect_Framework={“Pytorch”: False} Helps, But It’S Not A Great Solution. We Think It’S Related To Clearml Trying To Do Something At Each Dataloader Iteration. We’Ll Try To Provid
anyone having problems with ClearML slowing down pytorch experiments? auto_connect_framework={“pytorch”: False} helps, but it’s not a great solution. we thin...
3 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Is There Any Way To Export Csv With Max Metrics And Hyperparameters For Selected Experiments?
is there any way to export CSV with max metrics and hyperparameters for selected experiments?
4 years ago
0 Votes
11 Answers
2K Views
0 Votes 11 Answers 2K Views
We Can’T Add Overview To The Subprojects (Btw Thank You So Much For Subprojects, This Is Probably The Best Feature Ever Introduced To Trains/Clearml). Is It Intended? When I Click Overview For The Subproject, It Just Shows An Empty Page Without Any Button
we can’t add overview to the subprojects (btw thank you SO MUCH for subprojects, this is probably the best feature ever introduced to trains/clearml). is it ...
4 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
There Is Something Weird Going On With Console Log After Latest Updates Of Clearml Server. It Doesn'T Show The Latest Updates, Instead It Often Jumps To The Seemingly Random Parts Of The Console Output
there is something weird going on with console log after latest updates of ClearML Server. it doesn't show the latest updates, instead it often jumps to the ...
2 years ago
0 Votes
7 Answers
2K Views
0 Votes 7 Answers 2K Views
When We Train The Models, We Often Choose Checkpoint Based On The Validation Accuracy, But Test Set Accuracy (Or Specific Class Validation Accuracy) Is Not Necessarily The Best For This Checkpoint. Right Now There Are Options To Add Columns With Max And L
when we train the models, we often choose checkpoint based on the validation accuracy, but test set accuracy (or specific class validation accuracy) is not n...
4 years ago
0 Votes
2 Answers
2K Views
0 Votes 2 Answers 2K Views
Two Annoying Visual Bugs In Clearml Server Ui After Latest Update:
two annoying visual bugs in ClearML Server UI after latest update: experiment status is still shown as “Aborted” after successful resetting until you refresh...
3 years ago
Show more results questions
0 I Updated Trains-Server Today, And Now It'S Very Unstable, Web Interface Randomly Stops Working. Anyone Had The Same Problem? I'Ve Never Had Any Problems With Updating The Server Before

I decided to restart the containers one more time, this is what I got.

I had to restart Docker service to remove the containers

5 years ago
0 I Updated Trains-Server Today, And Now It'S Very Unstable, Web Interface Randomly Stops Working. Anyone Had The Same Problem? I'Ve Never Had Any Problems With Updating The Server Before

I'll get back to you with the logs when the problem occurs again

5 years ago
0 I Updated Trains-Server Today, And Now It'S Very Unstable, Web Interface Randomly Stops Working. Anyone Had The Same Problem? I'Ve Never Had Any Problems With Updating The Server Before

as a sidenote, I am not able to pull the newest release, looks like it's not pushed?
"Error response from daemon: manifest for allegroai/trains:0.14.2 not found"

5 years ago
0 I Updated Trains-Server Today, And Now It'S Very Unstable, Web Interface Randomly Stops Working. Anyone Had The Same Problem? I'Ve Never Had Any Problems With Updating The Server Before

I assume, temporary fix is to switch to trains-server?

5 years ago
0 I Updated Trains-Server Today, And Now It'S Very Unstable, Web Interface Randomly Stops Working. Anyone Had The Same Problem? I'Ve Never Had Any Problems With Updating The Server Before

hmmm allegroai/trains:latest whatever it is

5 years ago
0 I’M Interested In Learning More About Internals Of Clearml Server - For Example, How Elasticsearch, Mongodb, And Redis Are Used Internally. Are There Any Materials Available?

not quite. for example, I’m not sure which info is stored in Elastic and which is in MongoDB

3 years ago
0 Hey Guys, Here I Am Again With Another Question

hoooraaaay

5 years ago
0 I’M Interested In Learning More About Internals Of Clearml Server - For Example, How Elasticsearch, Mongodb, And Redis Are Used Internally. Are There Any Materials Available?

I guess I could manually explore different containers and their content 😃 as far as I remember, I had to update Elastic records when we moved to the new cloud provider in order to update model URLs

3 years ago
0 I’M Interested In Learning More About Internals Of Clearml Server - For Example, How Elasticsearch, Mongodb, And Redis Are Used Internally. Are There Any Materials Available?

got it, thanks!

3 years ago
0 Hi

all our workers went down after starting the slack bot, is it expected?)

5 years ago
0 Feature Request: We Have Several Servers With Multiple Gpus, And Atm We Have To Manually Check Which Gpu Has Enough Memory Before Queuing Each Experiment Into The Right Queue. It Would Be Cool If We Could Set Required Gpu Memory Parameter For Each Experim

got it, thanks!

4 years ago
0 Hey Guys, I'M Trying To Run An Experiment Using Trains-Agent. I Have A Custom Docker Image With Nightly Versions Of Pytorch And Our Own Library Installed From A Private Repo. I Was Assuming That These Packages Will Be Automatically Available To Trains Dur

it also happens sometimes during the run when tensorboard is trying to write smth to the disk and there are multiple experiments running. so it must be smth similar to the scenario you're describing, but I have no idea how it can happen since I'm running four separate workers

5 years ago
0 We Have A Use Case Where An Experiment Consists Of Multiple Docker Containers. For Example, One Container Works On Cpu Machine, Preprocesses Images And Puts Them Into Queue. The Second One (Main One) Resides On Gpu Machine, Reads Tensors And Targets From

I’ll let you know 😃

3 years ago
0 We Can’T Add Overview To The Subprojects (Btw Thank You So Much For Subprojects, This Is Probably The Best Feature Ever Introduced To Trains/Clearml). Is It Intended? When I Click Overview For The Subproject, It Just Shows An Empty Page Without Any Button

yeah, it works for the new projects and for the old projects that have already had a description

4 years ago
0 Hey Guys, I Keep Getting "Failed Parsing Task Parameter" Warning For The Arguments Such As This One:

done!

4 years ago
0 Hey Guys, I'M Trying To Run An Experiment Using Trains-Agent. I Have A Custom Docker Image With Nightly Versions Of Pytorch And Our Own Library Installed From A Private Repo. I Was Assuming That These Packages Will Be Automatically Available To Trains Dur

docker mode. they do share the same folder with the training data mounted as a volume, but only for reading the data.

awesome news 👍

5 years ago
0 I'M Getting A Lot Of Errors When Running Cleanup Service

self-hosted ClearML server 1.2.0
SDK version 1.1.6

3 years ago
0 I'M Using Tensorboard Summarywriter To Add Scalar Metrics For The Experiment. If Experiment Crashed, And I Want To Continue It From Checkpoint, For Some Reason It Plots Metrics In A Really Weird Way. Even Though I Pass Global_Step=Epoch To The Summarywrit

okay, so if there’s no workaround atm, should I create a Github issue?

4 years ago
0 I Keep Getting Errors When Trying To Compare A Lot Of Experiments At The Same Time (>10). What'S Evern Worse Is That Trains Start Working Much Slower In General After These Attempts, The Only Way To Fix It Is To Restart The Whole Thing. Would Getting Bett

tail of the api server log

5 years ago
0 It Would Be Nice To Group Experiments Within Projects Use Cases:

more like collapse/expand, I guess. or pipelines that you can compose after running experiments to see that experiments are connected to each other

3 years ago
0 Is Is Possible To Pass Custom

works like a charm!

3 years ago
0 I'M Getting A Lot Of Errors When Running Cleanup Service

I updated S3 credentials, I'll check if they work later

it doesn't explain inability to delete logged images and texts though

3 years ago
0 We Just Had A Slight Problem - There Was A Double Space In S3 Checkpoint Name, But Clearml Ui Prints Them As One In The Model Description. If You Copy And Paste It, The Address Will Be Wrong

sounds like an overkill for this problem, but I don’t see any other pretty solution 😃

2 years ago
0 Is Is Possible To Pass Custom

we're using os.getenv in the script to get a value for these secrets

3 years ago
0 Hey Guys, Is There A Ready Script That Can Delete All Models From S3 (Or Other Storage) That Are Related To Deleted Or Archived Experiments?

what if cleanup service is launched using ClearML-Agent Services container (part of the ClearML server)? adding clearml.conf to the home directory doesn't help

4 years ago
Show more results compactanswers