AstonishingSeaturtle47

5 Questions, 10 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Badges 1

10 × Eureka!

Questions 5
Answers 10

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Hi, Is There A Way To See How Many Experiments Are In Each Queue, Using Api/Python Code?

Hi, Is there a way to see how many experiments are in each queue, using API/Python code?

clearml

4 years ago

0 Votes

3 Answers

1K Views

0 Votes 3 Answers 1K Views

Hi Guys, We Consider Using Trains Experiment Manager And I Wonder Is There A Way To Backup All Experiment Data? In Case The Backend Machine Will Die And The Data Will Die With It.

Hi guys, We consider using Trains Experiment Manager and I wonder Is there a way to backup all experiment data? in case the backend machine will die and the ...

clearml

4 years ago

0 Votes

5 Answers

1K Views

0 Votes 5 Answers 1K Views

Hi, I Have A Question On The Trains-Server. Assuming I Am Using The Docker-Compose, I Would Like To Backup All Data As Introduced In The Upgrading Tutorial. What Will Happened If I Will Run

Hi, I have a question on the trains-server. Assuming I am using the docker-compose, I would like to backup all data as introduced in the upgrading tutorial. ...

clearml

4 years ago

0 Votes

5 Answers

1K Views

0 Votes 5 Answers 1K Views

Hi, Is It Possible To Resume An Experiment That Stopped Unexpectedly, By Using A Checkpoint Of The Model?

Hi, Is it possible to resume an experiment that stopped unexpectedly, by using a checkpoint of the model?

clearml

4 years ago

0 Votes

9 Answers

1K Views

0 Votes 9 Answers 1K Views

Hi, I Am Trying To Start A Poc With Server And Agent And A Git Repository That Has A Submodule. I Don'T Need The Agent To Try To Fetch The Submodule, Is There A Way To Control The Clone Command? Avoid Calling Submodules?

Hi, I am trying to start a POC with server and agent and a git repository that has a submodule. I don't need the agent to try to fetch the submodule, is ther...

mlops

4 years ago

0 Hi, I Am Trying To Start A Poc With Server And Agent And A Git Repository That Has A Submodule. I Don'T Need The Agent To Try To Fetch The Submodule, Is There A Way To Control The Clone Command? Avoid Calling Submodules?

I had a problem that related to deploy keys since each git repository needs a different deploy key. And both uses the same hostname, it failed, I hacked it using an alias of the submodule git host name

4 years ago

As for credentials issue it is a github issue where you can not add same deploy-key to two different repositories (If I am wrong here please let me know) .
As for a solution you are right, I would add flag that to the agent for example --submodules-pull <true|false>.

4 years ago

0 Hi, Is There A Way To See How Many Experiments Are In Each Queue, Using Api/Python Code?

10x

4 years ago

0 Hi, Is It Possible To Resume An Experiment That Stopped Unexpectedly, By Using A Checkpoint Of The Model?

Is it considered the same experiment? Is it possible to use the trains-agent? Submit a resume from the UI?

4 years ago

Wow very Nice thanks AgitatedDove14

4 years ago

Well it is a bit ugly. I changed the hostname of my submodule then I added another key in the .ssh/config file. The problem is that now, who ever uses this repo needs to do something about that, so in order to avoid issues with the developers I added an alias in AWS (route 53 CNAME) from my-new-hostname to http://github.com . AgitatedDove14 Does that make sense to you?

4 years ago

0 Hi, I Have A Question On The Trains-Server. Assuming I Am Using The Docker-Compose, I Would Like To Backup All Data As Introduced In The Upgrading Tutorial. What Will Happened If I Will Run

Thanks you

4 years ago

0 Hi Guys, We Consider Using Trains Experiment Manager And I Wonder Is There A Way To Backup All Experiment Data? In Case The Backend Machine Will Die And The Data Will Die With It.

So you suggest that if I backup /opt/trains (assuming I use the docker-compose option on linux) I will be able to recover from it. Thanks for the fast reply

4 years ago

0 Hi, Is It Possible To Resume An Experiment That Stopped Unexpectedly, By Using A Checkpoint Of The Model?

Yes, Thanks

4 years ago

0 Hi, I Have A Question On The Trains-Server. Assuming I Am Using The Docker-Compose, I Would Like To Backup All Data As Introduced In The Upgrading Tutorial. What Will Happened If I Will Run

Thanks, SuccessfulKoala55 So if that's the case what will happened if I will stop server (docker-compose stop) while agent is running an experiment? I tested it, and it seems that the experiment is continue running without any issues.

4 years ago