LazyLeopard18

6 Questions, 27 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Badges 1

27 × Eureka!

Questions 6
Answers 27

0 Votes

3 Answers

1K Views

0 Votes 3 Answers 1K Views

I Am Looking For A "Hello World" Example To Do 3 Tasks: Data=Preprocessdata() //Local Processing Model=Trainmodel(Data) // On Cloud Processing On A Custom Container Say Using Pytorch Or Keras Results=Evaluatemodel(Model, Testdata) //Local Processing

I am looking for a "hello world" example to do 3 Tasks: data=preprocessData() //local processing model=trainModel(data) // on cloud processing on a custom co...

pytorch

4 years ago

0 Votes

17 Answers

1K Views

0 Votes 17 Answers 1K Views

Having Issues Running Trains-Server On Win10. Trains-Elastic Exited With Code 137 Trains-Mongo Exited With Code 100 Trains-Apiserver Exited With Code 1 Some Errors=> Requests.Exceptions.Connectionerror: Httpconnectionpool(Host='Elasticsearch', Port=9200

Having issues running trains-server on Win10. trains-elastic exited with code 137 trains-mongo exited with code 100 trains-apiserver exited with code 1 Some ...

clearml

4 years ago

0 Votes

9 Answers

1K Views

0 Votes 9 Answers 1K Views

Is Trains Adaptable For Federated Learning Scenarios?

Is trains adaptable for federated learning scenarios?

clearml

4 years ago

0 Votes

4 Answers

1K Views

0 Votes 4 Answers 1K Views

Anyone Deployed Trains On Azure, I Am Interested To Know About Your Experience.

Anyone deployed trains on azure, I am interested to know about your experience.

clearml

4 years ago

0 Votes

11 Answers

1K Views

0 Votes 11 Answers 1K Views

Upon Calling Task.Init(), I Get Below Error: Failed Getting Token (Error 401 From

Upon calling Task.init(), I get below error: Failed getting token (error 401 from http://localhost:8008 ): Unauthorized (invalid credentials) (failed to loca...

clearml

4 years ago

0 Votes

11 Answers

1K Views

0 Votes 11 Answers 1K Views

Trains[Azure] Install - Azure Dependencies Not Latest. Trains Depends On Older Version Of Azure Python Sdk. My Project Already Has Dependency On The Latest Version. How Can This Be Resolved? Installing Collected Packages: Azure-Storage-Common, Azure-Stor

trains[azure] install - Azure dependencies not latest. trains depends on older version of azure python sdk. My project already has dependency on the latest v...

azure

4 years ago

0 Trains[Azure] Install - Azure Dependencies Not Latest. Trains Depends On Older Version Of Azure Python Sdk. My Project Already Has Dependency On The Latest Version. How Can This Be Resolved? Installing Collected Packages: Azure-Storage-Common, Azure-Stor

There already seems to be support for multiple containers in the code.
Is there an example to configure multiple storage accounts?

4 years ago

I just installed trains[azure]. Since all my data is on Azure. I don't know about StorageManager.

4 years ago

0 Anyone Deployed Trains On Azure, I Am Interested To Know About Your Experience.

I use AzureML, and like to try trains.
First, how to setup trains-server on Azure.
And then...
AzureML allows to trains on low prio clusters.
How can I configure and setup low prio training clusters and connect them to trains.

4 years ago

0 Anyone Deployed Trains On Azure, I Am Interested To Know About Your Experience.

Will try, thank you.

4 years ago

0 I Am Looking For A "Hello World" Example To Do 3 Tasks: Data=Preprocessdata() //Local Processing Model=Trainmodel(Data) // On Cloud Processing On A Custom Container Say Using Pytorch Or Keras Results=Evaluatemodel(Model, Testdata) //Local Processing

I have ~100GB of data that I do not wish to upload to the trains-server. Instead, I would like to have them copied only to host machine (azure container) at training time.
The data is in Azure blob storage and will be copied using a custom script just before training starts.

4 years ago

0 Is Trains Adaptable For Federated Learning Scenarios?

Is there documentation for (2) available for evaluation?

4 years ago

0 Is Trains Adaptable For Federated Learning Scenarios?

Federated learning is about sending code to where data exists, training local models and aggregating them in a central place.
Can existing design support this or extensions need to be built?

4 years ago

0 Is Trains Adaptable For Federated Learning Scenarios?

Would be nice to have a reference implementation

4 years ago

0 Is Trains Adaptable For Federated Learning Scenarios?

Will do , thanks

4 years ago

I surely can, will let you know.

4 years ago

Also, each task might need its own configuration. Data are usually stored in multiple containers. Rather than a single configuration, there should be possibility to do it per task.

4 years ago

I see that _AzureBlobServiceStorageDriver need to be updated. Anything else?

4 years ago

0 Upon Calling Task.Init(), I Get Below Error: Failed Getting Token (Error 401 From

I did git clone, not pip install

4 years ago

0 Upon Calling Task.Init(), I Get Below Error: Failed Getting Token (Error 401 From

go tit

4 years ago

0 Upon Calling Task.Init(), I Get Below Error: Failed Getting Token (Error 401 From

where do I run trains-init from?

4 years ago

0 Upon Calling Task.Init(), I Get Below Error: Failed Getting Token (Error 401 From

got it

4 years ago

0 Having Issues Running Trains-Server On Win10. Trains-Elastic Exited With Code 137 Trains-Mongo Exited With Code 100 Trains-Apiserver Exited With Code 1 Some Errors=> Requests.Exceptions.Connectionerror: Httpconnectionpool(Host='Elasticsearch', Port=9200

trains-apiserver | [2020-07-10 13:33:29,269] [8] [ERROR] [trains.updates] Failed obtaining updates
trains-apiserver | Traceback (most recent call last):
trains-apiserver | File "/opt/trains/server/updates.py", line 96, in _check_updates
trains-apiserver | response = self._check_new_version_available()
trains-apiserver | File "/opt/trains/server/updates.py", line 48, in _check_new_version_available
trains-apiserver | uid = Settings.get_by_key("server.uuid")
trains-apiserver | Fil...

4 years ago

I tried a slightly different approach that seems to work.
docker volume create --name=mongodata
And configured mogodat data in docker-compose file

4 years ago

Web server port is modified and changed c:\opt to d:\opt

4 years ago

Above command and yaml file are working in Win10

4 years ago

docker volume create --name=mongodata

4 years ago

Looks like a mongodb and NTFS issue
https://github.com/docker-library/mongo/issues/190

4 years ago

Sure, let me test its completely working

4 years ago

https://stackoverflow.com/questions/54911021/unable-to-start-docker-mongo-image-on-windows

4 years ago

Checked. Only change I had to make was to increase memory to 4GB. Still there are errors.
I think errors are related to network and permission.

4 years ago

0 Upon Calling Task.Init(), I Get Below Error: Failed Getting Token (Error 401 From

🙂 I could not locate this file!

4 years ago

0 Is Trains Adaptable For Federated Learning Scenarios?

For now I am trying to achieve (1). But the goal is (2)

4 years ago