FrustratingBee69

6 Questions, 8 Answers

Active since 04 May 2023

Last activity 16 days ago

Reputation

Badges 1

8 × Eureka!

Questions 6
Answers 8

0 Votes

5 Answers

949 Views

0 Votes 5 Answers 949 Views

Hi Everyone, I Have Some Questions Regarding Clearml Aws_Autoscaler.Py.

Hi everyone, I have some questions regarding clearml aws_autoscaler.py. First one: On AWS machine agent runs with this command: python -m clearml_agent --con...

aws mlops

one year ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

Hi! I Have Deployed A Cm Server + Agent On A Bm Kubernetes Cluster And Am Trying To Set The Default Docker Image For Running Trains. I Have Specified The Default Docker Image In Clearml.Conf In The Agent And Added An Environment Variable To The Api Server

Hi! I have deployed a CM server + agent on a BM Kubernetes cluster and am trying to set the default docker image for running trains. I have specified the def...

mlops

one year ago

0 Votes

3 Answers

743 Views

0 Votes 3 Answers 743 Views

Hi! Once Again, I'M Having Trouble With The Autoscaler. If The 'Setup Shell Script' Field Is Present, The Task Won'T Start. It Woulf Install All The Requirements In The Newly Created Instance And Then Stop. My Setup Script Is:

Hi! Once again, I'm having trouble with the autoscaler. If the 'setup shell script' field is present, the task won't start. It woulf install all the requirem...

clearml

one year ago

0 Votes

3 Answers

93 Views

0 Votes 3 Answers 93 Views

Hi All, Once Again, I Want To Ask If There Is Any Convenient Way To Pass Ebs Disk Throughput/Iops Values To Aws Autoscaler Parameters?

Hi all, Once again, I want to ask if there is any convenient way to pass EBS disk throughput/IOPS values to AWS autoscaler parameters?

mlops

26 days ago

0 Votes

1 Answers

109 Views

0 Votes 1 Answers 109 Views

Hi All! I Have A Question Regarding Aws Auto-Scaler. Is There A Way To Set Ebs Throughput And Iops? It Is Created With Baseline Values, Which Is Too Low For Our Purposes. Thank You!

Hi all! I have a question regarding AWS Auto-Scaler. Is there a way to set EBS throughput and iops? It is created with baseline values, which is too low for ...

clearml

one month ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Hi Again! Is There An Easy Way To Set The –Shm-Size For A Task Pod In A Kubernetes Environment? I Guess Docker Args Won’T Work, And As Far As I Know, I Should Mount An Emptydir Into /Dev/Shm With A Memory Limit. Is It Possible To Set Up The Agent To Spaw

Hi again! Is there an easy way to set the –shm-size for a task pod in a kubernetes environment? I guess docker args won’t work, and as far as I know, I shoul...

kubernetes mlops

one year ago

0 Hi Everyone, I Have Some Questions Regarding Clearml Aws_Autoscaler.Py.

@<1523701205467926528:profile|AgitatedDove14>

Hi!

I guess all the problems are resolved.

First one: Task parameters, for sure.

Second one: I've looked into our ML engineer's code, and they were using boto3 to download S3 data, not the ClearML API. I guess that's the problem, but I'll find out for sure only tomorrow.

Third one: I've copied the configuration in the UI, and for some reason, it worked :woman-shrugging:

Thank you for your involvement!

one year ago

0 Hi Everyone, I Have Some Questions Regarding Clearml Aws_Autoscaler.Py.

Oh, thank you! That's definitely the case.

I'll try to set some SDK parameters you mentioned in my other thread aswell :)

one year ago

0 Hi Again! Is There An Easy Way To Set The –Shm-Size For A Task Pod In A Kubernetes Environment? I Guess Docker Args Won’T Work, And As Far As I Know, I Should Mount An Emptydir Into /Dev/Shm With A Memory Limit. Is It Possible To Set Up The Agent To Spaw

Thanks! Works great with template.

one year ago

0 Hi All, Once Again, I Want To Ask If There Is Any Convenient Way To Pass Ebs Disk Throughput/Iops Values To Aws Autoscaler Parameters?

I might do actually!
Thanks

16 days ago

0 Hi! Once Again, I'M Having Trouble With The Autoscaler. If The 'Setup Shell Script' Field Is Present, The Task Won'T Start. It Woulf Install All The Requirements In The Newly Created Instance And Then Stop. My Setup Script Is:

@<1523701070390366208:profile|CostlyOstrich36> I'm launching it via AWS Autoscaler. Is there any configuration to allow spawning tasks outside docker?

one year ago

I was trying to

"Remove the default docker image (UI) or set it to None (SDK) to signal ClearML to run the agent without docker"But it didn't work for me. Upon starting, agent trying to run task with arg '--docker None' or '--docker none:latest',

Task itself defines docker image as 'None' if value is empty.

one year ago

0 Hi All, Once Again, I Want To Ask If There Is Any Convenient Way To Pass Ebs Disk Throughput/Iops Values To Aws Autoscaler Parameters?

Nevermind, I've achieved it by rewriting aws_driver

25 days ago

0 Hi All! I Have A Question Regarding Aws Auto-Scaler. Is There A Way To Set Ebs Throughput And Iops? It Is Created With Baseline Values, Which Is Too Low For Our Purposes. Thank You!

Maybe there's option to launch instance from template? That would help

one month ago