JuicyFox94

11 Questions, 382 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Badges 1

53 × Eureka!

Questions 11
Answers 382

0 Votes

23 Answers

1K Views

0 Votes 23 Answers 1K Views

Hi, I'M Trying To Set Storage Manager To Use Our Internal Miniio Installation But I Ran Into This Issue With This Testing Code:

Hi, I'm trying to set storage manager to use our internal MiniIO installation but I ran into this issue with this testing code: from trains import Task, Stor...

clearml

4 years ago

0 Votes

3 Answers

1K Views

0 Votes 3 Answers 1K Views

Hi, How Can I Obtain Current Task Using A Pipeline With Decorators? More Specific, I Need

Hi, how can I obtain current task using a pipeline with decorators? more specific, I need logger = task.get_logger()but I don't have task using pipelines dec...

clearml

3 years ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Hi Everyone, There Are 3 Pr On

Hi everyone, there are 3 PR on https://github.com/allegroai/trains-server-k8s/pulls that are still waiting in the wings after more than 20 days. There is any...

clearml

4 years ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

Since I’M Using Trains On K8S With My Team I Started To Dig Into The Helm Chart That Needs Tweaks. I Just Started Exploring The Chart So I Just Put A First Small Pr Here

Since I’m using Trains on K8s with my team I started to dig into the Helm chart that needs tweaks. I just started exploring the chart so I just put a first s...

clearml

4 years ago

0 Votes

0 Answers

1K Views

0 Votes 0 Answers 1K Views

Other Will Come In Near Future Hopefully

other will come in near future hopefully 😄

clearml

4 years ago

0 Votes

0 Answers

1K Views

0 Votes 0 Answers 1K Views

Hi everyone!

clearml

4 years ago

0 Votes

29 Answers

1K Views

0 Votes 29 Answers 1K Views

Hello Guys, I Have A Strange Situation With A Pipeline Controller I'M Testing Atm. If I Run The Controller Directly In My Pycharm On Notebook It Connects Correctly To The K8S Cluster With Trains Installed. After This, If I Go Directly In The Ui, I Reset T

Hello guys, I have a strange situation with a Pipeline Controller I'm testing atm. If I run the controller directly in my PyCharm on notebook it connects cor...

clearml

4 years ago

0 Votes

4 Answers

1K Views

0 Votes 4 Answers 1K Views

Hi Everyone, I Had A Request To Use

Hi everyone, I had a request to use task_overrides during a pipeline step. The goal is to set the OUTPUT DESTINATION on the fly so: pipe.add_step(name='creat...

clearml

3 years ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Hi, Do You Have A Channel For Dev/Contributors On Your Github Repos? I See Only A

Hi, do you have a channel for dev/contributors on your github repos? I see only a but no one si there. I think a specific dev channel would be great and help...

clearml

4 years ago

0 Votes

12 Answers

1K Views

0 Votes 12 Answers 1K Views

Just Curious About The Pipeline Decorator Example, I Tried To Run It In My Cluster (Latest Chart As Ususal

Just curious about the pipeline decorator example, I tried to run it in my cluster (latest chart as ususal 😄 ) and I got Traceback (most recent call last): ...

clearml

3 years ago

0 Votes

21 Answers

999 Views

0 Votes 21 Answers 999 Views

Hi Guys, Until Today I Always Requested Data Scientists To Use Cli To Create Tasks. After That I Usually Reconfigure Them So They Can Be Pointed On Git Repo And So On. Unfortunately This Is Becoming A Big Task Since Now We Have Pipelines With Many Tasks A

Hi guys, until today I always requested data scientists to use CLI to create tasks. After that I usually reconfigure them so they can be pointed on git repo ...

clearml

3 years ago

0 Hi! I Have Question About K8S Glue Agent. Is It Possible To Specify Clearml Config There The Same Way As It Is In Agentgroups? And Also Could You Please Clarify The Difference Between Agentgroups, Agentservices And K8S Glue Agent?

oh I got what the problem is

2 years ago

0 Hi, I Am Trying To Test The Whole Stack On My Local Machine But I Am Unable To Make

can you pls share output of helm list in clearml namespace ?

2 years ago

0 We'Re Trying To Upgrade Our Clearml On K8S But We'Re Getting This Error -

if yopu instruct apiserver to use s3 fileserver will not basically used anymore (I need SuccessfulKoala55 confirmation to be 100% sure, Im more infra guy :D )

2 years ago

0 Hi! I See There'S A New Release Of The Clearml-Agent Package, Is There Any Plan To Update The Allegroai/Clearml-Agent-K8S-Base Docker Image With This Version? In Particular, I Would Like To Use Multiple Queues When Running The Clearml-Agent Chart. I Tried

There’s an incomplete PR for this None .

9 months ago

0 Hello. I Am Running Clearml Server And Agents In K8S Using The Helm Charts. The Clearml Server Came Preconfigured With The 2 Queues: 'Default' And 'K8S_Scheduler'. I Have Created One More Queue 'Services' And Deployed 1 Agent For The 'Default' Queue And

at task completion do you get state Completed in UI?

2 years ago

0 Hi, I Am Trying To Test The Whole Stack On My Local Machine But I Am Unable To Make

Hi Tom; lets’ try to debug. Did you install all the charts in same namespace? Did you generate a key/secret pair from UI and the use them just in agent and serving chart?

2 years ago

0 Hi Guys, Until Today I Always Requested Data Scientists To Use Cli To Create Tasks. After That I Usually Reconfigure Them So They Can Be Pointed On Git Repo And So On. Unfortunately This Is Becoming A Big Task Since Now We Have Pipelines With Many Tasks A

` ❯ clearml-task --version
ClearML launch - launch any codebase on remote machine running clearml-agent
usage: clearml-task [-h] [--version] [--project PROJECT] --name NAME [--repo REPO] [--branch BRANCH]
[--commit COMMIT] [--folder FOLDER] [--script SCRIPT] [--cwd CWD] [--args [ARGS [ARGS ...]]]
[--queue QUEUE] [--requirements REQUIREMENTS] [--packages [PACKAGES [PACKAGES ...]]]
[--docker DOCKER] [--docker_args DOCKER_ARGS]
...

3 years ago

I think yes, at least this is whatI saw in docs

3 years ago

0 I Saw A Guide On Setting Up Clearml Server In Kubernetes.

if you need a not automated way to create the cluster I suggest to take in consideration helm chart only.

3 years ago

0 Hey, I’Ve Deployed Clearml On K8S With The Helm Charts In Repo “Allegroai/Clearml-Helm-Charts”. Is There A Way To Bind All Logs From Tasks Running On The Agents To Stdout So That They Will Be Visible On The Pod And Not Only Through The Ui? With “Kubectl L

I need to investigate, ScrawnyLion96 can you pls open an issue on https://github.com/allegroai/clearml-helm-charts ?

3 years ago

not a big issue but you maybe worth a quick fix

3 years ago

0 Hi, We Are Using Clearml On Gcp K8S Using The Clearml-Helm-Charts, We Noticed That After Restarting The Apiserver Pod, The User Credentials We Added For The Secret.Credentials.Apiserver And Secret.Credentials.Tests In The Values.Yaml Are Being Deleted Any

In this case I suggest to give a try to k8s-glue that is there by default in latest chart version

2 years ago

0 Hi, I Am Trying To Test The Whole Stack On My Local Machine But I Am Unable To Make

\o/

2 years ago

0 Hello Guys, I Have A Strange Situation With A Pipeline Controller I'M Testing Atm. If I Run The Controller Directly In My Pycharm On Notebook It Connects Correctly To The K8S Cluster With Trains Installed. After This, If I Go Directly In The Ui, I Reset T

this configuration object is stored as a file in /root/.trains ?

4 years ago

0 Hi, I'M Trying To Set Storage Manager To Use Our Internal Miniio Installation But I Ran Into This Issue With This Testing Code:

as usual it starts small and after 5 mins discussion is getting challenging 😄 I love this stuff... let me think a bit about it I will get back to you asap on this.

4 years ago

0 When I Run

annotations:
http://nginx.ingress.kubernetes.io/proxy-body-size: "0"
http://nginx.ingress.kubernetes.io/proxy-read-timeout: "600"
http://nginx.ingress.kubernetes.io/proxy-send-timeout: "600"

2 years ago

It should work I think :)

2 years ago

clearml-agent 1.1.0 released

2 years ago

running tests

2 years ago

0 Hi! Working On Deploying Clearml To Aws Eks And Looking For A Way To Initialize Projects And Designated Queues For Agents. Are There Any Best Practices For This Or Should I Just Add A Command When Starting Up The Api Server (I.E., Send Some Http Requests

then enjoy :D

2 years ago

hopefully this will fix the issue

2 years ago

not totally sure tbh

2 years ago

0 Hi I Have A Problem (Presumably) With K8Sglue-Agents Working Roughly 50% Of The Time. Basically What Happens Is When I Launch A Pipeline From Command Line, It Ends Up In "Pending" State And Dissapears From All Of The Queues. Initially It First Appears On

This is clearly a network issue; first I’d check there are no restarts of apiserver during that timespan. It’s not easy to debug this since it looks to be random but it can be interesting to check k8s networking configuration overall just to be sure.

2 years ago

I’m going to investigate (and fix it if possible) in some day

3 years ago

0 Is There A Way To Deploy It Without Using Kind? Seems That Kind Taking Over The Control-Plane Configuration In A Way I Can'T See The Other Pods Or Nodes That Keep Running

this is a clear issue with provisioner not handling the pvc request for any pod having a pvc. It’s not related chart but provisioner you are suing that probably doesn’t support dynamic allocation. what provisioner are you using?

2 years ago

Hi ApprehensiveSeahorse83 , today we released clearml-agent chart that just installs glue agent. My suggestion is to disable k8s glue and any other agent from the clearml chart and install more than one clearml-agent chart in different namespaces. In this way you will be able to have k8s glue for every queue (cpu and gpu).

2 years ago

uh it would be interesting if you can include it in chart and push a PR :D

2 years ago

k8s cluster can access ubuntu archive?

2 years ago

0 Hey Hey, I Having Trouble With Clearml And Albs In The Aws. Could Someone Help Me?

in some second it should became green

2 years ago

0 I Have A Kubernetes Setup Of Clearml 1.7.2 Done With The Official Helm Charts. When I Upgrade To The Latest Version Of Clearml With The Newest Helm Charts, Will The Existing Data Be Migrated (Mongo, Elastic, Redis) ?

Can you pls share helm list output?

one year ago

Show more results