BoredHedgehog47

27 Questions, 213 Answers

Active since 10 January 2023

Last activity 10 months ago

Reputation

Badges 1

212 × Eureka!

Questions 27
Answers 213

0 Votes

14 Answers

1K Views

0 Votes 14 Answers 1K Views

Hey All, Is There Any Reason The Python Sdk

Hey all, is there any reason the python sdk clearml would cause subprocess issues? I'm calling returncode = Popen(cmd).wait() and getting File "/usr/lib64/py...

clearml

2 years ago

0 Votes

7 Answers

1K Views

0 Votes 7 Answers 1K Views

Was There Any Changes To Clearml Python Sdk In The Past 24 Hours?

Was there any changes to clearML python SDK in the past 24 hours?

clearml

2 years ago

0 Votes

4 Answers

1K Views

0 Votes 4 Answers 1K Views

Yesterday I Executed An Experiment In Our Hosted Clearml Cluster. After The Experiment Was Finished, We Got An Aws Guard Duty Notification About Suspicious Outbound Traffic From The Ec2 That Executed The Job. It Looks Like The Tag Being Used Is Hardcoded

Yesterday I executed an experiment in our hosted clearML cluster. After the experiment was finished, we got an AWS guard duty notification about suspicious o...

clearml

2 years ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

Where I Can Change This Host Name Using The Helm Charts? I Got This Error When My Task Is Fetching A Dataset.

Where I can change this host name using the helm charts? I got this error when my task is fetching a dataset. 2022-09-23 15:09:45,318 - clearml.storage - ERR...

clearml

2 years ago

0 Votes

10 Answers

1K Views

0 Votes 10 Answers 1K Views

Is There Any Examples Of Mounting An Aws Efs Mount To A Self Hosted K8 Agent Deploy?

Is there any examples of mounting an AWS EFS mount to a self hosted k8 agent deploy? https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearm...

mlops

2 years ago

0 Votes

30 Answers

1K Views

0 Votes 30 Answers 1K Views

When I Run An Experiment (Self Hosted), I Only See Scalars For Gpu And System Performance. How Do I See Additional Scalars? I Have

When I run an experiment (self hosted), I only see scalars for GPU and System performance. How do I see additional scalars? I have "tensorboard": { "enabled"...

tensorboard

2 years ago

0 Votes

3 Answers

1K Views

0 Votes 3 Answers 1K Views

In My Git Repo, I Have A

In my git repo, I have a setup.py , how would I run pip install -e . rather than using --packages or --requirements

clearml

2 years ago

0 Votes

30 Answers

1K Views

0 Votes 30 Answers 1K Views

When I Do

When I do Dataset.get why does the SDK use clearml.storage - ERROR - Could not download http://files.clearml.myhost.com vs using what is defined on the agent...

mlops

2 years ago

0 Votes

8 Answers

1K Views

0 Votes 8 Answers 1K Views

When I Run

When I run clearml-data close on an 84mb file, I get the following response 413 Request Entity Too Large 413 Request Entity Too Large nginxYet the file is st...

dataset

2 years ago

0 Votes

0 Answers

1K Views

0 Votes 0 Answers 1K Views

Hey Everyone, I'M Trying To Add A Test User To The Api Server Config. Here Is A Snippet Form My Values.Yaml File. Do I Have This Formatted Correctly? I'M Not Seeing Api Config Map In The K8 Cluster

Hey everyone, I'm trying to add a test user to the api server config. Here is a snippet form my values.yaml file. Do I have this formatted correctly? I'm not...

clearml

2 years ago

0 Votes

30 Answers

1K Views

0 Votes 30 Answers 1K Views

I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

I'm trying to configure the glue agent to use AWS ECR via helm charts. Below is my configuration. It is not pulling the image though, it is failing with K8S ...

mlops

2 years ago

0 Votes

13 Answers

1K Views

0 Votes 13 Answers 1K Views

Apiserver: Service: Type: Clusterip Configuration: Additionalconfigs: Apiserver.Conf: | Auth { Fixed_Users { Enabled: True Pass_Hashed: False Users: [ {

apiserver: service: type: ClusterIP configuration: additionalConfigs: apiserver.conf: | auth { fixed_users { enabled: true pass_hashed: false users: [ { user...

clearml

2 years ago

0 Votes

14 Answers

1K Views

0 Votes 14 Answers 1K Views

Does Clearml Have The Ability To Run A Single Experiment Across Multiple Nodes/Gpus In A K8 Cluster?

Does ClearML have the ability to run a single experiment across multiple nodes/GPUs in a k8 cluster?

clearml

2 years ago

0 Votes

17 Answers

1K Views

0 Votes 17 Answers 1K Views

Or Is It Just The Ubuntu Official Image

or is it just the ubuntu official image https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml-agent/values.yaml#L59

clearml

2 years ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

What Does This Log Message Mean

What does this log message mean ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start ?

clearml

2 years ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

In A Nutshell, What Do I Need For The Clearml Agent To Scale Ec2 Nodes In The K8 Cluster, In Terms Of Helm Configuration? I Assume Aws Credentials, Is There Anything Else?

In a nutshell, what do I need for the clearML agent to scale EC2 nodes in the k8 cluster, in terms of helm configuration? I assume AWS credentials, is there ...

mlops

2 years ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

Also Is This The Image That Is Used For Experiments?

Also is this the image that is used for experiments? https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml-agent/values.yaml#L38-L39

clearml

2 years ago

0 Votes

2 Answers

1K Views

0 Votes 2 Answers 1K Views

If I Leave

If I leave WORKING DIRECTORY empty in the experiment configuration (in the UI), will that use the git project root by default?

clearml

2 years ago

0 Votes

2 Answers

2K Views

0 Votes 2 Answers 2K Views

If I Have An Aws Key/Secret For An Iam User, What Is The Best Way To Pass In These Credentials So The Task Docker Container Has Credentials Generated For Usage With Boto3?

If I have an AWS key/secret for an IAM user, what is the best way to pass in these credentials so the task docker container has credentials generated for usa...

clearml

2 years ago

0 Votes

7 Answers

1K Views

0 Votes 7 Answers 1K Views

Is There Any Additional Configuration Needed For

Is there any additional configuration needed for PYTHONPATH to be setup properly in the clearml agent? I'm getting python import errors from the root directo...

clearml

2 years ago

0 Votes

18 Answers

1K Views

0 Votes 18 Answers 1K Views

I'M New To Using Datasets, If My Git Project Root Is

I'm new to using datasets, if my git project root is myProject and I expect file.json to be at the root level, how do I accomplish this?

clearml

2 years ago

0 Votes

16 Answers

1K Views

0 Votes 16 Answers 1K Views

When I Try To Create Experiment In The Ui All I See Is This Dialogue

When I try to create experiment in the UI all I see is this dialogue

clearml

2 years ago

0 Votes

6 Answers

1K Views

0 Votes 6 Answers 1K Views

How Do I Create An Experiment Where I Can Set The Github Repository/Branch Name/Script Path Like This Example Shows?

How do I create an experiment where I can set the github repository/branch name/script path like this example shows?

clearml

2 years ago

0 Votes

30 Answers

1K Views

0 Votes 30 Answers 1K Views

In Order For A New Worker To Come Online In My K8 Cluster, Do I Need To Have An Ec2 Startup Script Init The Agent/Config, And Then Start The Daemon? Do I Have To Do This Manually Is This A Better Way?

In order for a new worker to come online in my k8 cluster, do I need to have an EC2 startup script init the agent/config, and then start the daemon? Do I hav...

clearml

2 years ago

0 Votes

31 Answers

38K Views

0 Votes 31 Answers 38K Views

When My Remote Task Is Installing The Python Dependencies

When my remote task is installing the python dependencies --packages requests for example, is there any caching "magic" that is done by the k8 agent? Or is i...

clearml

2 years ago

0 Votes

15 Answers

1K Views

0 Votes 15 Answers 1K Views

Hey All, I'M Testing The Usage Of

Hey all, I'm testing the usage of SETUP SHELL SCRIPT in the experiment window. I added a simple command but did not see it in the console. The task did execu...

clearml

2 years ago

0 Votes

30 Answers

1K Views

0 Votes 30 Answers 1K Views

Why Am I Getting A 403 From File Server When The K8 Glue Agent Is Initializing ?

Why am I getting a 403 from file server when the k8 glue agent is initializing ?

mlops

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

I can open a PR

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

I think the quotes don't effect the yaml

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

Yea this is a bug

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

AgitatedDove14 note the missing brackets https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml-agent/templates/agentk8sglue-deployment.yaml#L22

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

Can you fix this or should I open a PR. I'm blocked by this.

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

You guys are the maintainers of this repo

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

I learned helm a few days ago

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

I dont know how to do that

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

Yes! Thanks so much for the quick turnaround

2 years ago

0 Where I Can Change This Host Name Using The Helm Charts? I Got This Error When My Task Is Fetching A Dataset.

Figured this out, the value is parsed from my local clearml.conf file

2 years ago

0 When I Run

okay I will try that

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

I made the PR here JuicyFox94 AgitatedDove14 https://github.com/allegroai/clearml-helm-charts/pull/106

2 years ago

0 When I Run

Would that be under values.yaml for agent?

2 years ago

0 When I Run

On a somewhat related note to k8s, do you know where I can change this host name? I got this error when my task is fetching a dataset.
2022-09-23 15:09:45,318 - clearml.storage - ERROR - Could not download

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

https://github.com/allegroai/clearml-helm-charts/pull/107

2 years ago

0 If I Have An Aws Key/Secret For An Iam User, What Is The Best Way To Pass In These Credentials So The Task Docker Container Has Credentials Generated For Usage With Boto3?

Thanks that worked, I had to set the AWS_PROFILE as well

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

Thanks everyone!

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

For instance, quotes are used

2 years ago

0 Where I Can Change This Host Name Using The Helm Charts? I Got This Error When My Task Is Fetching A Dataset.

err maybe not, I dont know where its being fetched

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

I'm not familiar with helm that well to clone this, fix it, and then test

2 years ago

0 When I Do

AgitatedDove14 Will I need sudo permissions if I add this script to extra_docker_shell_script
echo "192.241.xx.xx venus.example.com venus" >> /etc/hosts

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

Yea that is a similar bug, needs the same fix

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

Its clearly a bug

2 years ago

0 I'M Trying To Configure The Glue Agent To Use Aws Ecr Via Helm Charts. Below Is My Configuration. It Is Not Pulling The Image Though, It Is Failing With

Seems like its just missing the brackets

2 years ago

0 Hey, What Is The Recommended Approach To Speed Up The Spin Up Of A Task In A Gcp Autoscaled Instance ? It Takes 20Mins To Build The Venv Environment Needed By The Clearml-Agent To Run It, Would Providing A Vm Image With Preinstalled Pip Packages On It Hel

It takes about 30 seconds here for that step

2 years ago

0 When I Do

Is this a config file on your side or something I can change, if we had enterprise version?

2 years ago

0 When I Run

nginx

2 years ago

0 When I Do

Does that make sense

2 years ago

0 When I Do

I suppose a short term hack would to just edit the /etc/hosts file and redirect the public url to k8 dns url?

2 years ago

0 When I Do

If you submit your task using the CLI does it still work?

2 years ago

Show more results