TrickySheep9

71 Questions, 428 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Badges 1

383 × Eureka!

Answers 428

0 When Running An Experiment From A Notebook, It Knows It’S A Notebook And Automatically Adds The Notebook As An Artifact Right? And The Uncommited Changes Becomes The Nottebook Converted To A Script? In One Case I Am Seeing Actual Git Diff Coming In Instea

I always have my notebooks in git repo but suddenly it's not running them correctly.

4 years ago

0 Hi Guys, I Want Automate The Clearml-Init In A Docker Container. Ideally I Would Do This By Having The Clearml.Conf File In The Container And Then Read In Env Variables I.E. Any Recommendations Would Be Good?

I have a wrapper SDK over clearml that includes default conf and others are loaded from secret manager / env vars as needed

4 years ago

0 Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs

As in if there are jobs, first level is new pods, second level is new nodes in the cluster.

4 years ago

0 Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs

AgitatedDove14 - any pointers on how to run gpu tasks with k8s glue. How to control the queue and differentiate tasks that need cpu vs gpu in this context

4 years ago

0 Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs

Running multiple k8s_daemon rightt? k8s_daemon("1xGPU") and k8s_daemon('cpu') right?

4 years ago

0 Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs

AgitatedDove14 aws autoscaler is not k8s native right? That's sort of the loose point I am coming at.

4 years ago

0 Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs

For different workloads, I need to habe different cluster scaler rules and account for different gpu needs

4 years ago

0 Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs

Got it. Never ran GPU workload in EKS before. Do you have any experience and things to watch out for?

4 years ago

0 When Running An Optimization Task, It Says Warning Parameter Not Found But Works Anyway. I Guess It’S Because It’S Looking For General/Param But Ends Up Using It As Default While Creating Tasks Anyway. If Default Is General, Can We Do Away With This Warni

Essentially. Not about removing all WARNINGS, but removing this as it actually works right and the WARNING is wrong.

4 years ago

0 What’S The Easiest Way To Update The Repo Url Alone For A Task? Need - In My Ci, The Url Used Is Https But I Need The Ssh Url To Be Used. I See That We Can Pass Repo To Task.Create But Not Task.Init

AgitatedDove14 either based on scenario

4 years ago

0 I Am Not Familiar With Pytorch, But Is It Expected That So Many “Models” Are Created? These Are Being Repeated As Well For A Single Task (This Is Training A T5_Model With Transformers):

` if project_name is None and Task.current_task() is not None:
project_name = Task.current_task().get_project_name()

if project_name is None and not Task.running_locally():
task = Task.init()
project_name = task.get_project_name() `

4 years ago

0 Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

That makes sense - one part I am confused on is - The Triton engine container hosts all the models right? Do we launch multiple gorups of these in different projects?

4 years ago

0 I Am Seeing That Some Steps In A Pipeline Are Being Skipped. Like For Example, In A Pipeline With 4 Steps, It’S Directly Starting At Step 3. Is There Some Reason For This, Some Optimization Kicking In?

I also have a pipelines.yaml which i convert to a pipeline

4 years ago

0 Why Would Every Submitted Task Be Aborted Directly?

I was having this confusion as well. Did behavior for execute_remote change that it used to be Draft is Aborted now?

4 years ago

0 So I Bumped Onto This Comparison Shared By Dagshub. It Kinda Placed Clearml Is A Rather Bad Position Compared To Everything Else In The Industry.

CynicalBee90 - on the platform agnostic aspect - dvc does it with the CLI right? It that what made you give a green checkmark for it?

4 years ago

0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

dataset1 -> process -> dataset2

4 years ago

0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

Optuna

4 years ago

0 Hi Guys, Until Today I Always Requested Data Scientists To Use Cli To Create Tasks. After That I Usually Reconfigure Them So They Can Be Pointed On Git Repo And So On. Unfortunately This Is Becoming A Big Task Since Now We Have Pipelines With Many Tasks A

Example:

name: ml-project template: nbdev pipelines_runner: gitlab pipelines: pipeline-1: steps: - name: "publish-datasets" task_script: "mlproject/publish_datasets.py" - name: "training" task_script: "mlproject/training.py" parents: ["publish-datasets"] - name: "test" task_script: "mlproject/test.py" parents: ["training"]Have cli which goes through each of the tasks and creates them

4 years ago

0 How Can I Clone A Task And Execute_Remotely The Cloned Task With Exit_Process=False. It Currently Kills The Notebook Kernel. If I Say Exit_Process=False, It Says Clone Cannot Be False. Why The Restriction? What To Do In A Notebook To Run A Task Remotely

Any chance you can open a github issue on it?

Will do!

4 years ago

0 Getting This Error At

That’s great, will try it out soon (it’s 2.30am here, about to crash 🙂 )

4 years ago

0 Is It Not Possible To Add Artifacts To A Completed Task?

Can I force add or something?

4 years ago

0 Is It Possible To Do Additional Setup (The

Ah is it, didn’t know about that. Let me check it out.

4 years ago

0 Does K8S Glue Support Running Service Agent? Slightly Confused Here

I guess the question is - I want to use services queue for running services, and I want to do it on k8s

4 years ago

0 Is It Possible To Add A Callback For A Pipeline From A Step?

from here: https://github.com/allegroai/clearml/blob/5a9155b2039413280f13dfded1121470c4c4323d/examples/pipeline/pipeline_controller.py#L29

4 years ago

0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

4 years ago

0 Is It Possible To Set An Environment Variable For A Task?

yeah i was trying in local and it worked as expected. But in local I was creating a Task first and then seeing if it’s able to get project name from it

4 years ago

0 Is There A Way To

+1. The k8s helper needs to be more k8s native.

4 years ago

0 When Using Something Like Pdf2Image Which Requires Poppler (Which Can Be Installed With Conda), How Can I Ensure That The Task Can Run On An Agent Correctly? As Of Now It Doesn’T Know About Poppler

Basic question - i am running clearml agent in a ubuntu ec2 machine. Does it use docker by default? I thought it uses docker only if I add the --docker flag?

4 years ago

0 Sorry Folks Too Many Questions - If I Have A Project (And I Set The Output Uri In It While Creating, To A S3 Folder) How Can I Ensure That A Experiment (Task) That I Run On My Local Outputs The Model To The Uri?

Pushed - https://github.com/allegroai/clearml/pull/342/

4 years ago

0 When I Do Task.Init() And Then A Execute_Remotely(), The Task Is Being Aborted Rather Than Be In Draft. Am I Missing Something?

I don’t want to though. Will run it as part of a pipeline

4 years ago

Show more results