TrickySheep9

71 Questions, 428 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Badges 1

383 × Eureka!

Answers 428

0 When I Do Task.Init() And Then A Execute_Remotely(), The Task Is Being Aborted Rather Than Be In Draft. Am I Missing Something?

I don’t want to though. Will run it as part of a pipeline

4 years ago

0 Hi, We Noted That Using K8S Glue, There Are Some Situations Where The Task Cannot Be Registered As Error And Will Be Stuck At Pending. An Example Of One Situation Is When The Task Is Pulling A Docker Image That Doesn'T Exist. Is There A Way To Catch Such

Lot of us are averse to using git repo directly

4 years ago

0 Logger.Report_Table

Nothing. nothing apparent at least

4 years ago

0 I Am Seeing That Some Steps In A Pipeline Are Being Skipped. Like For Example, In A Pipeline With 4 Steps, It’S Directly Starting At Step 3. Is There Some Reason For This, Some Optimization Kicking In?

Can I disable this cache?

4 years ago

0 When Using Something Like Pdf2Image Which Requires Poppler (Which Can Be Installed With Conda), How Can I Ensure That The Task Can Run On An Agent Correctly? As Of Now It Doesn’T Know About Poppler

Is there a good reference to get started with k8s glue?

4 years ago

0 The

Great, thanks

4 years ago

0 Does K8S Glue Support Running Service Agent? Slightly Confused Here

I guess the question is - I want to use services queue for running services, and I want to do it on k8s

4 years ago

0 Is It Possible To Increase The Polling Interval For K8S Glue? Currently It Is 5 Seconds I Believe. Would Adding An Argument For It Help? Can Do A Pr If So

Like it said, it works, but goes into the error loop

4 years ago

0 Getting This Error At

The console output in the UI says done but the pipeline is still “running”

4 years ago

0 Looking At Clearml-Serving - Two Questions - 1, What’S The Status Of The Project 2. How Does One Say How A Model Is Loaded And Served Etc? For Example, If I Have A Spacy Ner Model, I Need To Specify Some Custom Code Right?

Found the custom backend aspect of Triton - https://github.com/triton-inference-server/python_backend
Is that the right way?

4 years ago

0 What’S The Easiest Way To Update The Repo Url Alone For A Task? Need - In My Ci, The Url Used Is Https But I Need The Ssh Url To Be Used. I See That We Can Pass Repo To Task.Create But Not Task.Init

Ahhhh thanks!

4 years ago

0 Any Pointers On Running Gpu Tasks With K8S Glue?

I am seeing that it still picks up nvidia/cuda:10.1-cudnn7-runtime-ubuntu18.04

4 years ago

0 Clearml Server Deployment Uses Node Storage. If More Than One Node Is Labeled As App=Clearml, And You Redeploy Or Update Later, Then Clearml Server May Not Locate All Your Data.

Thanks!

4 years ago

0 Is It Possible To Add A Callback For A Pipeline From A Step?

Sorry, don’t get it

4 years ago

0 Does K8S Glue Support Running Service Agent? Slightly Confused Here

Yeah got it. Was mainly wondering if k8s glue was meant for this as well or not

4 years ago

0 When I Do Task.Init() And Then A Execute_Remotely(), The Task Is Being Aborted Rather Than Be In Draft. Am I Missing Something?

AgitatedDove14 - thoughts on this? I remember that it was Draft before, but maybe because it was in a notebook vs now I am running a script?

4 years ago

0 Does Clearml Have A Way To Do Human In The Loop Activities As Part Of A Pipeline That I Might Have Missed?

AgitatedDove14 sounds almost what might be needed, will give it a shot. Thanks, as always 🙂

3 years ago

AgitatedDove14 - on a similar note, using this is it possible to add to requirements of task with task_overrides?

4 years ago

0 Is There An Efficient Way To Query All Unique Models (Ie Excluding Versions) In A Project?

Yes I have multiple lines

4 years ago

0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

dataset1 -> process -> dataset2

4 years ago

0 After I Have Create A Task And Closed It In A Notebook, Any Activity Seems To Trigger Another Task. For Example:

Ah thanks for the info.

4 years ago

0 Are People Using Devcontainer + Clearml-Session?

Yeah mostly. With k8s glue going, want to finally look at clearml-session and how people are using it.

4 years ago

0 I Am Not Familiar With Pytorch, But Is It Expected That So Many “Models” Are Created? These Are Being Repeated As Well For A Single Task (This Is Training A T5_Model With Transformers):

Does a pipeline step behave differently?

4 years ago

0 Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

That makes sense - one part I am confused on is - The Triton engine container hosts all the models right? Do we launch multiple gorups of these in different projects?

4 years ago

0 Hi! When I’M Running An Experiment On A Local Machine, It Works Just Fine With The Clearml, But When Trying To Clone And Run (Enque) This Specific Experiment Directly From Clearml Server, There Are Errors In The Pip Installations. What Is The Best Way To

Is this this the issue?

https://github.com/pypa/pip/issues/8413

4 years ago

0 How Can I Clone A Task And Execute_Remotely The Cloned Task With Exit_Process=False. It Currently Kills The Notebook Kernel. If I Say Exit_Process=False, It Says Clone Cannot Be False. Why The Restriction? What To Do In A Notebook To Run A Task Remotely

create_task_from_functionI was looking at options to implement this just today, as part of the same remote debugging that I was talking of in this thread

4 years ago

When did this PipelineDecorator come. Looks interesting 🙂

4 years ago

0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

no task.close()

4 years ago

0 Hi, I'M Trying To Understand If Clearml Supports My Usecase: I Generate My Own Data (Problem-Specific) And Generation Process Is Uploading A Parquet Dataset (In Fact, Parquet Contains Multiple Files Obv.) To S3. Is There A Way To "Register" The Dataset In

+1 to this question

4 years ago

0 I Want To Use The Pipelinecontroller Which Assumes A Task Already Been Executed And As Ready As Template. I Never Executed The Task Before And It Is A Very Long Running Task. Is There A Way To Create The Template Without Executing All The Way Through?

Here’s an example - https://github.com/allegroai/clearml-serving/blob/b5f5d72046f878bd09505606ca1147d93a5df069/clearml_serving/serving_service.py#L58

4 years ago

Show more results