TrickySheep9

71 Questions, 428 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Badges 1

383 × Eureka!

Answers 428

0 Apart From Having Packages In Requirements.Txt, Does Clearml Expect Them To Be Actuall Installed To Add Them As Installed Packages For A Task?

So packages have to be installed and not just be mentioned in requirements / imported?

4 years ago

0 Any Pointers On Running Gpu Tasks With K8S Glue?

Thanks for the fast responses as usual AgitatedDove14 🙂

4 years ago

0 Looking At Clearml-Serving - Two Questions - 1, What’S The Status Of The Project 2. How Does One Say How A Model Is Loaded And Served Etc? For Example, If I Have A Spacy Ner Model, I Need To Specify Some Custom Code Right?

Hey SuccessfulKoala55 Like I mentioned, I have a spacy ner model that I need to serve for inference.

4 years ago

Thanks

4 years ago

0 I Am Seeing That Some Steps In A Pipeline Are Being Skipped. Like For Example, In A Pipeline With 4 Steps, It’S Directly Starting At Step 3. Is There Some Reason For This, Some Optimization Kicking In?

Can I disable this cache?

4 years ago

0 When I Clone A Task, Is There A Way To Set Parameters That Override Rather Than Replace? As In, Original Task Parameters Is Param1 = {“A”: 1, “B”: 1} Can I Supply {“B”: 2} And It Overrides B Alone Without Removing A. Or Do I Have To Handle The Merge Mys

Ok got it, thanks

4 years ago

0 Is It Possible To Add A Callback For A Pipeline From A Step?

In params:

parameter_override={'General/dataset_urlWhat’s the General for?

4 years ago

0 Is It Possible To Add A Callback For A Pipeline From A Step?

Ok the doc needs fix

4 years ago

0 How To Update The Logging Level Of All Loggers In Clearml?

yeah meant this, within clearml.conf:

logging {} sdk {}

3 years ago

0 Would Be Great If Clearml Is Represented In The Matrix. (It'S Mentioned As A Mlops Platform And The Origin Year)

Seems like usual? https://github.com/thoughtworks/mlops-platforms#contributions

3 years ago

AgitatedDove14 - on a similar note, using this is it possible to add to requirements of task with task_overrides?

4 years ago

0 I Am Not Familiar With Pytorch, But Is It Expected That So Many “Models” Are Created? These Are Being Repeated As Well For A Single Task (This Is Training A T5_Model With Transformers):

Does a pipeline step behave differently?

4 years ago

0 Is There A Way To

Something like the Gitlab Kubernetes Executor could work well.

4 years ago

AgitatedDove14 - are there cases when it tries to skip steps?

4 years ago

0 Getting This Error At

This is a Sagemaker notebook instances - Python 3.6.13

4 years ago

0 If I Have A Dataset And I Process It And I Want The Processed Data As Another Dataset, Is Parent The Right Approach?

In this case I have data and then set of pickles created from the data

4 years ago

0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

Something like:

with Task() as t: #train

4 years ago

0 Can Someone Help Me With Deploying This Example Model (From Triton Inference Server) Deployed In Clearml-Serving? Too Many Random Errors For Me To Figure It Out

AgitatedDove14 - it does have boto but the clearml-serving installation and code refers to older commit hash and hence the task was not using them - https://github.com/allegroai/clearml-serving/blob/main/clearml_serving/serving_service.py#L217

4 years ago

0 How Can I Clone A Task And Execute_Remotely The Cloned Task With Exit_Process=False. It Currently Kills The Notebook Kernel. If I Say Exit_Process=False, It Says Clone Cannot Be False. Why The Restriction? What To Do In A Notebook To Run A Task Remotely

With an hash of course 🙂

4 years ago

0 How To Update The Logging Level Of All Loggers In Clearml?

Thanks you! Does this go as a root logging {} element in the main conf? outside SDK right?

3 years ago

0 Anyone Doing Sagemaker With Clearml - Something Like The K8S Glue But The Tasks Are Pulled Into Sagemaker Training Jobs

Would this be a good use case to have?

4 years ago

0 How Do People Solve This? If I Am Pip Installing A Custom Package From .Tar.Gz, How Can I Ensure That If I Run The Experiment (Initially Run From A Notebook) Via The Queueing It Can Be Properly Installed Steps - Notebook -> Get A Tar.Gz From S3 -> Pip I

# Python 3.6.13 | packaged by conda-forge | (default, Feb 19 2021, 05:36:01) [GCC 9.3.0] argparse == 1.4.0 boto3 == 1.17.70 minerva == 0.1.0 torch == 1.7.1 torchvision == 0.8.2

4 years ago

0 Playing Around With Hpo For First Time. I Am Giving This As Hyperparameter:

Ok, just my ignorance then? 🙂

4 years ago

0 Is It Not Possible To Fire And Forget A Pipeline? In This Example, What’S The Step To Just Trigger A Pipeline Without Waiting? Without The Pipe.Wait() I Don’T See The Stages Running

AgitatedDove14 - just saw about start_remotely - https://clear.ml/docs/latest/docs/references/sdk/automation_controller_pipelinecontroller#start_remotely

This means the services agent will take care of taking it to completion right?

4 years ago

0 Is It Possible To Schedule Pipelines On Events Like Dataset Update?

sorry mean upstream dataset

4 years ago

0 Is It Possible To Add A Callback For A Pipeline From A Step?

Ah ok got it.

4 years ago

0 I Saw Some Talk Of Clearml + Kedro On Reddit. Is That A Good Approach?

Generally like the kedro project and pipeline setup that I have seen so far, but haven’t started using it in anger yet. Been looking at clearml as well, so wanted to check how well these two work together

4 years ago

But you have to do config.pbtxt stuff right?

4 years ago

0 Getting This Error At

Having a pipeline controller and running actually seems to work as long as i have them as separate notebooks

4 years ago

0 Need Some Help With Shell Script For A Task That Is Not Running From What I Can See: Have A

If you don’t mind, can you point me at the code where this happens?

4 years ago

Show more results