CostlyOstrich36

0 Questions, 4172 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4172

0 I Have A Docker Container That Have Clearml-Agent Running Inside In Normal Mode. The Agent Take On A Task And Execute It Fine. I Just Want To Somehow Log The Docker Image Version That The Agent Is Running Inside. I Start My Container With Something Like:

Hi @<1576381444509405184:profile|ManiacalLizard2> , is there a specific reason you're running the agent inside a docker container instead of running the agent in docker mode which would make it spin up a container?

one year ago

0 After Saving Models During Training I Cant Reuse The Same Task To Continue Training Is There Any Way To Continue Task Even Though There Are Models Saved? Alternatively Is There Any Way To Make Torch.Save Not Automatically Save The Model?

StaleButterfly40 , it looks like there might be a good solution for your request. In the previous link I provided, there is a parameter ' continue_last_task' that should work for you 🙂

3 years ago

0 Hello Folks! I Have A Pipeline With Three Tasks: A, B, And C I Want To Set It Up So That: A Gets Assigned A Machine (E.G. Based On The Queue) B Always Gets Assigned To The Same Machine As A (But May Run In A Different Docker Etc.) C Will Be Submitted To

Is there a specific reason you would want them executed on the same machine? Cache?

3 years ago

0 Is There An Example Of Simple Pipeline Using Task Scheduler? I Want To Create A Simple Pipeline Where First A Folder Is Monitored Using A Taskscheduler, And Under Certain Conditions, Data Is Uploaded And Dataset Id Is Given To The Next Step In The Pipeli

From the error you provided it looks like virtualenv isn't installed on the environment

3 years ago

0 Hi, I Have A Question About Task Status. I Have A Script That Runs "Forever": It Loads (Or Creates, If It Does Not Exist Yet) A Specific Clearml Task, Does Some Work (In My Case, Checks If Database Has Changed And If So Dump It To A File And Upload It As

Hi @<1558986867771183104:profile|ShakyKangaroo32> , can you please elaborate more on what is happening? So you're taking an existing task that finished and forcing it to get 'started' again? Then you write some things to it sometimes and then later you 'revive' it again? And due to this it appears some artifacts are missing?

one year ago

0 Hi, I Am Creating Pipeline And Have Several Step/Task. Example Step1 Will Download Data By Varibel Range-Date. Is It Possible, If The Parameter Of Step1 Not Changing (In This Case Range-Date), It Will Not Re-Download And Not Re-Upload It To Artifacts, But

Hi @<1523701260895653888:profile|QuaintJellyfish58> , I think what you're referring to is caching steps - if nothing changed code or configuration wise then use outputs from previous pipeline run. Is that what you're looking for?

2 years ago

0 Hello, I Am Working With A Pytorch Model, And I Would Like To Save It As An Outputmodel. I Read That Clearml Has Pytorch Auto-Logging Ebabled Automatically. My Question Is: What Path Should I Specify To Torch.Save() In Order For It To Be Uploaded Automati

I think you need to specify some pythonic object to work with torch.save() - as it appears in their documentation:
https://pytorch.org/docs/stable/generated/torch.save.html

3 years ago

0 Is There Any Way Of Passing Additional Parameters To Pip In Clearml-Agent? For Example, When You Install

@<1601023807399661568:profile|PompousSpider11> , if you know it needs to be installed I guess you could even inject it as a bash script if running in docker mode or just have it already pre-installed. Regardless, clearml-agent will attempt to resolve torch installs.

one year ago

0 Hi Everyone, We'Re Taking A Look At Clearml And Running Our First Examples. We Started A Server On Gcp From Docker Images And Currently Trying Do Create My First Dataset, But Keep Getting "Error: Datasets Are Not Supported With Your Current Clearml Server

Hi @<1615881718445641728:profile|EnchantingSeaturtle2> , what version of clearml are you using? Are you running the server yourself or using the community server?

one year ago

@<1523701260895653888:profile|QuaintJellyfish58> , check cache_executed_step parameter in pipeline steps

2 years ago

0 Hello, Friends! I'Ve Got A Problem. I Am Trying To Restore Clearml Server From Backup. I Did What Docs Tell: Archived "Config" And "Data" Folders, Moved Them To New System. I Copied Docker Compose File And Set Correct Paths. When I Try To Run This Apiserv

What are the Elasticsearch, Mongo and apiserver versions in the docker compose are? Backup will only work in this scenario when they are exactly the same between 2 systems.

one year ago

0 Hi, Is There Any Variable That Defines The Disconnectivity Timeout? I Want To Handle Cases Where My Remote Clearml Is Not Available For Some Time. In Addition, What Is The Recommended Way To Handle Clearml Remote Server Connection Issues? I Would Like Tha

Hi @<1853608151669018624:profile|ColossalSquid53> , if there is no connectivity to the clearml server, your python script will run regardless. clearml will cache all logs/events and then flush them once connectivity to the server is resumed.

one month ago

0 For Some Reason, When I Try To Load A Dataset (Dataset.Get), Method _Query Task Is Called And This Method Try To Call _Send Method Of Interfacebase Class. This Method May Return None And This Case Is Not Handled By The _Query_Task Method That Tries To Rea

Hello MotionlessCoral18 ,

Can you please add a log with the failure?

3 years ago

0 Hi All, I Have Python File Build_Pipeline, That Contain Pipelinecontroller With One Step Only. When I Try To Run The File I Get 'Build_Pipline.Py': [Errno 2] No Such File Or Directory' On The Webui. What I Do Wrong? Thanks!

Please try like Kirill mentioned. Also please note that there is no file target in the snippet you provided 🙂

3 years ago

0 Hi! Is It Possible To Compare In The Ui Tasks Across Different Projects? Or Is It Only Within Project? For Example: Let'S Say That In One Run Session We Created

Hi GorgeousMole24 , you can certainly compare across different projects.
Simply go to "all projects" and select the two experiments there (you can search for them at the top right to find them easily)

2 years ago

0 Hi. I Have Been Using Clearml For A While, And Wanted To Know How Can I Run My Tasks In A Pipeline, Without It Detecting It Is From A Git Repository, Since The Remote Machine Won'T Have Access To Our Repository. I Have Wrote The Code In A Way That Each Ta

Hi @<1625303791509180416:profile|ExasperatedGoldfish33> , I would suggest trying pipelines from decorators. This way you can have very easy access to the code.
None

one year ago

0 Hi Folks! Is There A Way To Programmatically Create Users And Groups On A Server? If So, Can Someone Point Me To The Docs? Thanks

Hi @<1668427989253099520:profile|DisgustedSquid10> , Unfortunately the open source has not programmatic user API, you can however remotely access your server and edit the user file live.
If user management is key, then the enterprise has full SSO integration including RBAC and of course API access

one year ago

VexedCat68 , I don't think such an example exists, but if you create one it would be great if you opened a PR for the open source 🙂

3 years ago

0 Is There A Way To Get List Of Users From The Api?

Hi @<1523701842515595264:profile|PleasantOwl46> , you can use users.get_all to fetch them - None

one year ago

0 Given A Task Object, How Do I Retrieve The Gpu Type ? I Can See It From The Webui But It Would Be Great If I Can Get It From The Python Sdk

Hi @<1576381444509405184:profile|ManiacalLizard2> , it will be part of the Task object. It should be part of the task.data.runtime attribute

5 months ago

How are you trying to 'target' the file in the code?

3 years ago

0 Hi, I'M Trying To Use Clearml On Pytorch-Lightning With Multiple Gpus, But It Seems As If The Server Does Not Monitor The Experiment. I Can See No Progress In The Console (Steps Counter Stays On 0) Nor Any Tensorboard Loggings. On A Single Gpu Everything

Also, how many GPUs are you trying to run off?

3 years ago

0 Hello, I'M Wondering If I Can Stop The Specific Logging For One Plot (Using Matplotlib). When The Data Points Become More, Then The Gui Of

ScaryBluewhale66 , please look in:
https://clear.ml/docs/latest/docs/references/sdk/task#taskinit
The relevant section for you is auto_connect_frameworks
The usage would be along these lines:
Task.init(..., auto_connect_frameworks={'matplotlib': False})

3 years ago

0 Why Is Async_Delete Not Working?

Meaning that you should configure your host as follows host: "somehost.com:9000"

one year ago

0 Why Is Async_Delete Not Working?

2024-02-08 11:23:52,150 - clearml.storage - ERROR - Failed creating storage object

Reason: Missing key and secret for S3 storage access (

)

(edited)

This looks unrelated, to the hotfix, it looks like you misconfigured something and therefor failing to write to s3

one year ago

0 Hi, I Was Wondering If There Is A Proper Way To Integrate My Model Config File (Json) Into The Workflow Using The Ui. I'Ve Managed To Connect It As A Configuration Object But It Would Be Preferable If I Could Load It Into A Table Like The Other Params (In

I'm not sure I understand your second request. Can you please elaborate on the exact process you're thinking of?

Clone task via UI -> Edit a config section in UI -> Enqueue it to a queue -> Worker picks it up and starts running the task -> Task is finished

What am I missing here?

3 years ago

0 Hey Currently Trying To Run A Pipeline Locally To Test A Pipeline Component With

Can you please elaborate on what you're trying to do and what is failing?

2 years ago

SparklingElephant70 , can you please provide the full log of the run? You can download it through the webapp 🙂

3 years ago

0 Hi, How To Specific An Existing Container Built By Custom Dockerfile When Using Clearml-Agent? I Cloned A Yolov5 Task And Executed Remotely By Setting

Hi @<1585441179091079168:profile|ColossalArcticwolf5> , can you provide a log of the run?

2 years ago

0 Hello! Is It Possible To Deploy Clearml-Server On Linux/Arm64 Platform?

Hi @<1810483998732849152:profile|NonsensicalDuck81> , as long as you have docker installed, yes 🙂

5 months ago

Show more results