CostlyOstrich36

0 Questions, 3713 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Answers 3713

0 How Can I Send A Composed Chunk Of Code For Remote Execution

Hi @<1523701083040387072:profile|UnevenDolphin73> , can you please elaborate?

10 months ago

0 Is There A Way To Configure A Clearml-Agent So That It Shutdown The Server After It Has Been Idle For A Certain Time Period? We Are Using Gpu Resources From A Provider That Autoscaling Doesn'T Support (Such As Sagemaker Training Jobs).

And you use the agent to set up the environment for the experiment to run?

one year ago

0 Hi, Dear All, I Have A Quick Question Regarding The Scalar Graph. As You Can See In The Picture Down Below, The Experiment Names Are Too Short When You Hover And Illustrations Are Not So Useful When You Have To Scroll To Check The Meaning Of Each One.

ColorfulRaven45 Hi!

I'm afraid this is kind of a plotly limitation. Currently you can switch to full screen view OR hit the maximize graph button (it shows on over) for a better view.
We'd be happy to take a suggestion though 🙂

3 years ago

0 In The Configuration Section Of An Experiment, I Can See The Args I Passed Via Argparse. Is There Any Way To Create Other Sections Other Than Args And Tf_Define

VexedCat68 I think this will be right up your alley 🙂
https://github.com/allegroai/clearml/blob/master/examples/reporting/hyper_parameters.py#L43

3 years ago

0 Why Is Async_Delete Not Working?

host: "my-minio-host:9000"

The port should be whatever port that is used by your S3 solution

9 months ago

0 Hello Everyone What'S The Proper Way To Run Multiple Interactive Jupyter Sessions On One Machine/Agent? What I Am Doing Is Running Multiple Agents On The Same Machine, Each Agent Handling One Running Session To Avoid Subsequent Tasks Being In

Hi @<1670964701451784192:profile|SteepSquid49> , that sounds like the correct setup 🙂
What were you thinking of improving or do you have some pain points in your current setup?

9 months ago

0 How To Version Models While Training In Production

Hi @<1639074542859063296:profile|StunningSwallow12> , here are the docs for the agent - None

8 months ago

0 Hi All! I Have A Question - I Have A Pipeline Build Out Of Multiple Tasks. One Of The Tasks Creates A File As An Output. I Don'T Need To Save This File Anywhere (Not In My Local Nor As An Artifact), But I Do Want To Use It An An Input For The Next Step In

Hi @<1539417873305309184:profile|DangerousMole43> , in that case I think you can simply save the file path as a configuration in the first step and then in the next step you can simply access this file path from the previous step. Makes sense?

one year ago

0 Hi There, We Have A Task That We Are Trying To Execute Remotely, If We Initiate It From One Computer The Task Executed Remotely Successfully But If We Initiate It From Another Computer The Task Failed. We Have One Remote Machine At The Worker Queue So It

Hi @<1544491305910931456:profile|SoggyPuppy25> , can you please attach logs of the two runs? Are both runs executed on the same worker? What are the main environment differences between the machines that ran the experiment locally - OS/Python/ETC

one year ago

0 Hello All, I'Ve Previously Successfully Used The "Clearml Gpu Compute" Application, From Clearml And Genesis. Recently, My Tasks Are Failing With A Modulenotfounderror Error (For Banal Things Like Scipy And Scikit-Learn). It Seems Clearml'S Automagical En

What version of clearml are you using? Can you try in a clean python virtual env?

one year ago

0 Hi All, I Have A Big Amount Of Experiment In A Single Project, There Is A Way To Download The Experiments As A Custom Table? To Let'S Say To A .Csv File? Thanks! Experiment Table Example:

Hi @<1547028131527790592:profile|PleasantOtter67> , nothing out of the box. You can however quite easily extract all that information and inject it into a csv programmatically.

I think the bigger question is how would you break it down? Each experiment has several nested properties.

one year ago

0 I Am Using Hydra. When Running Locally The Code Takes Into Consideration Any Hydra Override Arguments I Pass In The Command Line. But When I Run The Same Task In Remote (Using Clearml-Agent).... It Uses Only The Default Values. Is This Behaviour Reasonab

Hi @<1546303277010784256:profile|LivelyBadger26> , I think this is what you are looking for
None

one year ago

@<1546303277010784256:profile|LivelyBadger26> , it is Nathan Belmore's thread just above yours in the community channel 🙂

one year ago

0 Hi, When I Use Clearml In Jupyter Notebook, The Task Displays Script Path: Ipykernel_Layncher.Py By That Uncommitted Changes Does Not Show The Code. Does Anyone Know How To Fix This?

Hi @<1547752791546531840:profile|BeefyFrog17> , can you add the full log?

one year ago

0 Clearml Agent Cant Download Packages With Recent Version Numbers. I'Ve Already Had To Deprecate Many Packages Like Matplotlib. And I'M Still Not Done. Every Time I Deprecate A Package, Theres A New Version Issue With A New Package. Please Help. Am I Missi

In the installed packages, try removing the version for imageio (Is this a private package?). This looks like the environment (OS/Python version) doesn't support the specific package OR the package is inside a private artifactory

one year ago

0 Hi. I Use Set_Base_Docker For Remote Execute. Its My Custom Image From Gitlab Registry. And My Question Is How I Can Use Script And Etc From My Image? On My Local Machine I’Ve Got In Docker Container Folder With Code From That Image If I Made It Like From

Hi @<1523701457835003904:profile|AbruptHedgehog21> , I'm not sure I understand - How do you use set_base_docker and what do you expect to happen?

one year ago

0 Hi! I Have A Remote Server With Clearml Server On It. I’M Trying To Get Access To Clearml Web Ui Through Ssh Port Forwarding (Ssh Vdc01 -Fnl 8080:Localhost:8080), But Getting Error “Server Unavailable” In Localhost:8080 On Local Machine. Cleaml.Conf:

Hmm maybe @<1523701087100473344:profile|SuccessfulKoala55> might have an idea

one year ago

0 Dear All, Great To Join Your Community. We Are Working On Plant Growth Stage Models At Basf For Farmers And I Was Wondering If Clearml Can Be Used Also For Data Versioning Of Tabular Data, Structured Data. I Would Like To Track If This And That Row Is Par

Hi @<1543766544847212544:profile|SorePelican79> , I don't think you can track the data inside the dataset. Maybe @<1523701087100473344:profile|SuccessfulKoala55> , might have an idea

one year ago

0 Hi All ! I'M Trying To Run My Tasks On Open-Source Clearml-Server. But Everytime I Try To Run A Task On It With Clearml-Agent, I Get The Same Error : Clearml_Agent: Error: 'Utf-8' Codec Can'T Decode Byte 0Xe9 In Position 26: Invalid Continuation Byte Even

Hi @<1546303293918023680:profile|MiniatureRobin9> , can you add the full console log?

one year ago

0 Hi, What Could Be The Reason That A Task Ran On An Agent Just Stopped Updating? The Status Is Still "Running" But It Doesn'T Seems Like It. The Agent Is Running On A Docker On A Gpu. It Completed 92 Epochs And Started 93. Run Started At 18:37 Feb 27, Last

Can you see if in the APIserver logs something happened during this time? Is the agent still reporting?

one year ago

0 Hi All, Is There Documentation On How To Train On Model On Mutiple-Gpu Across Mutilple Nodes/Machines ?

Hi @<1541592241250766848:profile|BrightPenguin74> , I think this is what you're looking for
None

one year ago

0 Hi. I Have Been Using Clearml For A While, And Wanted To Know How Can I Run My Tasks In A Pipeline, Without It Detecting It Is From A Git Repository, Since The Remote Machine Won'T Have Access To Our Repository. I Have Wrote The Code In A Way That Each Ta

Hi @<1625303791509180416:profile|ExasperatedGoldfish33> , I would suggest trying pipelines from decorators. This way you can have very easy access to the code.
None

one year ago

0 Hi Everyone, I Am Working On A Script That Gets Enqueued, And Executes Remotely On Clearml-Agent Workers. I Got A "Hello World" Version Of The Script Running, The Python Env Gets Set Up, And Installs Some Basic Packages I Need From Pypi. However, I Need T

Hi @<1590152201068613632:profile|StaleLeopard22> , you can simply add the extra index url as part of the agent requirements as such:

agent.package_manager.extra_index_url=["<extra_index_url>",...]

one year ago

0 Hi, I'M Experiencing Some Fairly Slow Uploads Of A New Dataset Version. I'M Running A Local Server And I'M Uploading A ~20Gb Update To A ~30Gb Dataset Consisting Of Few Hundreds Files, Each Up To Several Hundred Mbs. It Seems That Compressing And Upload I

Hi @<1547028074090991616:profile|ShaggySwan64> , so the issue is when writing to the files server? Is it possible that the machine itself is having a hard time to write the data?

11 months ago

0 Hi, I Tried To Deploy Clearml-Server On Ec2. I Followed The Instruction Written On This

StickySheep96 , Is it possible you raised the server locally on your machine and not the EC2 instance?

one year ago

0 Hey Everyone, First Q

Hi @<1710827348800049152:profile|ScantChicken68> , I'd suggest first reviewing the onboarding videos on youtube:
None
None

After that, I'd suggest just adding the Task.init() to your existing code to see what you're getting reported. After you're familiar with the basics then I'd suggest going into the orchestration/pipelines features 🙂

5 months ago

0 Hi, I'M Logging Plots Using Clearml Sdk. The Logging Is Automatic By Running Matplotlib And Seaborn. One Of My Plots Is Sns.Barplot, In The Pycharm Run I Get All The Ticks Name But In The Clearml Dashboard Results It Is Without The Ticks Names. I'Ll Be Ha

Hi, can you provide an example of how you report them?

2 years ago

0 Hey, Im Trying To Run Some Example Pipelines But Have The Problem, That Inside The Steps No Requirements Are Installed. In The Controller Task Itself All Requirements From The Repo Requirements.Txt Are Installed But In The Steps Only Cython. Are The Steps

I think those might help 🙂

2 years ago

0 Hi, I Hope Someone Can Help Me With The Following Problem: I Have Been Using Clearml For Some Time And Have Many Projects And Experiments. Today, For The 1St Time, I Tried Cloning An Experiment. After Enqueueing The Cloned Experiment (As Explained

Please filter by 'XHR' and see if there are any errors (any return codes that aren't 200)

2 years ago

0 Hi. From Python, Is There Away To Check How Many Worker Is There In A Given Queue ?

It is returned in queues.get_all. I'd suggest navigating to the webUI and checking what the webUI is sending to the server (It's all API calls) and replicating that in code with the APIClient

2 days ago

Show more results