CostlyOstrich36

0 Questions, 4213 Answers

Active since 10 January 2023

Last activity 2 years ago

Reputation

Answers 4213

Hi DeliciousKoala34 , is there also an exceptionally large amount of files in that Dataset? How do you create the dataset? What happens if you use something like s3 if you have available?

3 years ago

0 Hello Everyone! I Launched An Ec2 Instance That'S Free Tier (

CluelessElephant89 , I think the RAM requirements for elastic might be 2GB, you can try the following hack so it maybe will work.

In the machine that it's running on there should be a docker-compose.yml file (I'm guessing at home directory).

For the following https://github.com/allegroai/clearml-server/blob/master/docker/docker-compose.yml#L41 you can try changing it to ES_JAVA_OPTS: -Xms1g -Xmx1g and this might limit the elastic memory to 1 gb, however please note this might ...

4 years ago

0 Hey There, Would It Be Possible To Make Clearml-Agents Support Both Docker Mode And Venv Mode At The Same Time? Ie. Not Requiring To Be Restarted To Switch The Mode. The Mode Should Be Define On The Task Level: I Start An Experiment And Define Whether It

Hmmm, but what should be the default task state? What is the use case by the way?

3 years ago

0 Hi! I Would Like To Make A Report On All Experiments In My Clearml Project, The Report Should Include Plots Based On Experiments Data Grouped By Labels. Can I Do This Using Clearml Web Ui? If Not, How Can I Download Project Data To Build It Using Other In

Hi EnviousPanda91 , I'm not quite sure what you want to extract but you can extract everything from the UI using the API. The docs can be found here: https://clear.ml/docs/latest/docs/references/api/events
And for the best reference - You can open developer tools in the UI and see how the requests are handled there 🙂

3 years ago

0 Hello, I Want To Use Custom Packages In My Code.It Works Fine When I Run It Locally.But When I Clone The Experiments And Run On Agent It Shows Package Not Found Error In Agent. Can Anyone Help Me Out How To Use Custom Packages In Clearml? Which Parameter

Hi ShaggySquirrel23 , is this package inside some artifactory?

The agent needs access to the package while running, you need to have it accessible somehow on a remote machine as well. What is your setup?

2 years ago

0 Hi! I Had A Self-Hosted Clearml And I Want To Visualize Aggregated Metrics (Mean, Norimalized Mean, Dispersion Etc) To Compare Clearml Projects. How Can I Do That? As I Know, Clearml Web Ui Can'T Do It, It Can Compare Only Few Separate Experiments In One

In that case I suggest you write some basic code that will aggregate and compute those values for you for comparison

9 months ago

0 Hi We Want To Reuse The Configuration When Having Cloned A Task. For Some Reason It Does Not Return It But I Get {} For This Former_Config: Self.Current_Task = Task.Init(); Former_Config = Self.Current_Task.Connect({}) Can You Help Us?

connected_config = task.connect({})

Looks like you're connecting an empty config..

one year ago

0 I Am Trying To Run A Task That Is Completely Detached From Git - Remotely. The Script Uploads Fine But In The Ui, The Git Repo Appears As “Origin”. When The Agent Tries To Pick This Up, It Fails On Trying To Clone “Origin”. What Can I Do To Let The Agent

You mean it works that way?

3 years ago

0 In

What version of clearml are you using? Are you using the community server?

2 years ago

0 Hello! I'M New To

Hi @<1856869640882360320:profile|TriteCoral46> , you can add custom columns in the webUI and filter/arrange according to them. The webUI uses the API in order to get this data from the apiserver. So you can use the webUI in order to generate whatever filtering you want to have in your code and then implement it via the API/SDK depending on what you want to create.

4 months ago

0 Hello, I’M Trying To Log (Via

Can you try upgrading and see what happens?

3 years ago

0 Hi All! I'M Struggling With A Specific Scenario, Maybe You Could Help. I Have 2 Machines Types (For Example Titan/A100) And 10 Types Of Models With A Generic Code (I Pass The Model Name As An Arg). I Want To Create A Task For Each Of The 20 Runs. That'S I

Hi @<1531807732334596096:profile|ObliviousClams17> , I think for your specific use case it would be easiest to use the API - fetch a task, clone it as many times as needed and enqueue it into the relevant queues.

Fetch a task - None
Clone a task - None
Enqueue a task (or many) - [None](https://clear.ml/docs/latest/docs/references/api/ta...

2 years ago

0 Hi, Clearml Stores Models In The Following Format:

Hi, I think this is the default behavior but I think you can probably edit the source code ( output_uri parameter of Task.init would be a good lead).

In what format would you like it saved?

2 years ago

0 Hi, Another Bug To Report With The Aws_Auto_Scaler Using 1.1.2:

And if you switch back to 1.1.2 in the setup that 1.1.1 worked, does it still fail?

4 years ago

0 In Pipelines. Is It Possible To Inject A Requierment.Txt Such That The Executing Node Will Install Before Running Tasks?

the question how does ClearML know to create env and what files does it copy to the task

Either automatically detecting the packages in requirements.txt OR using the packages listed in the task itself

3 years ago

0 Hi, I Am Trying To Request A Demo For Cleargpt But After I Enter By Connection Details I Get A Garbled Webpage And It Looks Like My Request Have Not Gone Anywhere (At Least From The Fact That I Don'T Get A Confirmation E-Mail). Does Anyone Know How Can I

@<1577468638728818688:profile|DelightfulArcticwolf22> , after checking internally with the guys I think you should have received an email from Tina about 9 days ago

2 years ago

0 Hey All, I Am Having An Issue With Clearml That Never Happened Before. It Looks Like It Happens On The Version

Hi @<1787653566505160704:profile|EnchantingOctopus35> , what are you running?

6 months ago

0 Hi, What Could Be The Reason That A Task Ran On An Agent Just Stopped Updating? The Status Is Still "Running" But It Doesn'T Seems Like It. The Agent Is Running On A Docker On A Gpu. It Completed 92 Epochs And Started 93. Run Started At 18:37 Feb 27, Last

Can you see if in the APIserver logs something happened during this time? Is the agent still reporting?

2 years ago

0 Hi There, Is There A Maximum Number Of Plots (I.E. Losses/Scalars Being Logged During Training)? I Have An Application With Many Different Losses (About 200) And I Can See That Some Are Missing From The Dashboard. When This Number Is Smaller Everything Ru

I recall a big fix to plots in server version 1.6.0, can you try upgrading to see if it fixes the issue?

3 years ago

0 Is It Possible To Create A Task Using Task Cli Using A Python Entrypoint (Either Script Or Module) And Then Have The Task_Name Become Overridden By The Values Of Task.Init(Task_Name="Real_Task_Name") Inside The Python Script?

Hi @<1774245260931633152:profile|GloriousGoldfish63> , can you please elaborate on what your use case is?

8 months ago

0 Hi, I Am Trying To Use The Parameterset For Hyper-Parameter Tuning With Dependencies, An Example Of How I Use It: Parameterset([{“Prm1”:1, “Prm2": 1},{“Prm1”:2, “Prm2":2}]) But I Get A Warning :

Hi MoodySheep3 ,

Can you please provide screenshots from the experiment - how the configuration looks like

3 years ago

0 If I Want To Run Training Inside A Docker Container, How Do I Connect It To Clearml Installed Outside My Docker Container?

Hi PerfectMole86 ,

how do I connect it to clearml installed outside my docker container?

Can you please elaborate?

3 years ago

0 Hi, Quickhelp With Pipelines: I Am Loading A Model During A State Of It And Them Passing This Model (Torch.Nn.Module Object) As Input Argument To A Pipeline Component. I Noticed The Model Inside The Pipeline Component Is An Object Of Class 'Pathlib2.Posix

I see. When you're working with catboost, as what type of object is it being passed?

3 years ago

0 Hi All, I Am Making A Signal Processing Pipeline And I Would Like To Execute It Remotely But When I Do That I Cannot Really Run My Code Because I Lose Python Scripts I Have In Utils Directory. Would Anyone Know How To Make It Work? Do I Have To Create A P

Hi @<1829328217773707264:profile|DiminutiveButterfly84> , how are you building the pipeline? Is it from tasks or from decorators?

6 months ago

0 Hi, I Wanted To Report A Matplotlib Figure. In The Experiment Tab Everything Works As Expected And Is Displayed Correctly. However, When Embedding This Figure In A Clearml Report, Everything Changes Colour From Black To White, But Not The Axis Labels (See

Hi @<1717350310768283648:profile|SplendidFlamingo62> , are you using a self hosted server or the community?

11 months ago

0 Hi There All! Is There A Way To Set Empty Requirements When Creating A Remote Task? I Have Tried To Set Packages To None Or Empty Array, But It Doesn’T Work, Which Is Corroborated By The Documentation Of That Function

Yes, however I think you might be able to expose this via an env variable on the Task object itself

one year ago

0 Hey, When We Change In Our Clearml Conf Local Cache To Our Mounted Nas Drive (Default_Base_Dir: "/Nfs_Client/.Clearml/Cache") Download Speed Is ~50 Times Slower. Did Anybody Encountered This Issue And Or Know How To Fix It ?

Did you download the same data directly to the NAS and it took 5 secs?

one year ago

0 I Keep Facing This Issue. I'M Trying To Set Up My Own Clearml Server Using This Tutorial.

VexedCat68 , It appears to be a bug of sorts, we'll sort it out 🙂

4 years ago

Hi @<1829328217773707264:profile|DiminutiveButterfly84> , Is the code part of some repository or its just a folder with some script files?

6 months ago

0 Hello Folks! I Have A Pipeline With Three Tasks: A, B, And C I Want To Set It Up So That: A Gets Assigned A Machine (E.G. Based On The Queue) B Always Gets Assigned To The Same Machine As A (But May Run In A Different Docker Etc.) C Will Be Submitted To

Hi RoughTiger69 , you can specify a queue per step with execution_queue parameter in add_function_step
https://clear.ml/docs/latest/docs/references/sdk/automation_controller_pipelinecontroller

Same goes for the docker image - docker parameter add_function_step

3 years ago

Show more results