TimelyPenguin76

Administrator

0 Questions, 711 Answers

Active since 10 January 2023

Last activity one year ago

Reputation

Answers 711

0 I Am Trying To Use Clearml In My Work And I Am Facing Some Problems So Could Anyone Help Me With That? I Have Connected My Workstation With The Clearml Server As An Agent And When I Run The Code In My Local Device Then Clone It And Enqueue It To Run The C

can you share the local run log?

2 years ago

Hi WickedBee96 ,

Are you running a standalone script or some code part of a git repository?

2 years ago

0 Hey, About The Dependency Propagation Of Pipeline Components, If I Call A Vanilla Python Function From A Component Does The Dependencies Specified In The Internal Imports Propagated To This Function Call Too ? And Additionally If That Function Is In Anoth

Hi FierceHamster54 ,

I think

And is this compatible with the

Task.force_store_standalone_script()

option ?

is causing the issue, you are storing the entire script as a standalone without any git, so once you are trying to import other parts of the git, BTW any specific reason using it in your pipeline?

2 years ago

0 Hey Guys!

You can always clone a “template” task and change everything (it will be on draft mode), what is you use case? maybe we already have a solution for it

4 years ago

0 Hi, I Have A Problem That I Am Not Really Sure About How To Track It Down: I Sometimes Get The Following Message That Kills My Running Process After A Few Hours:

Hi ShallowKitten67 .

Can you send the logs? can you share the machine monitoring (from scalars section)?

3 years ago

0 Hi! I Am Setting Up A Few Clearml Agents To Run On A Local Gpu Server. They Have To Run In Their Own Docker Containers, Since We'Re Not Allowed To Install A Python Runtime On The Server Directly. I Got One Agent Running Listening To The Default Queue, Bu

👍 great, so if you have an image with clearml agent, it should solve it 😀

3 years ago

0 Hello, I Tried The Clearml-Session Cli To Start A Jupyter Instance On An Agent, But An Error With The Password, Here Is The Full Cli Log:

which ClearML agent version are you running?

3 years ago

0 Using The S3 To Push Data, I Tried This Snippet.. How To Add In The Key And Secret Key ? I See That It Requires Another Class, Storagehelper, But I Wasnt Able To Find A Code Snippet

Hi DeliciousBluewhale87 ,

Do you have your credentials for the S3 bucket in your ~/clearml.conf file?

https://github.com/allegroai/clearml/blob/master/docs/clearml.conf#L76

3 years ago

0 How Would I Go About Adding Multiple Credentials In The Autoscaler? (I.E. Specify Multiple

Hi UnevenDolphin73 , so all works now? With multi credentials?

2 years ago

0 Hi, A Small Bug (Not Really A Bug) In The Autoscaler: I Have P3.2Xlarge Instances That Take A Long Time To Shutdown. With

HI JitteryCoyote63 , so just the print is double?

3 years ago

0 Is There An Option To Separate The Storage From The Server? E.G. Deploying My Trains Server On Some Light Machine, And Confguring The Storage To Be Aws S3 Or Something Similar

Hi WackyRabbit7

When calling Task.init() , you can provide output_uri parameter. This allows you to specify the location in which model snapshots will be stored.
Allegro-Trains supports shared folders, S3 buckets, Google Cloud Storage and Azure Storage.

For example (with S3):

Task.init(project_name="My project", task_name="S3 storage", output_uri="s3://bucket/folder")
You will need to add storage credentials in ~/trains.conf file (you will need to add your aws in thi...

4 years ago

0 Is It Possible To Disable Vcs-Cache? I Tried To Change Value From True To False In The Trains.Conf, But It Does Not Affect Anything. I Want To Disable It, Because It Gives Error When I Run A Project Firstly On Docker Then On Venv.

Hi MysteriousBee56 .

What trains-agent version are you running? Do you run it docker mode (e.g.
trains-agent daemon --queue <your queue name> --docker?

4 years ago

0 Hey Again

yap, that should do the trick

4 years ago

0 Hi Allegroal Team, I Recently Saw Your Project And Tried It. This Is A Great Tool! I Have A Question To Ask:

FierceFly22 like Elior wrote, you can use Task.execute_remotely , just need to supply the queue name 🙂

4 years ago

0 Hello I Was Asked To Bring Up A Clearml Server On Our System. We Do Not Use Any Of The Cloud Options And Not Use Docker As Well

Hi CheekyToad28 ,

None of the options https://clear.ml/docs/latest/docs/deploying_clearml/clearml_server#deployment works for you?

3 years ago

0 Hey Again

Hi JitteryCoyote63 ,

Sure you can, you have many https://allegro.ai/docs/use_cases/trains_agent_use_case_examples/ , just pick to one you need 🙂

4 years ago

0 Hi, We Saw 2 More Issues With Images Logging: 1. You Need To Use Tf.Summary.Image And Not Summary_Ops_V2.Image 2. Image Needs To Be In Range [0, 1] And Not [0, 255] (Matplotlib And Tensorboard Can Handle Either One) Is That Expected?

Hi BattyLizard6 ,

Do you have a toy example so I can check this issue my side?

3 years ago

0 Hi, I Started My Agent Using. Clearml-Agent Daemon --Gpus 0 --Queue Gpu --Docker --Foreground, With The Following Parameters In Clearml.Conf.

After the task is cloned, the task is in a draft state. In this state every field is editable, so you can just double click the BASE DOCKER IMAGE section and change it to your image. If you’ll just delete the value from this section, then the ClearML agent will use the docker image you configure in the clearml.conf file (dockerrepo/mydocker:custom).

3 years ago

0 We'Re Trying To Use The Aws Autoscaler And Have Managed To Get It Up And Running With Spinning Up Instances. However, It Does Not Seem To Pull Any Of The Tasks For The Remote Instances. We See It Gets

Hi UnevenDolphin73 ,

If the ec2 instance is up and running but no clearml-agent is running, something in the user data script failed.

Can you share the logs from the instance (you can send in DM if you like)?

2 years ago

0 Hi, How Can I Get Programmatically A Task'S Logged Stderr Stream?

Hi ImmensePenguin78 ,

You can get all the console outputs using task.get_reported_console_output() . can this do the trick?

3 years ago

0 Hi, I Have A Question Regarding The New

Hi GiganticTurtle0 ,

You have all the tasks that are part of the pipeline in an execution table (with links) under plots section, does it helps?

3 years ago

Show more results