Hi, does anyone know how to clone every step of a pipeline to a project? I'm doing this to save all execution results and compare them with previous versions...
8 months ago
FrustratingGoldfish63
1
Question,
9
Answers
Active since 13 December 2024
Last activity
8 months ago
Reputation
0
Badges 1
Eureka!
0
Hello. I'M Running The Self-Hosted Version Of `Clearml-Server` And I'M Seeing That The Elasticsearch Container Is Using A Lot Of Memory. I Have Two Questions:
1. Would Archiving Old Experiments Help Reduce The Memory Usage Of The Elasticsearch Container?
I set the memory limit in docker-compose file
elasticsearch:
networks:
- backend
container_name: clearml-elastic
environment:
bootstrap.memory_lock: "true"
cluster.name: clearml
cluster.routing.allocation.node_initial_primaries_recoveries: "500"
cluster.routing.allocation.disk.watermark.low: 500mb
cluster.routing.allocation.disk.watermark.high: 500mb
cluster.routing.allocation.disk.watermark.flood_stage: 500mb
discovery.type:...
8 months ago
0
Hi Everyone!
I Have A Couple Of Questions Related To Model Registry In Clearml:
- I use mode_id to name my model so that i can always identify all models.
- use StorageManager can upload your file to s3, for local you can just copy file or save it to clearml fileserver
8 months ago
0
Hi Everyone, I’D Really Appreciate Your Advice—Thank You In Advance! I’Ve Created A Pipeline Consisting Of Tasks. I Ran Tasks And They Are In Status “Draft”. When I Run The Pipeline Script Using Pipe.Start_Locally(), Everything Works Fine, And The Pipelin
#run this cmd will get you one more default queue
clearml-agent daemon --queue default --detached
8 months ago
0
Hi Everyone, I’D Really Appreciate Your Advice—Thank You In Advance! I’Ve Created A Pipeline Consisting Of Tasks. I Ran Tasks And They Are In Status “Draft”. When I Run The Pipeline Script Using Pipe.Start_Locally(), Everything Works Fine, And The Pipelin
open one more queue. one queue for pipeline another for actual task
8 months ago
0
Hi Everyone, I’D Really Appreciate Your Advice—Thank You In Advance! I’Ve Created A Pipeline Consisting Of Tasks. I Ran Tasks And They Are In Status “Draft”. When I Run The Pipeline Script Using Pipe.Start_Locally(), Everything Works Fine, And The Pipelin
one machine can attach multi queues
I use default queue for pipeline and services queue for task but two default also work
8 months ago
0
Hi Everyone, I’D Really Appreciate Your Advice—Thank You In Advance! I’Ve Created A Pipeline Consisting Of Tasks. I Ran Tasks And They Are In Status “Draft”. When I Run The Pipeline Script Using Pipe.Start_Locally(), Everything Works Fine, And The Pipelin
clearml-agent daemon --queue default --stop
8 months ago
0
Hi Everyone, I’D Really Appreciate Your Advice—Thank You In Advance! I’Ve Created A Pipeline Consisting Of Tasks. I Ran Tasks And They Are In Status “Draft”. When I Run The Pipeline Script Using Pipe.Start_Locally(), Everything Works Fine, And The Pipelin
you will get PC:01 for a queue and PC:02 for other queue
8 months ago