we often do ablation studies with more than 50 experiments, and it was very convenient to compare their dynamics at the different epochs
fantastic, everything is working perfectly
thanks guys
Hi DilapidatedDucks58 ,
This is a result of a constraint we introduced (no more than 10 experiments in comparison) - this was not an expected use-case 🙂
We can move this constraint value to be a server configuration option in a coming patch release, if you'd like - is this an important scenario?
Error 12 : Validation error (value ‘['13b46b9325954517ab99381d5f45237d’, ‘bc76c3a7f0f6431b8e064212e9bdd2c0’, ‘5d2a57cd39b94250b8c8f52303ccef92’, ‘e4731ee5b33e41d992d6d3fdb2913045’, ‘698d9231155e41fbb61f8f3faa605727’, ‘2171b190507f40d1be35e222045c58ea’, ‘55c81a5db0ad40bebf72fdcc1b3be2a4’, ‘94fbdbe26ef242d793e18d955cb3de58’, ‘7d8a6c8f2ae246478b39ae5e87def2ad’, ‘141594c146fe495886d477d9a27c465f’, ‘640f87b02dc94a4098a0aba4d855b8f5’]' length is bigger than allowed maximum ‘10’.)
OK, I'll make sure to add this as a configurable option - we'll release a patch version in a day or two 🙂