As an alternate solution, if I could group runs and get stats across the group, that would be cool

SmallDeer34 , and they still have the same colors when you maximize the graph?

Oh look, the blue setting is best!

maximized:

no maximized:

something like this is what I'm looking for

No, not specifically 20,in fact more than 20

SmallDeer34 , great, thanks for the info 🙂

Or at least not conveniently

generally I include the random seed in the name

SmallDeer34 Hi! 🙂

I'm afraid that currently we support only up to 10 experiments in comparison at once. However you can add/remove experiments mid comparison. Is there a specific reason why you'd need to compare specifically 20?

Regarding the coloring, if you do 5/5 it would be supported.

Aggregating the sort of range of all the runs, maybe like a hurricane track?

They don't, no

Well they do all have different names

And the reason is, because I have a bunch of "runs" with the same settings, and I want to compare broadly across several settings. So if I select "a bunch" with setting A I can see a general pattern when compared with setting B.

I've got 7-10 runs per setting, and about 7 or 8 settings

SmallDeer34 , just out of curiosity, how many in a single compare would be needed for your use case?

SmallDeer34 , as a workaround for the issue of the graph maximize you can simply rename some of the experiments and this should fix the coloring issue for now until it is fixed in the next version 🙂