How is attempting to benchmark llms like religion?

Re-read the comment I'm replying to, it's not talking about benchmarks, just models.

Comparing models via benchmarks or feeling. Question remains.

If people were expressing their experiences working with two prolific software consultants across their various industries would you make the same claim? That's not to anthropomorphize the models, but to just put into perspective that the environment and circumstance is a major factor in output.

> If people were expressing their experiences working with two prolific software consultants across their various industries would you make the same claim?

If they are as ridiculous as they are when it comes to comparing models, yes I would.