This argument only applies in “race to sleep”, but that also doesn’t look very good. Taking +17% longer, but using -40% power still means that the slower processor is using less energy overall.

You’d have a point if user interactions lagged because of the performance difference, but typical user interactions wouldn’t even be noticeably different going from an X1 to an X4 let alone an X3 to X4.