one more thing we didn't expect: chain-of-thought helps on the hard relational tasks and hurts on the easy ones, where the model talks itself out of a click it would otherwise get right.

Our approach is to vary visual rendering and instructions while preserving the underlying page structure using MHTML archives. This lets us separate visual robustness from instruction robustness to…