Sometimes Two Heads Are Better Than One