Just one quarter of chief financial officers are optimistic about Brexit’s long-term impact, new survey suggests.