This happens far too often. I spend ages searching for the answer. Then soon after I post a question in a forum, my searches suddenly decide to be helpful and I find the answer...
To fix this:
1. Change First Person Camera "Render Type" from "Base" to "Overlay"
2. In the inspector for the main camera, at the bottom there is a "Stack" add the first person camera to this.