The decline of British fishing drove coastal support for leaving the EU, but many of the industry’s problems have an origin closer to home.