It's not necessarily wrong to call an Englishman a Brit.
Depends on the bloke involved.

I'm an Englishman first and a Brit a distant second.

Just for a laugh, call any Welshmen or Scotsman a 'Brit'
Light the blue touch paper and retire to a safe distance ...