Keep track of a riding partner if just the two of you. I agree with the other folks that you need to talk with him and find out why he's riding more slowly. Speedo calibration or other issues might be at the heart of it.
Suggest another riding partner if you can't come to terms on speed and safety. Best of luck!