Does it only do it with the left signal? We only have one turn signal relay on our bikes. But, you should be able to pick up a new turn signal relay at any auto parts store.

But, other than annoying, you should be safe to ride.