I haven't found a way, but this can actually be beneficial:
Since it's the same pseudo-number each time, I've added it to each contact as a custom category number, that category being "GV"
I can then SMS that number from the normal messaging app instead of Google Voice, but it will show on...