The alternative approach is to view this from a roleplaying perspective. Do the other players' characters notice this behavior? How do they feel about it?
I could see this turning into a great chance for RP, and while it may split the party (or even cause some Player vs Player combat), it could turn out to be a really positive experience.