I had a concept for a very support style monk who used feint to help their allies strike the enemy, can I dual wield war fans and get a +4 bonus on a feint? Or is just a static +2?
I can't really find a ruling anywhere
The distracting weapon quality provides an untyped bonus.
You gain a +2 bonus on Bluff skill checks to feint in combat while wielding this weapon.
The bonus applies for just wielding the weapon, not for making a specific attack or maneuver with it. And interestingly enough, feinting is not actually a combat maneuver; it is a skill check, independent of a specific weapon or attack bonus. So all your bonuses should apply!
However, your GM may rule differently here, because even though untyped bonuses normally stack, there is one exception:
Bonuses without a type always stack, unless they are from the same source.
By RAW, since the fans are two individual weapons, they should count as different sources for the purposes of stacking untyped bonuses, whether or not they are the same style of weapon.
But the GM may rule that because the weapons are identical, the bonus is the same. If so, then you could circumvent this by wielding two different weapons with the distracting quality (e.g. fighting fan in one hand, and sickle-sword in the other hand).
Or, the GM may rule that the "source" of the bonus is the distracting quality itself, in which case you cannot stack them. There is no counter for this; simply respect the GM's verdict and move on, as there are many other ways of improving a character's feint check.