The Dueling fighting style doesn't benefit natural weapons
The description of the Dueling fighting style says:
When you are wielding a melee weapon in one hand and no other weapons, you gain a +2 bonus to damage rolls with that weapon.
The key here is that you must be wielding a melee weapon in one hand, and not wielding any other weapons.
As indicated by the question, there are many ways for PCs to gain natural weapons (though unless the player picks a race with a natural weapon, multiclassing is necessary in order for the player to also have the Dueling fighting style).
For instance, the description of the tabaxi race's Cat's Claws trait (VGtM, p. 115) says:
Your claws are natural weapons, which you can use to make unarmed strikes. If you hit with them, you deal slashing damage equal to 1d4 + your Strength modifier, instead of the bludgeoning damage normal for an unarmed strike.
Now, let's consider whether the tabaxi's claws count as "wielding a melee weapon in one hand and no other weapon". (Any natural weapon that is unrelated to your hands, such as a Bite or Stinger attack, is excluded by default for obvious reasons.)
It would be paradoxical for it to work
First of all, let's approach it just from a logical perspective.
User blackaurox asked a similar question on /r/DNDNext on Reddit about benefiting from Dueling while cursed with werebear lycanthropy, and this line from hphammacher's comment on the post quite simply sums up the self-contradiction of allowing claws to let you benefit from Dueling:
If claws are weapons it sounds like there's one in each hand. If claws are not weapons then dueling does not apply.
Essentially, in basically every case in which you have claws (or similar) as natural weapons, you will have them on both hands. Even if we accept that claws can be considered "wielded" in your hand, if you have them on both hands, then you can't benefit from Dueling. And if you don't consider them to be wielded in your hand, then Dueling doesn't apply anyway. You can't logically treat them in one way for one hand, but treat them a different way for the other hand.
Natural weapons aren't "wielded" - they're body parts
I would strongly disagree with the idea that natural weapons such as claws can be considered to be "wielded" at all. They're a part of your body, just one that can be used to attack in a way that does more damage than a punch or headbutt. You can wield a sword, but you don't "wield" claws (or a bite, or a stinger).
(The same logic applies to unarmed strikes. They're also a part of your body, they're even more explicitly not weapons, and you don't "wield" your fists any more than you wield your head or your feet.)
Natural weapons aren't usually intended to be treated as "weapons"
Jeremy Crawford unofficially sums up the game's classification of natural weapons in a May 2018 tweet:
I'll boil it down for you. When we wrote the "Player's Handbook," we meant the weapons on the weapon table when we wrote "weapon," unless we said otherwise.
In essence, game features that refer to a "weapon" typically aren't intended to apply to natural weapons. Usually, it doesn't break anything in the game to let them apply to natural weapons as well, but in this case, even a logical reading doesn't allow natural weapons to benefit from the Dueling fighting style.
Given that they're not wielded or treated as weapons for most game purposes, natural weapons don't allow you to benefit from the Dueling fighting style. (Correspondingly, they also don't prevent you from benefiting from Dueling; they're body parts, not "wielded" weapons.)