No, Improved Divine Smite does not do extra damage to fiends and undead
Improved Divine Smite says:
By 11th level, you are so suffused with righteous might that all your melee weapon strikes carry divine power with them. Whenever you hit a creature with a melee weapon, the creature takes an extra 1d8 radiant damage. If you also use your Divine Smite with an attack, you add this damage to the extra damage of your Divine Smite.
There is no mention of extra damage for fiends and undead so no extra damage is done (beyond the 1d8 extra it does to every creature of course). Contrast this with Divine Smite which says:
Starting at 2nd level, when you hit a creature with a melee weapon attack, you can expend one spell slot to deal radiant damage to the target, in addition to the weapon’s damage. The extra damage is 2d8 for a 1st-level spell slot, plus 1d8 for each spell level higher than 1st, to a maximum of 5d8. The damage increases by 1d8 if the target is an undead or a fiend.
Without that line of text there is no reason to think that Improved Divine Smite does the same thing. The two abilities are completely separate from each other despite the similarity in the names.
However, note the last line of Improved Divine Smite which states that Divine Smite and Improved Divine Smite can be used together and thus the extra damage against fiends and undead can be added to Improved Divine Smite albeit at the cost of a spell slot.