Or is it just more trouble then it's worth. If it is are there other methods for getting charisma to AC? Mechanically I simply want to make a character that is as SAD as possible in this case charisma. So what would be the easiest and fastest way to do it using a bard chassis?
From consulting the invaluable X Stat To Y Bonus tool, I'd say the best ways to get CHA to AC for a Bard would be either Arcane Duelist 2 if the class features appeal to you, or Battle Dancer 1 if you just want to get straight back to being a Bard.
As for general bard-friendly SADness, useful things are the Snowflake Wardance feat from Frostburn (which will allow you to add CHA to attack) and the Gauntlets of Heartfelt Blows (+CHA fire damage on attacks) from Dragon Compendium. You could also consider a Paladin dip for CHA to saves, using the Paladin of Freedom alternate class from Unearthed Arcana.
My bard optimization usually uses these tools as bonuses to focus on Inspire Courage optimization, for which there is a handbook.