You can cast two cantrips, but not for the reasons you state.
The reasons you state rely on Booming Blade and Green Flame Blade involving a weapon attack. However, this has nothing to do with the reason that a Haste'd Bladesinger can attack with a dagger, and cast two cantrips. The cantrips could be Shocking Grasp and Firebolt, for example. They do this by taking the Attack action (dagger then Shocking Grasp), then taking the modified restricted Attack action granted by haste.
The Bladesinger's feature is a specific rule that states, "whenever you take the Attack action on your turn [...] you can cast one of your cantrips in place of one of those attacks." The Haste spell states that you can "take the Attack (one weapon attack only) [...] action." Thus the Haste spell is granting an Attack action on your turn, which can be modified by the feature.
Because the Bladesinger allows you one thing "in place of" another, it interacts with Haste by allowing you to replace "one weapon attack" (the text present in the spell) with "cast one of your cantrips" (the text present in the feature). Thus, a Bladesinger with that feature under the effects of Haste can take the Attack (cast one of your cantrips only) [...] action
{take the Attack (cast one of your cantrips only) [...] action}.