In summary: you can finagle the will-o'-wisp into the bag, but wetherwhether you can keep it in there, or wetherwhether it can escape or destroy the bag from the inside will be up to your DM. Either of the two would make the effort a bad idea in most circumstances.
The overwhelming consensus is that you cannot open a bag of holding from the inside. Even though the will-o'-wisp can fly, and is incorporeal so it could move through the lid without opening it, the answer's interpreationinterpretation of the sentence quoted above is that the only way to get something out of the bag is to retrieve it.
In addition, the will-o'-wisp has no attack that would allow it to pierce or tear the bag, it can only shock it with its shock attack. So rules as written it cannot destroy the bag from the inside, even if that is generally possible, and it again would be a DM call if burning a hole with electicityelectricity would work to rupture the bag, as this upvoted answer postulates. If it would, the will-o'wisp could escape to the astral plane, destroying your bag and getting rid of all your stuff while doing so.