No; the character notices the hidden creature - which is why they're not surprised
In your example, the goblin is trying to hide from the PC. If its Dexterity (Stealth) check is lower than the PC's passive Perception, then its attempt to hide fails and its presence is noticed. It follows the same rules as any attempt at hiding; if another creature's Wisdom (Perception) check or Passive Perception beats your Dexterity (Stealth) check, then they notice your presence.
For reference, see the "Hiding" sidebar below this section of the basic rules:
The DM decides when circumstances are appropriate for hiding. When you try to hide, make a Dexterity (Stealth) check. Until you are discovered or you stop hiding, that check's total is contested by the Wisdom (Perception) check of any creature that actively searches for signs of your presence.
You can't hide from a creature that can see you clearly, and you give away your position if you make noise, such as shouting a warning or knocking over a vase. An invisible creature can always try to hide. Signs of its passage might still be noticed, and it does have to stay quiet.
In combat, most creatures stay alert for signs of danger all around, so if you come out of hiding and approach a creature, it usually sees you. However, under certain circumstances, the DM might allow you to stay hidden as you approach a creature that is distracted, allowing you to gain advantage on an attack roll before you are seen.
Passive Perception. When you hide, there's a chance someone will notice you even if they aren't searching. To determine whether such a creature notices you, the DM compares your Dexterity (Stealth) check with that creature's passive Wisdom (Perception) score, which equals 10 + the creature's Wisdom modifier, as well as any other bonuses or penalties. If the creature has advantage, add 5. For disadvantage, subtract 5. For example, if a 1st-level character (with a proficiency bonus of +2) has a Wisdom of 15 (a +2 modifier) and proficiency in Perception, he or she has a passive Wisdom (Perception) of 14.
Basically, hiding is generally a subset of surprise; hiding might enable you to surprise someone. If they do detect you, then by definition, you're not hidden.