The object-targeting option of the Telekinesis spell (PHB, p. 280-281) says:
You can try to move an object that weighs up to 1,000 pounds. If the object isn't being worn or carried, you automatically move it up to 30 feet in any direction, but not beyond the range of this spell.
You can exert fine control on objects with your telekinetic grip, such as manipulating a simple tool, opening a door or a container, stowing or retrieving an item from an open container, or pouring the contents from a vial.
The idea of ripping a gate off its hinges with my mind gets me power drunk giddy.
The spell rules don't specifically address a situation of trying to move an object that's connected to other objects by something like brick mortar or hinges. Is this something that's up to DM discretion?