If a character with the Arcane Background (Weird Science) edge takes a new Power, say Bolt, do they need to roll a skill check to create their Ray Gun?
No. The time spent on the level-up shows devotion and perfection to the new device. There is no room for error.
From Explorer Edition page 84: