There may be no need for One with Shadows.
To analyze this, we should look at what Hiding (the action) does versus Invisibility.
In the Hiding sidebar (PHB 177), it says
An invisible creature can't be seen, so it can always try to hide.
In addition, the condition Invisible (PHB 291, emphasis mine) says
An invisible creature is impossible to see without the aid of magic or a special sense. For the purpose of hiding, the creature is heavily obscured. [...]
Attack rolls against the creature have disadvantage, and the creature's attack rolls have advantage.
There's a lot of crossover here. The main benefit of Invisibility for this build over "hidden" is that you 1) can always hide, and 2) you always get advantage on attack rolls, which will always trigger sneak attack.
Unfortunately, for this build, One with Shadows ignores point 2, since it's not continuous, so it only gains "you can always hide". This is fully negated by the Skulker Feat, because it allows you to hide in even dim light, and you can't turn invisible with One with Shadows unless you're in dim light. One with Shadows has its uses, but usually not in a rogue, since they can use their bonus action to hide. The only real benefit for this build is that you can hide from enemies with darkvision in dim light, whereas you normally wouldn't be able to, but I don't think it's worth your action in combat, and you should try to find darkness or cover instead.
Action economy with One with Shadows:
Turn 1. Move to dim light or darkness, use One with Shadows, bonus action Hide.
Turn 2. Attack, bonus action Hide, move again
Turn 3. Move to dim light or darkness, use One with Shadows, bonus action Hide.
Repeat steps 2 and 3.
Action economy without:
Turn 1. Attack, move to dim light or darkness, bonus action Hide.
Turn 2. Attack, move again, bonus action Hide.
Turn 3. Attack, move again, bonus action Hide.
Repeat steps 2 and 3.
In the first version, you're guaranteed advantage and sneak attack, but you attack half as much. In the second, you attack twice as much, and will likely get sneak attack, as a creature must actively Search for you to contest your Hide.