While no official books discuss traveling between different Material Planes, Mike Mearls (a designer for 5e) has spoken about it in a youtube video by D&D Beyond.
Then within the material plane, you have crystal spheres; each of which hosts one or more worlds, which ... typically the worlds in the crystal spheres ... when you look from sphere to sphere; they're very similar; they're typically... at least one of them is earthlike ... but they might have differences in how magic works, some worlds might have more magic, others less, which gods have influence, and which creatures you might find there, but they're all generally earthlike
What it boils down to is the construction of a vessel capable of traversing the stuff between "crystal spheres" (regions that house different Material Planes) which is called "phlogiston". There are no rules in 5e for this yet, but you can get some insight by reading the Spelljammer campaign setting for AD&D 2e