This is only a partial answer concerning Arctic mythologies:
According to Bogoras (1907), the Chukchee's cosmogonical beliefs include the idea of a multilayered world, the North Star being the passage between them (see this previous question/answer of mine):
COSMOGONICAL BELIEFS.- According to the cosmogonical beliefs of the Chukchee, there are several worlds situated one above another, in such a manner that the ground of one forms the sky of the one below. The number of these worlds is stated as five, seven, or nine. These worlds are arranged symmetrically above and below the earth, each of the lower worlds having a corresponding one above it.
According to a statement in the tale of "The Scabby Shaman" which gives many curious details of the subject, there are four large worlds besides the earth. Those nearest to the earth are occupied by ke'let; the next, by men. In the upper and lower worlds there are the same number of animals on the land, birds in the air, and fish in the sea, so that the amount of life is the same above and below the earth.
According to other statements, the lowest world is occupied by those who have died twice, and therefore cannot return to earth. Some of these worlds have several suns, the number of which varies from two to eight.
When it is winter in our world, it is summer in the next, and vice versa.
[...]
These worlds are not very far apart. In the tale of "The Shaman with Warts", a shaman, while struggling with his rival, is hurled through two worlds, piercing the heaven of one head foremost, and that of the next feet foremost; then he lands in the third world on the moving ground of the clouds.
[...]
All these worlds, as said before, are joined by holes situated under the Polar Star. Shamans and spirits while going from one world to another slip through these holes.
More details can be found in Bogoras (1902), which contain for instance the complete tale of the "Scabby Shaman" referenced in the upper text.
Similarly Jochelson (1904) reported that the Koryaks believed that the
universe consists of a series of five worlds, one above the other, the middle one being our earth.
The only mention of the other worlds however is that the Supreme Being lives with his family in the Upper World.
So it seems at the very least that the conception of a multilayered world was common to the indigenous Arctic populations of the Eurasian continent. However I can not find any reference (apart from an Underworld where the deads end up) of this concept in north American Arctic populations.