Bigger is nice, but model making is a bit of a different thing and small works well as long as it is big enough.
I also make models and have acquired a couple of small lathes, a longbed Sherline, a Taig, an Enco 9x20 and a Rivet 8x21.
Sherline doesn't add to your swing, but with 8" or 17" between centers adds significantly to the length of pieces you can work and tooling you can use. Sherline has a huge selection of tooling.
Taig has a slightly larger swing, and 9 3/4" between centers. Less expensive than Sherline, and less refined in my opinion but still a good small lathe made to a higher standard than the Chinese mini lathes.
As far as the 7x lathes they will be an improvement over your 4x6, but I would look at the 8x16, 8x20 and 9x20 lathes as well. The size difference is less than you probably expect. The major difference is weight. The length difference is only around 7-8".