Limited experience could mean a lot of things. There are a lot of good comment here already, if you are an absolute beginner (more or less) you would do well to try to connect with people in your area that have experience. Clubs, people on this site that might be nearby, maker-spaces, Technical schools? Even woodworking groups often have members that are also into metal working and machines.
Often meeting people with like interests and more experience will lead you to a good deal on a starting kit that someone wants to pass on. If you are willing to wait a bit and spend the time looking, you can probably find a good deal on older, more substantial machines and they often come with a decent amount of "kit". However, if you don't know how to evaluate a used machine or don't have a friend that does, you may end up with a major reconditioning project - which is a terrible way to get started unless you plan on specializing in machine restoration!
If you are in one of those areas that simply doesn't have much in the way of used equipment, then again - meeting people and seeing what they have for equipment and talking can really help when deciding to buy new.
There are a lot of really nice and generous people in this hobby and you would do well to meet them in person if you can.
The suggestion of SOR - statement of requirements is a good point, if you are just starting out, your requirements will inevitably grow. But having an idea of what you'd like to be making from the start is a good idea.
About 10 years ago, I landed a used Southbend 9A in very good condition with a lot of kit at a great price. All because I was involved with the local woodturners and had meet and friended a hobby machinist. He knew I was looking for a small lathe. It probably took a year or more before he called me out of the blue. Someone else needed to downsize and sell.
It has a 9" swing and about 24" between the headstock and tailstock. There have only been a few times when I wish I had more room. But I work on the small side / model scale stuff. The lathe also has a quick change gear box and power cross feed. Because it's old, the highest spindle speed is a little on the slow side. But as other have said, if you use hand ground HHS bits, you don't need or want the higher spindle speeds that carbide wants.
When it came time for a small mill, I ended up getting one from LMS - They are a good company and I'd recommend them. I have made a number of small modifications to the mill and it's fit and finish doesn't even compare to the old-iron SouthBend lathe. I'm happy with it but it's a different beast. I imagine I'd feel the same about a brand new small lathe.
Good luck and let us know how it works out!
(and welcome to the group)
HA! I should have waited and just posted: "What Terry said"