Willy, I've been mulling this "feel" thing over. I just milled some mild steel and aluminum to organize my thoughts on this. I've said in the past that I feed fast enough (that is, I turn the handwheel fast enough) to feel a slight resistance as the end mill cuts through the material, and then I try to maintain that rate of feed. This is as close to what I "feel" as I can get. As I also said, I've pushed end mills to the breaking point and it requires a LOT more feed and force to break one VS feeding it so that it cuts without rubbing. There is also a sound when the end mill is cutting happily; that I cannot describe.
Some end mills cut with less resistance to feed than others; depends on the geometry, the material, your cutting conditions, coolant, etc. Regardless of this, I feed by feel and my end mills cut well and seem to live a good long life.
Manual guys like us learn to listen to and feel our machines, and we respond to the cut. We learn what this is like when the machine is happy and when it is not, and we will sense when it is not in an instant. I like that about manual hobby machines. For myself, I will leave the MMR and light cuts with super-fast feeds to the CNC guys. I'm sure it lights their fire to do that but for me, I prefer to feel the machine cut well. I have an X-axis powerfeed on the mill but I often feed manually, just because I like to stay in touch with how the machine feels as it cuts. I suppose that this is silly in this day and age but as Jim said, it is really all a manual guy has.
One other thing crossed my mind as I was cutting some mild steel. I use an ER chuck to hold the end mills. That feels different from using an R8 collet or end mill holder. The ER feels more solid and has less vibration.
Not sure if this will help. Maybe the other guys will chime in with their methods.