I'm kinda sorta moved into my shop, but still have a lot parts, my lathe & mill in the house yet. It's about 40 yards from the middle room in the shop to the hobby room in the back of my house. I think I make the trip 15x or more everyday... on the one hand it's a nuisance to get anything done, but on the other hand I'm getting lots of exercise too.
Perhaps a re-organization of your shop tools is in order Reg, put your lathe on one end, the mill on the other, tools for each at opposite ends & your workbench in the middle... you'd get an incredible amount of exercise everyday.