John,
As someone who has looked at & bought quite a few custom knives over the years, I think you're right. The handle is the first thing that will draw to me to any particular knife I may purchase. If I see something in stag, buffalo horn, rams horn, elk or some of the nice wood scales out there.....the maker has my attention. Then comes the style, size & the type of steel used. A nice sheath to compliment it is always a big plus.
Bruce