What you say makes a great deal of sense and if it works for you, all the more reason to continue to make it work in your life.
for me, and perhaps many others, I am not the hugging type. i prefer to keep touching beyond a hearty hand shake reserved for more special encounters or more special people. and as such, I do not consider myself any less caring or affectionate. Same is true, for me, with "I love you". I think it's used far too much amongst non-loving situations and its impact gets watered down.
But, that's what makes the world go 'round!
In fact, one of the very few scenes in the film I thought to be unrealistic was Ennis and Jack hugging upon greeting after Ennis' divorce. This was 1977, middle of Wyoming, in front of his kids. No way. That kind of greeting truly only started among men toward the 90s, and then usually among the so-called urban sophisticates.