I'm not sure I could handle the cognitive dissonance of hearing Armie reading the story, which is from Elio's point of view.
You know, I'm not only totally ok with it, I love it, because I believe Oliver is speaking the words back to Elio, the words Elio has just first spoken. I mean, how Call Me by Your Name is that??
Excellent point! (But still...)
Think of it this way; as gifted, as talented our boy Timmy Chalamet is, his (post--??) millennial speech (gabble?) is not exactly the greatest instrument to voice Aciman's (Elio's) precise (not to say pretentious) torrent of fevered, logorrheic eloquence. But Oliver (I mean Armey!)--I mean, GOD, that measured, honeyed blond baritone is perfect!!And--I wasn't at all wrong in saying Armey is a 21st century doppelganger of George Peppard-- LOOK! but especially LISTEN! to the video immediately below. Talk about honeyed blond baritone! The strong, lovely, logical, totally-understandable-but-never-overly-enunciated accent is again, perfect, and it sounds exactly like Armey (although, in the clip, Peppard IS slightly overly enunciating by mocking, in a playful way, Tiffany's, John McGiver's lovely salesclerk, the jokey situation). By the way, can you guess that I have become a rabid Armey fan? Ok, it's true, I cop to it.
(Apropos of nothing in particular, re ONE of the three distinct accents in this great scene at Tiffany's in Breakfast at Tiffany's: the accent of wonderful character actor, John McGiver (a born and raised New Yorker who went to Regis High School on 84th Street)--people now disparage 'Mid-Atlantic' accents from the 30's, 40's, 50's (and yes, 60's and 70's) as being artificial or stagey or contrived, but when I was a child (born in 1954) there were a lot of New Yorkers who really spoke like that--little old ladies, rich people, salesclerks like John McGiver, school teachers, EDUCATED people, but they are all dead now, NOBODY talks like that anymore, more's the pity.) [youtube=425,350]http://www.youtube.com/watch?v=rVFi-yeTe5g[/youtube]
Breakfast at Tiffany's (1961)
George Peppard, Audrey Hepburn
& John McGiver
Published on Oct 08, 2011
Oh my LORD, it just struck me--
You know who Armie looks like?
(Looks like? And sounds like--
that voice!!)
George Peppard! 
SEPT 21, 2017
Elio and Oliver's first night together, as read by Armie Hammer
[on Soundcloud NOW]
(Call Me By Your Name audiobook drops Oct 3.)

CLICK HERE TO HEAR:
https://soundcloud.com/macaudio-2/call-me-by-your-name-by-andre-aciman-read-by-armie-hammer