Greg replied to let me know that the R.E.M. song I was looking for last night is in fact a cover of a Big Star song by Alex Chilton, from the "Third / Sister Lovers" album.

Thanks Greg!