Do you ever just sit and listen to music, or do you have to be doing something else at the same time?

I've mentioned that I like to just sit back in my easy chair, put headphones on and just listen to music without doing anything else. People say this is weird and say they would fall asleep or go crazy from not doing anything. Am I weird for doing this?