You have had so much turmoil this year. I can understand, as I have too. It's awful to lose a grandpa-i've lost four! It's never easy.
But, that final memory will fade-last time I saw my most recently deceased grandpa he was shaking and speaking nonsense, wheezing like crazy, and it was just awful. But I made a choice to remember him in his better days.
As for dealing with family...Stephie, don't feel like you have to say, or do, anything. Grieve in your own way. Go down there and don't say anything, talk your face off, or don't go down there at all. It's so personal and painful and everyone deals differently.
I'm so sorry you have to be going through this right now.