Trouble with driver window

[Facetime]

I just put new rubber around the doors and top in hopes to cut down on the cold air entering during winter. IN doing so, I now have a much tighter seal around the glass. Good news until I went to roll my window down the first time and pulled the glass out of the lower rail inside the door. Got it all apart and realize the felt in the pillar at the front of the door was trashed. After looking at it, that pillar seems difficult to remove and subsequently replace the felt. Any one have any experience with this? Looks like rivets at top and bottom. Any help is appreciated. Thanks!