Fuse panel removal, 74 Chevy C20 pickup

[Denver9]

How do you remove the fuse panel from a 1974 Chevy C20 pickup? I have removed the 2 screws that retain the fuse panel inside the vehicle, After removing those two screws I discovered that the Interconnect plug on the firewall, inside the engine compartment is also bolted to the fuse panel with a single bolt in the middle of the connector. After having removed that bolt, I tried to separate the connector from the fuse panel. Pulling as hard as I felt safe to do, I still couldnt separate the connector from the fuse panel. Could there be something else holding the pair together, or do I just need to wiggle and pull the plug harder? Any constructive suggestions would be appreciated.
- Denver9