I think that the card should be modal and that a X in the top right hand corner above the card or a click any where else on the screen (since the card is now modal) will close out the card.
That will be an intermediary step but I am looking at something a bit more elegant for the long term. Perhaps a card preview window that you can use to view cards and then select them in the SBB