Can I travel to and from Switzerland if I lose my residence permit?

Travelling to and from Switzerland without proper documents in hand could pose a problem — or not — depending on several factors.