If you are deregistered from Sweden and intend to marry at a foreign authority, you can apply for a marriage certificate at the embassy or a consulate.
You need the following documents in original:
Do you want to register your foreign marriage in Sweden or do you have further questions about marriage abroad? Please visit the Swedish Tax Agency's website for more information.