If you’re on a machine where you can't install software (like a library or corporate PC), portable apps are often the only workaround.
Are you sure you need a USB stick? Sometimes "portable" means "accessible from any device without leaving data behind." proton mail desktop app portable
Keep your encrypted mail environment separate from the host OS. Does Proton Offer an Official Portable Version? If you’re on a machine where you can't