Thank you all for your awesome suggestions. I have booked my trip for Quebec City and will be staying in old city right next to Fairmont Le Château Frontenac.
Ohfer****sakes, I wasn’t done yet… Anyway, there is the Chocolaterie de Ste Petronille in Ile d’Orleans. It’s on the southwest tip, right on the water with a beautiful view toward Quebec City.