It might sound weird, but yes by refrigerating the chocolates, you are ruining its taste. Recently a study pointed out how refrigeration actually dulls the taste of chocolate! The perfect temperature to store this sweet treat is 15 degrees C and one must store it in some cool and dark cupboard that is between 10 to 20 degrees C. Here is how you might be ruining that bar of decadence:
Moisture leads to sugar bloom
@via
The sugar rises on the surface and discolors the chocolate if kept for long in the fridge. You must have seen a white layer on it if you take them out after a long time.