Hands-On Generative Adversarial Networks with Keras

Mode collapse and mode drop

Mode collapse and mode drop are common problems in GANs. They refer to reduced variety in the samples produced by a generator. The term has been used interchangeably and has the following two main interpretations:

1. The generator synthesizes samples with intra-mode variety, but some modes are missing.
2. The generator synthesizes samples with inter-mode variety, but each mode lacks variety.

Note that both the first and the second interpretation assume that a model has high precision and low recall. The first interpretation refers to low inter-mode recall, that is, when there is a variety in the modes present in the synthesized samples but not all modes are present; the second interpretation refers to low intra-mode ...