As populations shrink random fluctuations of gene frequencies, or genetic drift occurs. Small populations experience a great deal of genetic drift
In large populations natural selection can overpower drift, in small populations, drift overpowers selection
https://phys.org/news/2024-05-genetic-drift-natural-main-factor.html