As there are no bones supporting "the structure", the main influence on your boobs going south is gravity. The more you help gravity, the quicker they will go south.
In other words:
The heavyer your boobs become, either because of natural size or because someone decided the to attach a few...