You might not worry about an easy branch or leaf, but such things can develop into a hazard to those swimming inside your pool.
Have a phone installed near your pool anyone won't require to leave children even for a short while to answer calls.