brushing

Hey guys, if you take good care of your pool. Meaning the filter is optimal, the chemicals are balanced.... then should you see yellow build-up if you miss brushing for just one day? I know this probably isn't exact science, and most likely everybody is YMMV. If I miss brushing for just one day...