I am thinking that the yellow areas are from some calcium build up due to the plaster "dust" hardening in those areas that didn't get brushed during the first two weeks. If so, that calcium deposit can be easily removed by sanding with 80 grit wet&dry sandpaper. It does NOT harm the plaster...