I checked the area near the valve and there was a place for the little bottle to go, so I guess it is a sight glass afterall, good call there.
Also, I put one of the plugs into the filter basket thing, if it fits it means it should probably be in there right? There was nothing else to plug...