No, that sound isn't normal. Have you tried taking off the cap? It might be corroded, or poorly seated - if that's the case, a new one might fix it. It could be the wrong size.
If it seems to be in good shape, you can try covering the threads with teflon. This should eliminate some of the...