Withholding sex from your spouse means that there is a major problem in your marriage.
You can't be that stressed from other responsibiliti es to be intimate with your spouse. Part of cultivating a healthy relationship is having a strong desire to be intimate with your spouse. If you lack that or your spouse lacks that for you, then it's going to be a miserable pairing.