Ben Yehoyadah explains why one who deprives himself from wine or any food is regarded as a sinner. Portions of one’s soul are contained within foods and drinks. When one recites a blessing before eating these foods, he can cause a remedy for those parts of the soul, and through his blessing, they will be able to go to their rightful place. It emerges that one who declares himself to be a nazir and therefore refrains from eating grapes or drinking wine, is sinning regarding his soul, for now his soul will remain deficient.
Furthermore, there are many mitzvos where wine is required, such as kiddush on Shabbos and Yom Tov, havdalah, birkas hamazon, bris milah and sheva brochos. Chazal established the mitzvos in this manner in order to rectify the sin of Adam Harishon, which was with wine. One who vows to be a nazir and therefore abstains from drinking wine causes anguish to his soul.