Is it normal for your fwb (friends with benefits) to be upset?

Well, it seems he really cares for you. You need to decide what you want for your future and go forward. Be a success and have integrity. What you have will leave you feeling shallow in time, and you could lose out on some wonderful experiences with some special people.