Maybe you could have offered to let him go first? I wouldn’t have been rude but it’s polite when you have a large order to ask the other person who’s waiting if they just need something real quick. If there’s a long line I don’t but one person? Maybe let him grab the one thing he might need.