You havent done anything wrong, you’re within your boundaries to do what you did. He’s projecting his bad behaviour and this is just 101 from a narcissists playbook. Even if you wanna argue that “not everyone is a narcissist” there’s certainly a lot of men and women who will take a leaf out of their book for their advantage