If someone is trying to stop you in an unusual situation (and this is not the police or a waiter who wants to return your forgotten phone, for example), then sometimes it is better to avoid unnecessary conversations and try to leave, especially if you feel unsafe at that moment.