The filter queue routine, as you found out, filters by callerid. There is no way to show actual queue members as the queue members themselves might not have relation to extensions buttons as is.
So, in your case that feature is of no use, unless you use distinct member names for your queue members.