Parents have demanded that a plaque commemorating a visit from Andrew Mountbatten-Windsor to a Scottish primary school is removed.