In medieval times people being punished for crimes were made to wear these as a type of public humiliation, as their sentence or punishment was being carried out. This is in fact where the dunce cap originated.