A spotless giraffe was recently born at Bright’s Zoo in Limestone, TN and was just announced in the media this morning. They’re starting a public naming contest for her, of course.
I’d love to know what type of mutation causes this lack of of pattern, but I don’t know if we have genetics on that for giraffes the way we do other species. As far as is known, she’s the first spotless giraffe ever documented!
On July 31, 2023, a giraffe with no spots was born at Brights Zoo in Tennessee.
Image recognition algorithms are trained on a variety of images from around the internet, and/or on a few standard image datasets. But there likely haven't been any spotless giraffes in their training data, since the last one to be born was probably in 1972 in Tokyo. How do they do when faced with photos of the spotless giraffe?
Here's Multi-Modal In-Context Learning:
And InstructBLIP, which was more eloquent but also added lots of spurious detail.
More examples at AiWeirdness.com
Are these crummy image recognition models? Not unusually so. As far as I can tell with a brief poke around, MMICL and InstructBLIP are modern models (as of Aug 2023), fairly high up on the leaderboards of models answering questions about images. Their demonstration pages (and InstructBLIP's paper) are full of examples of the models providing complete and sensible-looking answers about images.
Then why are they so bad at Giraffe With No Spots?
I can think of three main factors here:
AI does best on images it's seen before. We know AI is good at memorizing stuff; it might even be that some of the images in the examples and benchmarks are in the training datasets these algorithms used. Giraffe With No Spots may be especially difficult not only because the giraffe is unusual, but because it's new to the internet.
AI tends to sand away the unusual. It's trained to answer with the most likely answer to your question, which is not necessarily the most correct answer.
The papers and demonstration sites are showcasing their best work. Whereas I am zeroing in on their worst work, because it's entertaining and because it's a cautionary tale about putting too much faith in AI image recognition.
These giraffe images are about 18 feet high, located on a high, curving slope at Dabous, Niger in the Aïr Mountains. They were made ca. 7000 BCE. More than 800 smaller rock engravings are nearby. Photo Matthew Paulson, 2015. Creative Commons CC BY-NC-ND 2.0; cropped at left.
can you expand on the giraffes not having long necks please?
Mammals are developmentally regulated to only have about 7 neck vertebrae - some mammals break that but it takes a lot of evolution to do so, because the developmental lock is strong
giraffes wanted to reach up high for food, but couldn't break that
so instead of adding more neck vertebrae - the true definition of a long neck -
they made their neck vertebrae bigger
here is a giraffe neck. You can see the seven, very large neck vertebrae
here is a truly long necked animal, a swan. you can see the vertebrae are many, many, MANY more than seven
here you can see a large number of vertebrae in the neck of a nother truly long necked animal, Mamenchisaurus (also, notice the similarities between the Mamenchisaurus neck vertebrae and the swan neck vertebrae!)
Sooooo yeah. Giraffes don't have long necks. This is also why the movement of their necks is so inflexible - they literally have fewer bones to move about