AI is Racist

MIT, Harvard scientists find AI can recognize race from X-rays — and nobody knows how
https://www.bostonglobe.com/2022/05/13/business/mit-harvard-…

A doctor can’t tell if somebody is Black, Asian, or white, just by looking at their X-rays. But a computer can, according to a surprising new paper by an international team of scientists, including researchers at the Massachusetts Institute of Technology and Harvard Medical School.

The study found that an artificial intelligence program trained to read X-rays and CT scans could predict a person’s race with 90 percent accuracy. But the scientists who conducted the study say they have no idea how the computer figures it out.

I bet the AI is using the machine learning process of “symbolic regression”.

Powerful ‘Machine Scientists’ Distill the Laws of Physics From Raw Data
https://www.quantamagazine.org/machine-scientists-distill-th…

intercst

2 Likes

I don’t know why this is so mysterious. Every artist knows that the shape of the skull, cheekbones, eyebrow ridges and jaw is characteristic of races. Any reasonably good artist can show the race of a person with a simple charcoal sketch, not as a caricature but in a subtle way that is clear. Of course, there is plenty of overlap in shapes, especially in racially-blended groups like African-Americans (who average almost 25% European ancestry).
https://www.science.org/content/article/genetic-study-reveal…

An X-ray can detect the shape of teeth, which is also different. (For example, the back of the front teeth is flat in Europeans but concave in Asians.)

AI facial recognition programs use bony landmarks and eye shapes every day of the week. The facial recognition programs construct realistic portraits of all races. Take a look at the Land’s End catalog which uses AI models, not live models, of all races.

If the scientists don’t understand how this is done, it’s because they aren’t artists and haven’t worked with facial recognition.

Using the word “racist” is pure click-bait. AI isn’t racist. It’s doing what it’s programmed to do by artists. No mystery at all.

Wendy

14 Likes

Ok, but is that a plus or a minus.

You are not surprised to learn that poverty, nutrition, diet preferences, etc cause our bodies to develop differently. Or that AI is able to identify those differences.

When it comes to medical, those differences allow treatments to be customized one would hope for better outcomes.

Is that racism? Or is it common sense?

3 Likes

Being able to recognize race is not racist.

I guess you mean AI is race aware.

5 Likes

The first thought that comes to mind is “Who cares?”

Generally, X-rays are not required for anything other than medical healthcare issues. Healthcare
issues are typically requiring rather intimate knowledge of patients by those providing the
services.
Do you really want healthcare providers to not be aware of the patient’s race and general
medical history?

Howie52

4 Likes

I sound like they finally got around to reading Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy by Cathy O’Neil
https://www.goodreads.com/book/show/28186015-weapons-of-math…

The study found that an artificial intelligence program trained to read X-rays and CT scans could predict a person’s race with 90 percent accuracy. But the scientists who conducted the study say they have no idea how the computer figures it out.

Law of Large Numbers. Get enough data, you can see/figure out correlations.

You can do the same thing with EKGs, lab, and other data points, and have a certain degree of success. Doesn’t mean AI or medicine is racist.

JLC

could predict a person’s race with 90 percent accuracy.

And, of course, a statistic like that is assuming that there is some other method of assessing race which is 100% accurate to serve as the reference … which doesn’t exist.