The Basque Country is implementing Quantus Skin in its health clinics after an investment of 1.6 million euros. Specialists criticise the artificial intelligence developed by the Asisa subsidiary due to its “poor” and “dangerous” results. The algorithm has been trained only with data from white patients.

  • Phoenixz@lemmy.ca
    link
    fedilink
    English
    arrow-up
    0
    arrow-down
    3
    ·
    13 days ago

    Though I get the point, I would caution against calling “racism!” on AI not being able to detect molea or cancers well on people with darker skin; its harder to see darker areas on darker skins. That is physics, not racism

    • zout@fedia.io
      link
      fedilink
      arrow-up
      3
      ·
      13 days ago

      The racism is in training on white patients only, not in the abilities of the AI in this case.

      • Hardeehar@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        arrow-down
        2
        ·
        13 days ago

        It’s still not racism. The article itself says there is a lack of diversity in the training data. Training data will consist of 100% “obvious” pictures of skin cancers which is most books and online images I’ve looked into seems to be majority fair skinned individuals.

        “…such algorithms perform worse on black people, which is not due to technical problems, but to a lack of diversity in the training data…”

        Calling out things as racist really works to mask what a useful tool this could be to help screen for skin cancers.

        • xorollo@leminal.space
          link
          fedilink
          English
          arrow-up
          1
          ·
          13 days ago

          Why is there a lack of robust training data across skin colors? Could it be that people with darker skin colors have less access to cutting edge medical care and research studies? Would be pretty racist.

          There is a similar bias in medical literature for genders. Many studies only consider males. That is sexist.

        • Revan343@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          ·
          13 days ago

          Training data will consist of 100% “obvious” pictures of skin cancers

          Only if you’re using shitty training data

    • TimewornTraveler@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      13 days ago

      if only you read more than three sentences you’d see the problem is with the training data. instead you chose to make sure no one said the R word. ben shapiro would be proud

    • Leon@pawb.social
      link
      fedilink
      English
      arrow-up
      2
      ·
      11 days ago

      It is a direct result of structural racism, as it’s a product of the treatment of white men as being the default. You see it all the time in medicine. There are conditions that disproportionately affect black people that we don’t know enough about because time and money hasn’t been spent studying it.

      Women face the same problem. Lots of conditions apply differently in women. An example of this being why women historically have been underrepresented in e.g. autism diagnoses. It presents differently so for a while the assumption was made that women just can’t be autistic.

      I don’t think necessarily that people who perpetuate this problem are doing so out of malice, they probably don’t think of women/black people as lesser (hell, many probably are women and/or black), but it doesn’t change the fact that structural problems requires awareness and conscious effort to correct.

    • Melvin_Ferd@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      arrow-down
      2
      ·
      13 days ago

      Think more about the intended audience.

      This isn’t about melanoma. The media has been pushing yellow journalism like this regarding AI since it became big.

      It’s similar to how right wing media would push headlines about immigrant invasions. Hating on AI is the left’s version of illegal immigrants.

      • goldenbug@fedia.io
        link
        fedilink
        arrow-up
        1
        ·
        13 days ago

        Reading the article, it seems like badly regulated procurement processes with a company that did not meet the criteria to begin with.

        Poor results on people with darker skin colour are a known issue. However, the article says its training data containes ONLY white patients. The issue is not hate against AI, it’s about what the tools can do with obviously problematic data.

        Unless the article is lying, these are valid concerns that have nothing to do with hating on AI, it has all to do with the minimal requirements for health AI tools.

        • Melvin_Ferd@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          arrow-down
          1
          ·
          edit-2
          13 days ago

          Do you think any of these articles are lying or that these are not intended to generate certain sentiments towards immigrants?

          Are they valid concerns to be aware of?

          The reason I’m asking is because could you not say the same about any of these articles even though we all know exactly what the NY Post is doing?

          Compare it to posts on Lemmy with AI topics. They’re the same.

            • Melvin_Ferd@lemmy.world
              link
              fedilink
              English
              arrow-up
              0
              arrow-down
              1
              ·
              edit-2
              13 days ago

              Media forcing opinions using the same framework they always use.

              Regardless if it’s the right or the left. Media is owned by people lik the Koch and bannons and Murdoch’s even left leading media.

              They don’t want the left using AI or building on it. They’ve been pushing a ton of articles to left leaning spaces using the same framework they use when it’s election season and are looking to spin up the right wing base. It’s all about taking jobs, threats to children, status quo.