• UnderpantsWeevil@lemmy.world
    link
    fedilink
    English
    arrow-up
    25
    arrow-down
    1
    ·
    11 months ago

    These algorithms already have a comical bias towards the folks contracting their use.

    Case in point, the UK Home Office recently contracted with an AI firm to rapidly parse through large backlogs of digital information.

    The Guardian has uncovered evidence that some of the tools being used have the potential to produce discriminatory results, such as:

    An algorithm used by the Department for Work and Pensions (DWP) which an MP believes mistakenly led to dozens of people having their benefits removed.

    A facial recognition tool used by the Metropolitan police has been found to make more mistakes recognising black faces than white ones under certain settings.

    An algorithm used by the Home Office to flag up sham marriages which has been disproportionately selecting people of certain nationalities.

    Monopoly was a lie. You’re never going to get that Bank Error In Your Favor. It doesn’t happen. The House (or, the Home Office, in this case) always wins when these digital tools are employed, because the money for the tool is predicated on these agencies clipping benefits and extorting additional fines from the public at-large.

    • butterflyattack@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      11 months ago

      Bank errors in your favour do happen, or at least they did - one happened to me maybe twenty five years ago. I was broke and went to the bank to pay in my last £30-something of cash to cover an outgoing bill. Stopped at the cash machine outside my bank to check my balance was sufficient now, and found that the cashier had put an extra 4 zeros on the figure I’d deposited. I was rich! I was also in my early 20s and not thinking too clearly I guess because my immediate response was to rush home to get my passport with the intention of going abroad and opening an account into which to transfer the funds, never coming back. I checked my balance again at another machine closer to home and the bank had already caught and corrected their mistake. Took them maybe thirty minutes.

      After a bit of occurred to me that I was lucky really, because I didn’t know what the fuck I was doing and the funds would have been traced very easily and I’d have been in deep shit.

      But yeah, anecdotal, but shit like that did happen. I assume it’s more rare these days as fewer humans are involved in the system, and fewer people use cash.