AI accused me of fraud
I recently tried to employ a conveyancing solicitor, standard protocol they need to see ID and run it through an authenticator to make sure you are who you say you are. In this case they used an ID authenticator from 'Legl'.
Legl has an in-browser thing that accesses your phone's camera and takes a photo of your ID, I used that to upload an image of my passport as directed. It failed. And again. I spoke to the solicitor, offered to show them my physical passports, they told me to keep trying the system. I did. Even tried with my other, dual-nationality passport. Same result. Eventually it locked me out, and I received this message from the solicitor:
>Owing to the search company’s confirmation that they consider your ID has been digitally tampered with – on both passports the ... Compliance Department has said that I must decline your instructions.
My phone is almost ten years old and has no camera filters enabled, the browser was accessing the camera directly. The solicitor, now very curt and terse - clearly suspects me of doing something wrong - said I'd have to speak to Legl about it. I tried emailing Legl and they told me they were unable to discuss it with me and I would have to speak to the solicitors. Who said I should speak to Legl. You see where this is going.
tl;dr sent in two forms of valid ID, offered no other option, Legl's computer said no, the company (and any other service employing Legl's ID services) has now effectively blacklisted me.
I'm fine, I just went with a different conveyancing solicitor who doesn't use Legl. But that's pretty fucking scary. Some bullshit quirk of Legl's algorithm insists you're doing something shady and there's no recourse, no real human will consider the situation, you're just locked out.
It's not just Legl - I got lucky with my solicitor but they all use these algorithmic or AI powered systems and any one of them could turn on you for completely black-boxed reasons and there's nothing you can do about it. Computer says no, bureaucracy says no.