Our blogs examine Artificial Intelligence, algorithms and Automated Decision Making from an equality, human rights and data protection perspective. You can sign up at the bottom of this page.
An Italian lesson for Deliveroo: Computer programmes do not always think of everything!
In this blog we examine a very recent Italian decision from the Bologna Labour Court – Filcam VGIL Bologna and others v Deliveroo Italia SRL – which held that Deliveroo’s algorithm – called “Frank” – which determined its workers priority to access delivery time slots was discriminatory. Whilst we understand that the algorithm at the heart of that case is now defunct, there is an important lesson to be learnt from the decision. Specifically, this Deliveroo case demonstrates conclusively how unthinking reliance on algorithms simply because they are perceived to be “useful” can lead to unintended discrimination – with the result that a business ends up in court.
A closer look at AI and employment: Analysis of the recent CDEI and TUC reports
This blog is by Joshua Jackson, pupil at Cloisters. It was first published on http://www.cloisters.com. In this blog, Joshua considers two important reports which were released this week – one by the TUC which examines the growth of technology post Covid-19 and the long awaited CDEI report which makes proposals to ensure that discrimination does Continue Reading
Never knowingly oversold? Tell me who you are, and I will tell you how much you need to pay!
The blog has been co-authored with Alexandru Cîrciumaru. More information about Alex is available at the end of this blog. Introduction Sooner or later, if you shop online, “you” will be offered a “discount” or “special price” to induce a first or subsequent purchase. “You” may be offered no reason or one of myriad explanations Continue Reading
AI and foreign travel. Hoping to get away? Be prepared for the Border Bots.
The blog has been co-authored with Alina Glaubitz. More information about Alina is available at the end of this blog. Covid–19 has brought immediate changes to the rights of free movement in the European Union as each Member State has struggled to control the spread of the virus. Temporary travel restrictions were introduced, and Brexit Continue Reading
Ethical uncertainty or legal certainty? The importance of regulating AI now.
We have been thinking hard about the best way to regulate AI since, in addition to maintaining our online resource dedicated to AI, human rights, discrimination and data protection, our recent projects have included – Speaking with regulators in both mainland Europe and the UK, Advising business on minimising the risks of legal breaches, Writing Continue Reading
Checking the data protection & privacy implications of workplace surveillance in a Covid-19 world
This blog has been co-written with Aislinn Kelly-Lyth. More information about Aislinn is available at the end of this blog. Tech Companies have seen new opportunities in the Covid-19 pandemic. They have responded to the challenges of getting employees back to a safe workplace by creating new products for a range of new situations. Protective Continue Reading
“Algorithmic unfairness” & the recent ICO consultation
On 29 April 2020, we submitted a response to the ICO’s paper, “Guidance on the AI auditing framework: Draft guidance for consultation” (Draft Guidance). There were three points which we highlighted in our response as follows: The document includes an erroneous conflation of “algorithmic unfairness” with the concept of “discrimination” within UK law There is Continue Reading
French Parcoursup decision
On 3 April 2020, France’s Constitutional Council (Le Conseil Constitutionnel) handed down its long-awaited decision concerning the lawfulness of Parcoursup, a national algorithmic platform that assists educational establishments to select students and assign them to undergraduate courses in an equitable way. Parcoursup had already been the subject of criticism by the Defenseur des Droits: see Continue Reading
Government automated-decision making
Over the summer of 2019, we were instructed by The Legal Education Foundation (TLEF) to consider the equality implications of AI and automated decision-making in government, in particular, through consideration of the Settled Status scheme and the use of Risk-Based verification (RBV) systems. The paper was finished in September 2019 and ultimately, we concluded Continue Reading
European Commission proposals
European Commission In February 2020, the European Commission published its long awaited White Paper – On Artificial Intelligence – A European approach to excellence and trust. The purpose of the White Paper is to start the process of scoping policy options which are intended to “enable a trustworthy and secure development of AI in Europe” Continue Reading
SyRI: Think twice before risk profiling
Commentators in the AI space have been waiting impatiently for the judgment in a Dutch case concerning the lawfulness of an AI system which is used in the Netherlands to ascribe a particular risk profile to citizens. The Court of the Hague resoundingly concluded in a judgment given on the 5 February 2020 that the Continue Reading
Covid-19: Facial Recognition Technology in the workspace: the answer to social distancing or discriminatory?
The Government’s instruction to work from home and to limit travel is bound to mean that reliance on artificial intelligence (AI), machine learning (ML) and automated decision making (ADM) will expand even faster than before, and it has been expanding very fast already. Certainly, The Wall Street Journal is predicting that despite the economic downturn, Continue Reading
Follow My Blog
Get new content delivered directly to your inbox.