Note: this is an attempt to engage with and interpret a piece of legislation on the usage of AI. I don't have a strong opinion on this yet and expect it to be controversial which is why I preferred the Question Mode.
In the AI Act, i.e., EU's regulatory framework for the usage of AI-related technologies it is mentioned that
The following artificial intelligence practices shall be prohibited:
the placing on the market, putting into service or use of an AI system that
exploits any of the vulnerabilities of a specific group of persons due to their
age, physical or mental disability, in order to materially distort the behaviour of
a person pertaining to that group in a manner that causes or is likely to cause
that person or another person physical or psychological harm.
Title II, Article 5, p. 43 (English Version).
I'll set up one interpretation of this statement in debate form:
Question: should AI writers be prohibited in education?
Claim: we can stretch this statement to apply to the usage of AI writing products employed by underage students for their assignments. This technology exploits students' inability to make a fully-informed and thoughtful decision as to what would be beneficial for their intellectual development and education. Therefore, the practice should be prohibited.
Counterclaim: the AI system is not exploiting anyone's vulnerability as the notion of vulnerability should not be considered to entail one's proneness to dishonesty or cheating behaviors. Therefore, AI writers should not be prohibited and students should be held accountable for cheating when using AI writing models to compose their assignments.
Feel free to continue the debate in the comments section.