You sound like a crazy person. The actual relevant bit of law is APP 13[1], which has a definition for "holds", which shows the source of the information does matter. If you're going to go and quote half the law, but ignore the actual relevant piece, at least talk to a lawyer.
If ChatGPT just provided it from public info/the training set, am I wrong to think that isn’t as bad?
Just for clarity, I think it’s not a good idea to use LLMs if you care whether the answer is right or wrong. So this is a terrible use case.