the problem with that is, have you noticed how sometimes the AI can just spit out completely false information? because it doesn't provide you with references so you have no way of knowing where it got its information. but sometimes you just know it is wrong.
Yes, I know the problem. There have been famous cases of lawyers for example who filed a lawsuit made by Chat GPT that contained errors. So, we shouldn't be overconfident when using it but that will happen less and less. It has to do with the fact that Chat GPT is programmed for the user's satisfaction, and if you talk to it (I do it to practice languages), he never contradicts you and if he does it is in a very polite way.