Except that AI, when used by non-experts, comes with this pastiche of authority bolstered in part by perfect grammar. Perfect grammar has always suggested "education" to many human readers who are less educated. Human writers are also subject to validation not only relative to the specific claim in question, but also to the overall track record of their work. AI develops no track record, because getting it right ten times has far less predictive power to suggest whether the 11th is also accurate. AI starts from scratch at every response, even if starting from scratch refers to its own prior work. But the point of the example is that it will pursue its mistakes with determination even when challenged by someone with authority, until it's forced to a different track and presents responses utterly incompatible with what it was insisting on a couple of iterations prior to that.
That places an awfully large burden on the user to know more than the AI engine's data pool so that its summaries can be validated, and that's the one thing users of AI will lack in the common use case.
If I read a work of nonfiction that was asking me to change my view of something on the basis of greater learning, experience, or specific data, I would read the blurb--the "about the author" summary on the dust cover overleaf or on the back of the book. It might say, "Rick Denney has no specific training or experience in the field, but has read every work available about it on the Internet and his statements are predictions based on the likelihood of such statements to appear in all those works." I certainly would not consider the book further--when learning something new, I want to go to the source, or to summary works that properly cite the sources, not get some mish-mash of majority opinions without expert curation. The creators of knowledge (or their expert summarizers) can expand my horizons, or startle me with a whole new direction.
Using AI to, for example, summarize reams of testimony in court cases seems like something really useful for engines that don't forget details and can tolerate the boring vastness of most such, but any expression of a point of view seems to me stolen creativity that might not be in agreement with the next paragraph or the next similar search.
Rick "suspecting LLM developers are still mostly just trying to improve the grammar and expressiveness of the outcome to make it sound even truthier" Denney
You raise a valid point, "AI develops no track record, because getting it right ten times has far less predictive power to suggest whether the 11th is also accurate."
AI NEVER really learns anything, it just spews out the latest search. It's not an expert in ANYTHING. Programmers built in the ability to argue an incorrect fact is right until the user points out how wrong it is and the output is changed again. The final failure is NOTHING is learned from this encounter by the AI. The next search by another user can throw out the same wrong information or another false scenario.
Using Perplexity is like asking for research help from the local dementia ward, exclusively using ONLY patients who can't remember anything that happened more than 5 minutes ago.
