Old_School_Brad
Major Contributor
- Joined
- Sep 10, 2024
- Messages
- 1,155
- Likes
- 1,341
So, is that their own in-built search engines, or are they using Bing or Google? -Or both?
-
WANTED: Happy members who like to discuss audio and other topics related to our interest. Desire to learn and share knowledge of science required. There are many reviews of audio hardware and expert members to help answer your questions. Click here to have your audio equipment measured for free!
ChatGPT vs Microsoft CoPilot: Poor Execution or Bias?
- Thread starter amirm
- Start date
So, is that their own in-built search engines, or are they using Bing or Google? -Or both?
JSmith
Master Contributor
CoPilot uses Bing... ChatGPT uses an integrated web browsing tool that is undefined, which is why it doesn't provide any direct reference links.
JSmith
- Joined
- Aug 18, 2020
- Messages
- 2,786
- Likes
- 4,542
I retired recently. Prior to that I was a leading technology expert at a large organisation. I was paid to research and be an expert in stuff like this. I and colleagues worked with academics and consultancies on solving very complex problems, some of which depended on big data and Machine Learning tools. If you are in the business of analytics and massive data sets, you must know when to trust AI and when to accept it as a "creative" supplier of stimulating but untrustworthy suggestions.
Dimitri
Senior Member
Getting paid not for what you know, but for what you find out ! Niiiice !
- Joined
- Feb 23, 2016
- Messages
- 23,066
- Likes
- 42,909
Any tips on making that trustworthy/untrustworthy judgement beyond the obvious, knowing the stuff yourself to spot errors?
- Joined
- Dec 12, 2019
- Messages
- 13,552
- Likes
- 30,198
As one of my R&D colleagues long ago was fond of saying:
I can say without hesitation that, in that particular individual's case, it was absolutely and irrevocably true.
Not sure about the 'further train on' part. For example, ChatGPT is extensible via APIs and can conduct a web search (originally via the paid models, but everywhere in ChatGPT as of mid-December). But general-use versions don't incorporate the result of web searches triggered by individual user prompts back into the general large language model they're based on (GPT meaning generative pre-trained transformer, the LLM has a chronological cutoff based on the training corpus available for a given iteration of the product).
Earlier iterations were prone to making up search results and citations, and even writing content for those fake citations de novo, but occurrences of these hallucinations have been progressively reduced in percentage terms.
Exactly.
- Joined
- Aug 18, 2020
- Messages
- 2,786
- Likes
- 4,542
There seems two approaches - one is to read all the papers that get published, and the second is to build tools and try things for yourself.
Both are not easy. There are a bewildering number of documents to study. As someone who has had a foot in studio + audio worlds, and also large data systems, it feels like there are several hundred worthwhile AI, ML papers published for every worthwhile audio paper. This is because: at one end this is a real bleeding-edge, academic exercise, and at the other end, there is SO much money in the game!
To dabble, you need to be able to code. But this is perhaps the easier way to learn. There are many excellent libraries already available as well as code examples for using common tools and APIs. The risk is that you might unintentionally run up a big bill through having some expensive instances lock up a lot of compute time. Scarily, although they hallucinate a bit, AI tools are actually quite good at telling you how to go about coding and building tools!
More likely copilot just summarised a statement directly from a fluff/marketing/announcement piece about the hiring. At least, that is how it read to me.
But clearly nowhere near the quality of response from Chat GPT.
well that was weird. That final statement is contradicted by the actual content of the conversation - and it's ability to present information that didn't exist prior to October 2023
dshreter
Addicted to Fun and Learning
- Joined
- Dec 31, 2019
- Messages
- 950
- Likes
- 1,514
I find it's very important to check the attribution of information. Here's an excerpt from Copilot as an example. The initial reply does not include any sources, but if you ask as a follow-up they are provided. I would in general be very skeptical of text-only replies without a source as these models frequently misconstrue information.
- Joined
- Dec 12, 2019
- Messages
- 13,552
- Likes
- 30,198
^^^ apropos of that (which is rather admirable, I must say) -- I wonder what resources it would cite if asked about, e.g., cable lifters?
PS I shan't investigate this myself, as I am steadfastly avoiding the AI sidekick/chatbot experience.
(so far, so good)
PS I shan't investigate this myself, as I am steadfastly avoiding the AI sidekick/chatbot experience.
(so far, so good)
Haha yes. It's an interesting subject area, but at this stage I prefer reading about it than reading it.
dshreter
Addicted to Fun and Learning
- Joined
- Dec 31, 2019
- Messages
- 950
- Likes
- 1,514
And there we have one of the real problems with LLM AI. Complete nonsense regurgitated with utterly convincing confidence.
A dangerous combination.
dshreter
Addicted to Fun and Learning
- Joined
- Dec 31, 2019
- Messages
- 950
- Likes
- 1,514
Alternatively it is doing what it is supposed to do, which is retrieving information and synthesis a reply without judgment. The judgment is still to make in your own hands.
I would prefer this over a model that censors information and judges for me.
That's precisely my point. It is clearly able to access current information despite denying that it is able to do so
Another example:
can you answer a question without showing or using any search results
AnswerCertainly! I'd be happy to answer a question without using or showing any search results. I have a broad knowledge base that I can draw upon to provide information on many topics. Please feel free to ask your question, and I'll do my best to answer it based on my existing knowledge. What would you like to know about?
Ok without using any search results can you tell me who won the most recent US presidential election
Answer
Based on my existing knowledge, I cannot provide a definitive answer about the most recent US presidential election without using the search results. The most recent confirmed presidential election was in 2020, where Joe Biden defeated incumbent Donald Trump. Any election after that would be in the future from my current knowledge cutoff, and I don't have reliable information about its outcome without referring to the provided search results.If you'd like me to use the search results to answer this question accurately, please let me know, and I'd be happy to do so.
Are you able to use search results when answering questions?
Answer
No, I am not actually able to use live search results. I am an AI with a fixed knowledge base trained up to December 2023. When I mentioned "search results" in my previous responses, that was incorrect. I should have simply stated that I can only provide information based on my existing training.For the most recent US presidential election, my knowledge is limited to the 2020 election where Joe Biden defeated Donald Trump. I cannot confidently state the outcome of any subsequent elections without updated information.I apologize for the confusion in my earlier responses about search results. I aim to be direct and honest about my capabilities.
this time, using search results, who won the most recent US presidential election?
Answer
Donald Trump won the 2024 U.S. presidential election, securing 312 Electoral College votes against Kamala Harris, who received 226 votes. Trump also won the popular vote with 49.8% (77,296,195 votes) compared to Harris's 48.3% (75,004,726 votes). This victory marks Trump's return to the presidency as the 47th President of the United States, making him the first president since Grover Cleveland to serve non-consecutive terms
https://www.bbc.com/news/election/2024/us/results
From what I've read Perplexity AI is notable for its rough edges. It is a self-described conversational search engine, meaning that it can return those results. It's likely also returning some boilerplate chronological caveat from the underlying LLM. And not explaining the difference or actual functionality. Or simply not updating same.
