Google Search Without the AI

‘Forget AI. Google just created a version of its search engine free of all the extra junk it has added over the past decade-plus. All you have to do is add “udm= 14” to the search URL….’ ( via Tedium )

Do LLMs display theory of mind behavior indistinguishable from human mentalization?

 

‘At the core of what defines us as humans is the concept of theory of mind: the ability to track other people’s mental states. The recent development of large language models (LLMs) such as ChatGPT has led to intense debate about the possibility that these models exhibit behaviour that is indistinguishable from human behaviour in theory of mind tasks. Here we compare human and LLM performance on a comprehensive battery of measurements that aim to measure different theory of mind abilities, from understanding false beliefs to interpreting indirect requests and recognizing irony and faux pas. We tested two families of LLMs (GPT and LLaMA2) repeatedly against these measures and compared their performance with those from a sample of 1,907 human participants. Across the battery of theory of mind tests, we found that GPT-4 models performed at, or even sometimes above, human levels at identifying indirect requests, false beliefs and misdirection, but struggled with detecting faux pas. Faux pas, however, was the only test where LLaMA2 outperformed humans. Follow-up manipulations of the belief likelihood revealed that the superiority of LLaMA2 was illusory, possibly reflecting a bias towards attributing ignorance. By contrast, the poor performance of GPT originated from a hyperconservative approach towards committing to conclusions rather than from a genuine failure of inference. These findings not only demonstrate that LLMs exhibit behaviour that is consistent with the outputs of mentalistic inference in humans but also highlight the importance of systematic testing to ensure a non-superficial comparison between human and artificial intelligences….’ (Nature Human Behaviour

Posted in Uncategorized

We just translated chimpanzee language. They’re talking about snakes.

Chimpanzees communication.

‘A study was published in Nature examining communication among chimpanzees. It found that chimps use “words,” and can combine the words into “syntactic-like structures,” the beginnings of phrases / sentences.

“Chimpanzees produce ‘alarm-huus’ when surprised and ‘waa-barks’ when potentially recruiting conspecifics during aggression or hunting. Anecdotal data suggested chimpanzees combine these calls specifically when encountering snakes. Using snake presentations, we confirm call combinations are produced when individuals encounter snakes and find that more individuals join the caller after hearing the combination.

So chimps have a “word” for surprise/danger and a “word” for come quickly, and when they combine them when seeing a snake, they are forming a proto-sentence with the approximate meaning of “Holy crap, get over here!”…’

— via Boing Boing

Posted in Uncategorized