In the age of artificial intelligence, super-intelligent machines like GPT have become a reality, leading to the question of how to quantify or measure their intelligence. While IQ tests are widely used to measure human intelligence, could a similar approach be used to assess the intelligence of machines? Is it possible to compare the intelligence of a machine to that of a human in this context, given that machines possess certain cognitive abilities and limitations that differ from those of humans? Additionally, what are some alternative methods for evaluating machine intelligence, and how do they differ from traditional IQ tests used for humans? Finally, what implications might arise from the development of super-intelligent machines, both in terms of how we measure and compare intelligence and in terms of their impact on society as a whole?
1 Answers
tl;dr– Yes, we can give machines IQ-tests. And we basically already do, just often skipping the last step of explicitly recognizing an IQ-score.
IQ-scores can be assigned based on relative performance on some intelligence-test.
Sure, we can give machines IQ-tests.
To be clear, IQ tests are basically just:
Create a test that assigns higher scores to test-takers with higher intelligence.
- For example, if you're primary interested in "intelligence" as in "ability to solve crossword-puzzles quickly", then you can give a test with a bunch of crossword-puzzles, then score test-takers based on stuff like how quickly and completely they do the crossword-puzzles.
Test a bunch of intelligences and score their exams.
Rank the test-takers from lowest-to-highest.
Assign each test-taker a percentile-ranking.
- For example, if a test-taker got a median score, then their percentile-ranking would be 50%.
Calculate IQ by casting the percentile-rankings to a normal-curve with a median of 100 and a standard-deviation of 15.
Equation's $\text{IQ} = \sqrt{2} \operatorname{erf}^{-1}{\left(2p - 1\right)} ~~ p \in \left(0, 1\right) \, ,$ where $p$ is the percentile-rank (e.g., $p=0.5$ for a median-percentile of 50%).
On WolframAlpha: $\texttt{100 + 15 * sqrt(2) * erf^(-1) (2 *}\underbrace{\texttt{ 0.5 }}_{p}\texttt{- 1)}$.
On Microsoft-Excel: $\texttt{=100+15*NORM.S.INV(}\underbrace{\texttt{0.5}}_{p}\texttt{)} \,.$
Folks basically already do this with various AI-models, e.g. when ranking their relative performance on a series of tasks, just don't normally do Steps 4 or 5.
How to compare human-IQ's with machine-IQ's?
Basically just give both humans and machines the same test and rank them, then calculate. That's it.
The main thing would be picking a test that'd test for some notion of "intelligence" that you'd be interested in.
- 142
- 1
- 1
- 8