This is the webpage of the project "Anytime Universal Intelligence" (anYnt).(alpha november yankee november tango)
|
Funding Entity: MEC (Ministerio de Educación y Ciencia), AYUDAS PARA LA REALIZACIÓN ACCIONES COMPLEMENTARIAS DENTRO DEL PROGRAMA NACIONAL DE PROYECTOS DE INVESTIGACIÓN FUNDAMENTAL, PLAN NACIONAL DE I+D+i 2008-2011
Type of Project: EXPLORA
Acceptance rate: 14 from 98 (14.2%)
Reference: TIN2009-06078-E/TIN
Period: September 2009 - December 2011
The project is already finished and this webpage not properly maintained, but we still keep an account of related publications and news here
|
SUMMARY OF THE PROJECT:
Following ideas from the first intelligence definitions and tests based on Algorithmic Information Theory [Dowe and Hajek 1997] [Hernandez-Orallo 2000a] [Legg and Hutter 2007], we face the challenge of constructing the first universal, formal, but at the same time practical, intelligence test. The key issue is the notion of "anytime" test, which will allow a quick convergence of the test to the subject's level of intelligence and a progressively better assessment the more time we provide. The ultimate goal is that science will be able some day to measure intelligence of higher animals (e.g. apes), humans and machines in a universal and practical way.
WORKING TEAM:
- José Hernández-Orallo, Associate Professor (T.U.), Departamento de Sistemas Informáticos y Computación, Universitat Politècnica de Valencia, Spain.
- David L. Dowe, Associate Professor, Clayton School of Information Technology, Monash University, Australia.
- María-Victoria Hernández-Lloreda, Associate Professor (T.U.), Departamento de Metodología de las Ciencias del Comportamiento Universidad Complutense de Madrid, Spain.
- Sergio España-Cubillo, Research Assistant, Departamento de Sistemas Informáticos y Computación, Universitat Politècnica de València, Spain.
- Javier Insa-Cabrera, Research Assistant, Departamento de Sistemas Informáticos y Computación, Universitat Politècnica de València, Spain.
FULL DESCRIPTION OF THE PROJECT:
A full description of the project (as of its original proposal in March 2009) can be found here.
REPORTS AND PAPERS INSIDE THE PROJECT:
- J. Hernandez-Orallo, D.L. Dowe "Measuring Universal Intelligence: Towards an Anytime Intelligence Test", Artificial Intelligence, 2010. ISSN 0004-3702, DOI: 10.1016/j.artint.2010.09.006: This paper sets up the theoretical framework
. (Some errata) (Preprint version (as of July 2010, *not* the final version)) (Slides of a 30' presentation)
- J. Hernandez-Orallo "A (hopefully) Unbiased Universal Environment Class for Measuring Intelligence of Biological and Artificial Systems (EXTENDED VERSION)", 2010 (abridged version in AGI'2010, Artificial General Intelligence, Lugano, March 2010): This paper develops a possible environment to evaluate different kinds of subjects. Slides of AGI'2010 presentation, Video of the AGI'2010 presentation. Panel discussion.
- J. Hernandez-Orallo "On Evaluating Agent Performance in a Fixed Period of Time (EXTENDED VERSION)" (abridged version in AGI'2010, Artificial General Intelligence, Lugano, March 2010) : This paper analyses the problem of evaluating agents in a fixed period of time and the specific problem of "stopping policies". Slides of AGI'2010 presentation , Video of the AGI'2010 presentation. Panel discussion.
- J. Hernandez-Orallo, D.L. Dowe, S. España-Cubillo, M.V. Hernandez-Lloreda, J. Insa-Cabrera "On more realistic environment distributions for defining, evaluating and developing intelligence" (Artificial General Intelligence, Mountain View, San Francisco, August 2011) : This paper introduces the so-called Darwin-Wallace distribution, a more realistic prior from which environments and intelligence test can be constructed. Slides of AGI'2011 presentation
- J. Insa-Cabrera, D.L. Dowe, S. España-Cubillo, M.V. Hernandez-Lloreda, J. Hernandez-Orallo "Comparing Humans and AI agents" (Artificial General Intelligence, Mountain View, San Francisco, August 2011) : This paper compares the performance of humans and a reinforcement learning agent (Q-learning) using an intelligence test. Slides of AGI'2011 presentation
- D.L. Dowe, J. Hernandez-Orallo, P.K. Das "Compression and intelligence: social environments and communication" (Artificial General Intelligence, Mountain View, San Francisco, August 2011) : This paper discusses the choice between multiple-model inference and single-model inference, and the two-part code vs. one-part code, and the implications for intelligence, social environments and communication. Slides of AGI'2011 presentation
- J. Insa-Cabrera, D.L. Dowe, J. Hernandez-Orallo "Evaluating a reinforcement learning algorithm
with a general intelligence test" (Conferencia de la Asociación Española de Inteligencia Artificial, November 2011) : This paper analysis a reinforcement learning agent (Q-learning) using an intelligence test.
- J. Hernandez-Orallo "On Discriminative Environments, Randomness,
Two-part Compression and MML": This paper discusses whether an environment class exist where only projectible environments appear. 2010
- J. Insa-Cabrera "Una arquitectura para la evaluación de sistemas inteligentes" (An architecture for the evaluation of intelligent systems (in Spanish) 2010: This report introduces the software architecture (in Java) we will use to make the tests. There is also a Presentation (also in Spanish)
- J. Hernandez-Orallo, D.L. Dowe "Mammals, machines and mind games. Who's the smartest?." The Conversation 2011
- J. Hernandez-Orallo, J. Insa-Cabrera, D.L. Dowe, B. Hibbard "Turing Tests with Turing Machines" The Alan Turing Centenary Conference, edited by A. Voronkov, Manchester, June, 2012.
- J. Insa-Cabrera, J. Hernandez-Orallo, D.L. Dowe, S. España, M.V. Hernandez-Lloreda "The ANYNT Project Intelligence Test : LAMBDA - one" AISB/IACAP 2012 Symposium "Revisiting Turing and his Test", edited by V. Muller and A. Ayesh, pp. 20-27, Birmingham, July, 2012.
- J. Hernandez-Orallo, J. Insa-Cabrera, D.L. Dowe, B. Hibbard "Turing Machines and Recursive Turing Tests" AISB/IACAP 2012 Symposium "Revisiting Turing and his Test", edited by V. Muller and A. Ayesh, pp. 28-33, Birmingham, July, 2012.
- D.L. Dowe, J. Hernández-Orallo "IQ tests are not for machines, yet." The Intelligence Journal, vol. 40, no. 2, pp 77-81, 2012.
- J. Hernandez-Orallo, D.L. Dowe "On Potential Cognitive
Abilities in the Machine
Kingdom" Minds and
Machines, to appear, 2013.
-
J. Insa-Cabrera, J.L. Benacloch-Ayuso, J. Hernandez-Orallo
"On Measuring Social Intelligence: Experiments on Competition and Cooperation",
Artificial General Intelligence - 5th International Conference, AGI 2012, Oxford, UK, December 8-11, 2012. Joscha Bach and Ben Goertzel and Matthew Ikle (eds.) Proceedings, Lecture Notes in Computer Science, vol. 7716, pp. 126-135, 2012.
[PDF]
[Slides]
For a more recent list of publications (of this and other topics), you can also click : here or here.
RELATED PROJECTS, PRESENTATIONS AND PAPERS:
- Webpage about C-test and intelligence measurement using Kolmogorov complexity including the following papers: [Hernandez-Orallo 2000a] "Beyond the Turing Test", [Hernandez-Orallo and Minaya-Collado 1998] "A Formal Definition of Intelligence
Based on an Intensional Variant of Algorithmic Complexity" and [Hernandez-Orallo 2000b] "On the Computational Measurement of Intelligence Factors"
- [Dowe and Hajek 1997] "A computational extension to the Turing Test"
- [Sanghi and Dowe 2003] "A computer program capable of passing I.Q. tests"
- 90' presentation (2012): "Machine intelligence evaluation: from the Turing Test to the present Day (and beyond)", in commemoration of Alan Turing's year). [Slides] .
- [Legg and Hutter 2007] "Universal Intelligence: A Definition of Machine Intelligence"
- A Montecarlo AIXI implementation which is able to suceed in a wide range of simple environments
- A presentation by Shane Legg including the notion of Universal Intelligence, related notions and the results of Montecarlo AIXI
- [Hermann et al 2007] "Humans Have Evolved Specialized Skills of Social Cognition: The Cultural Intelligence Hypothesis"
- Computerized Adaptive Testing
- "Medir sin pie de Rey", Presentation on Captchas, C-tests and measuring collective intelligence (in Spanish)
- "Exploration of virtual mazes by rhesus monkeys (Macaca mulatta)"
- "Everyone's a Critic: Memory Models and Uses for an Artificial Turing Judge by W.J. MacInnes, B.C. Armstrong, D. Pare, G.S. Cree and S. Joordens."
- "The Turing Ratio: A Framework for Open-Ended Task Metrics" by Hassan Masum, Steffen Christensen, Franz Oppache
- Bill Hibbard's SSEC Machine Intelligence project
- Inside the Mind of Animals, Time Magazine
. Take a look at this impressive video.
- Metagame
- Evaluation Overfitting in Empirical Reinforcement Learning
OUR TESTS:
In this section we will include the tests we developed during the project.
SOFTWARE:
Other tests, contests and systems:
In the Media (and humour):
Please don't take this section too seriously. Not all journalists know what a quoted text means. We haven't said everything that they say we say.
In English:
In Spanish:
Other languages:
Interviews and write-ups:
- Onda Regional Murcia. Programa: Nuevos Conocimientos (In Spanish), 31/1/2011.
- Lindy Burns interview of David Dowe on 774 ABC 3LO radio, Melbourne,
Australia, Tue 13/Sept/2011, (from) about 4:23pm until about 4:30pm.
- "The Party Show", 3RRR radio (102.7FM radio), Melbourne, Australia, Sun 16/Oct/2011 00:00 - 02:00a.m. (2 hours),
hosted by Headley Gritter, ``TECHNOLOGY'': (guest panel of) David "Wiz" Moylan, Adam Turner, Assoc. Prof. David Dowe,
16th Oct 2011.
- .Ràdio 9, Programa Matí (In Catalan), 1/1/2011
- Ràdio 4.RNE, L'Observatori, Catalunya (In Catalan), 11/2/2011
- EfervesCiencia. (In Galician), 5/2/2011
- Aula Abierta. Onda Local de Andalucía (In Spanish), 5/2/2011
- Diaro Público. En relación a Watson de IBM . (In Spanish), 14/2/2011
- Heraldo de Aragón Tuesday 20 November 2012, interviewed by María Pilar Perla Mateo (In Spanish)
-
"The
Conversation Hour",
774 ABC 3LO Melbourne
Wedn 26/Sept/2012, 11:05ish a.m. - 11:59ish a.m.,
hosted by Jon Faine,
(Conversation Hour forum: artificial intelligence
An overview of the likelihood artificial intelligence will inhibit our day to
day activities and the questions we should be asking... Panel: David L. Dowe, Adam A. Ford, Meredith Doig (posted online Tuesday 16 October 2012 5:33pm).
After all this empirical evidence with the media, we've developed a new concept called "anytime media" ;-)
Namely,
- they can call at any time.
- they can ask anything.
- they can write anything.
- they get worse the more time they have.
We have also proved the "anytime media theorem": Given an interview with the media, the output is completely independent from the input.
And finally, you're now ready for this ;-)
A smart machine will first consider which is more worth its while: to perform the given task or, instead, to figure some way out of it. Whichever is easier. And why indeed should it behave otherwise, being truly intelligent? For true intelligence demands choice, internal freedom. And therefore we have the malingerants, fudgerators, and drudge-dodgers, not to mention the special phenomenon of simulimbecility or mimicretinism. A mimicretin is a computer that plays stupid in order, once and for all, to be left in peace. And I found out what dissimulators are: they simply pretend that they're /not/ pretending to be defective. Or perhaps it's the other way around. The whole thing is very complicated. A probot is a robot on probation, while a servo is one still serving time. A robotch may or may not be a sabot. One vial, and my head is splitting with information and nomenclature. A confuter, for instance, is not a confounding machine — that's a confutator — but a machine which quotes Confucius. A grammus is an antiquated frammus, a gidget — a cross between a gadget and a widget, usually flighty. A bananalog is an analog banana plug. Contraputers are loners, individualists, unable to work with others; the friction these types used to produce on the grid team led to high revoltage, electrical discharges, even fires. Some get completely out of hand — the dynamoks, the locomoters, the cyberserkers.
Stanislaw Lem
Please feel free to contact us at jorallo@dsic.upv.es.