José Hernández-Orallo
Professor, Departament de Sistemes Informàtics i Computació Valencian Research Institute for Artificial Intelligence Universitat Politècnica de València Phone: + 34 96 3877007 Ext.: 73585, Office: DSIC (1F): 236 Address: Camí de Vera 14, E-46071 València, EU Email: jorallo@dsic.upv.es Associate Fellow, Leverhulme Centre for the Future of IntelligenceRecent Highlights
- Paper accepted for the Machine Learning Journal: The Teaching Size: Computable Teachers and Learners for Universal Languages" with Jan Arne Telle and Cesar Ferri
- Co-organising the Animal-AI Olympics. Participate or get involved!
- Co-organising the ECMLPKDD workshop on Automating Data Science (AutoDS).
- Paper accepted for the Journal of Artificial Intelligence Research: "AI Generality and Spearman's Law of Diminishing Returns".
- Co-organising the AISafety Workshop at IJCAI 2019.
- Gave a talk at the Cambridge Science Festival.
- Measure for measure column: "Unbridled mental power", Nature Physics, vol. 15, January 2019.
- Paper accepted for the IEEE Transactions on Games with Fernando Martinez-Plumed "Dual Indicators to Analyse AI Benchmarks: Difficulty, Discrimination, Ability and Generality".
- Participated at the HumaInt Winter School at the JRC of the European Commission, with two invited talks: Artificial Intelligence : Present, Future and Beyond and The What and How of AI Evaluation.
- Paper accepted for the AAAI/ACM Conference on Artificcial Intelligence, Ethics, and Society with Karina Vold: "AI Extenders: The Ethical and Societal Implications of Humans Cognitively Extended by AI", AAAI / ACM Conference on Artificial Intelligence, Ethics and Society, Honolulu, 27-28 January 2019. (Presentation).
- Co-organised The AAAI's Workshop on Artificial Intelligence Safety at AAAI 2019, Honolulu, Hawaii, January 2019. Also presented Surveying Safety-Relevant AI Characteristics
- Paper accepted for the Data Mining and Knowledge Discovery Journal with C. Ferri and P. Flach: Setting Decision Thresholds when Operating Conditions are Uncertain".
- Co-organised "Generality and Intelligence: from Biology to AI", 5th October, 2018, as part of the MIT-IBM AI Week and the Cambridge^2 initiative, a series of more extensive workshops taking place in Cambridge, UK, and Cambridge, MA, co-organised by the MIT-IBM Watson AI Lab and the Leverhulme Centre for the Future of Intelligence.
- Paper accepted for the Artificial Intelligence Journal: Item Response Theory in AI: Analysing Machine Learning Classifiers at the Instance Level".
- Was on sabbatical leave (2017-2018) as visiting fellow at the Leverhulme Centre for the Future of Intelligence. Also visiting fellow at Clare Hall, Cambridge, UK.
- Our project "Paradigms of Artificial General Intelligence and Their Associated Risks", co-led with Seán Ó hÉigeartaigh at CSER, has been selected by the highly competitive Future of Life's AGI safety grants.
- Paper accepted for IJCAI 2018: "The Facets of Artificial Intelligence".
- Presentation at Varieties of Minds 2018: Diversity Unites Intelligence: Measuring Generality.
- Co-organised Architectures and Evaluation for Generality, Autonomy and Progress in AI at IJCAI/ECAI 2018, ICML 2018 and AAMAS 2018 , which took place in Stockholm in July 2018.
- Received the Prose Award 2018 presented by the Association of American Publishers for my book The Measure of All Minds.
RESEARCH
One of the great scientific challenges of this century is to understand what intelligence is and how it can be recreated. My bit is, on one hand, the evaluation and measurement of intelligent systems in general and machine learning in particular and, on the other hand, some more applied research on data science, data mining and inductive programming. However, I'm interested in many other things, and my publication profiles below can give a better account of what my research really looks like: Here you also have a selection of some recent tutorials and presentations:- Surveying Safety-Relevant AI Characteristics, SafeAI2019 AAAI Workshop, Honolulu, 27 January 2019.
- AI Extenders: The Ethical and Societal Implications of Humans Cognitively Extended by AI, AAAI / ACM Conference on Artificial Intelligence, Ethics and Society, Honolulu, 27-28 January 2019.
- Artificial Intelligence : Present, Future and Beyond, [video], HUMAINT Winter school on AI and its ethical, social, legal and economic impact, JRC Seville, February 4-8th, 2019.
- The What and How of AI Evaluation, [video], HUMAINT Winter school on AI and its ethical, social, legal and economic impact, JRC Seville, February 4-8th, 2019.
- Artificial Intelligence and Data Science : Looking Ahead, Springer Nature Conference on Artificial Intelligence in Biomedicine, Madrid 7th February 2019.
- Diversity Unites Intelligence: Measuring Generality at Varieties of Minds 2018 in Cambridge, 2018
- Measuring A(G)I Right: Some Theoretical and Practical Considerations at DeepMind, London, 2018
- Natural and Artificial Intelligence: Measures, Maps and Taxonomies at Clare Hall, Cambridge, 2018
- The Mythical Human-Level Machine Intelligence at Philosophy and Theory of AI in Leeds, 2017
- FHI, Oxford, Aug 2016, or the very similar CSER, Cambridge, Aug 2016, about the measurement of natural and artificial intelligence
- Machine learning performance evaluation: tips and pitfalls at PAPIs Connect, 2016
- AGI 2015 Tutorial: Evaluation of Intelligent Systems
- Invited Talk at ECML Workshop on Learning over Multiple Contexts 2014
- Machine intelligence evaluation: from the Turing Test to the present Day (and beyond), for a Turing centenary celebration
OUR GROUP
Data Mining, Machine Intelligence and Inductive Programming (DMIP), part of the ELP group.- You can see the projects, software and other activities of our group here.
- If you're a student or an academic and want to collaborate with us or get involved with our group, please feel free to contact us.
- We are part of the Valencian Research Institute for Artificial Intelligence
TEACHING
- More than 7000 students (as for July 2019) on my MOOC EDX course on Machine Learning and Data Science (in Spanish) I currently teach several courses on data science and data mining at the master level.
- I also had an undergraduate database course for many years.
TRANSFER
We have had projects, collaborations and visits with several companies in different areas: health, retailing, software development, automotive, ... Recently, I've been managing two "Cátedras/Aulas de Empresa":- Agreement (cátedra) with BigML on machine learning.
- Agreement (aula) with Everis on employability in information technology.
SHORT BIO
José Hernández-Orallo is Professor at the Universitat Politecnica de Valencia. He received a B.Sc. and a M.Sc. in Computer Science from UPV, partly completed at the École Nationale Supérieure de l'Électronique et de ses Applications (France), and a Ph.D. in Logic with a doctoral extraordinary prize from the University of Valencia. His academic and research activities have spanned several areas of artificial intelligence, machine learning, data science and information systems. He has published five books and more than a hundred journal articles and conference papers on these topics. His research in the area of machine intelligence evaluation has been covered by several popular outlets, such as The Economist, New Scientist or Nature. His most recent book addresses an integrated view of the evaluation of natural and artificial intelligence (Cambridge University Press, 2017, PROSE Award 2018).IN THE MEDIA (and blogs)
Don't take this too seriously:- The Economist, March 3rd 2011
- New Scientist Sat 10/Sept/2011, pp42-45.
- Alpha Galileo. World's independent source of research news
- Eurekalert. Global news service of the AAAS (American Association for the Advancement of Science)
- ACM Tech News
- Vokrug Sveta (Russia)
- BBC News
- Nature
- Inverse
- Financial Times
- ...