Network Science Institute: Are Computers Becoming Less General-Purpose? Deep Learning, Hardware Specialization, and the Fragmentation of Computing
Title: Are Computers Becoming Less General-Purpose? Deep Learning, Hardware Specialization, and the Fragmentation of ComputingSpeaker: Neil C. Thompson, Research Scientist, Computer Science and Artificial Intelligence Lab, MITLocation: Northeastern University, 177 Huntington Avenue, Boston, MA 02115AbstractIt is a triumph of technology and of economics that our computer chips are so universal - the staggering variety of calculations they can compute make countless applications possible. But, this was not always the case. Computers used to be specialized, doing only narrow sets of calculations. Their rise as a ‘general purpose technology (GPT)’ only happened because of ground-breaking technical advancements by computer scientists like Von Neumann and Turing, and virtuous economics common to general purpose technologies, where product improvement and market growth fuel each other in a mutually reinforcing cycle.This paper argues that technological and economic forces are now pushing computing in the opposite direction, making computer processors less general-purpose and more specialized. This process has already begun, driven by the slow down in Moore’s Law and the algorithmic success of Deep Learning. This threatens to fragment computing into those applications that get to be in 'fast lane' because special customized chips are developed for them, while other applications get stuck in the 'slow lane' using general-purpose chips whose progress fades.The rise of general purpose computer chips has been remarkable. So, too, could be its fall. This paper outlines the forces already starting to fragment this general purpose technology.About the SpeakerI am a Research Scientist at MIT’s Computer Science and Artificial Intelligence Lab and a Visiting Professor at the Lab for Innovation Science at Harvard. I am also an Associate Member of the Broad Institute, and was previously an Assistant Professor of Innovation and Strategy at the MIT Sloan School of Management, where I co-directed the Experimental Innovation Lab (X-Lab). I have advised businesses and government on the future of Moore’s Law and have been on National Academies panels on transformational technologies and scientific reliability. I did my PhD in Business and Public Policy at Berkeley, where I also did Masters degrees in Computer Science and Statistics. I have a masters in Economics from the London School of Economics, and undergraduate degrees in Physics and International Development. Prior to academia, I worked at organizations such as Lawrence Livermore National Laboratories, Bain and Company, The United Nations, the World Bank, and the Canadian Parliament.
Tuesday, October 9, 2018 at 12:00pm
No recent activity