It is true that AI is very energy intensive, as chronicled in one of my previous articles in Dakota Digital Review: \u201cAI s Energy Appetite: Voracious & Efficient.\u201dii<\/sup> It\u2019s also true the emergence of more useful applications for AI tools is leading to a rapid increase in installations of energy-hungry data-center hardware. But, while AI is driving new demands for power, the reality is that conventional computing and communications the existing Cloud account for well over 90 percent of those forecasted rises in power demands.<\/p>\n\n\n\n It is also true that other sectors boost electric demand including, though far less impactful, electric vehicles. The more relevant and big-demand wildcard is whether and how soon goals to reshore manufacturing will be realized. Of course, if AI delivers on its promises, economic growth across the board will be greater than earlier forecast. Then there\u2019ll be the old-fashioned \u2018problem\u2019 of economic growth itself boosting electricity uses.<\/p>\n\n\n\n AI is accelerating a trend that was already underway. In the coming decade, even as AI takes up an increasingly larger share of total digital power appetites, the uses of conventional silicon will also expand and are forecast to still account for more than 70 percent of total digital electricity consumption by 2030.iii<\/sup>And those expected digital demands are at scales shocking to local and state utilities and regulators everywhere. In North Dakota, The Bismarck Tribune reported near-term plans for a handful of new data centers that would alone consume as much power as all that state\u2019s residences.iv<\/sup><\/p>\n\n\n\n This all distills to a rediscovery of a simple reality: Planners and policymakers need to refresh their views about how to meet society\u2019s electricity and energy needs based on growth<\/em>. One thing is clear, if planners fail to ensure adequate supply, and there isn\u2019t enough electricity, then the growth won\u2019t happen. Planners and forecasters might want to know whether this is a bubble or a trend and, in the latter, just how much more global and local digital demand is yet to come?<\/p>\n\n\n\n The idea of something as remarkable as a global, interconnected information and knowledge-supplying and knowledge-creating infrastructure is not new. Back in 1938, H.G. Wells\u2019s novel World Brain<\/em> imagined such a thing during that era of revolutionary globe-spanning telephone and telegraph networks. A couple of decades later, in 1962, the Council on Library Resources launched a project to imagine the \u201cLibraries of the Future\u201d and asked MIT computer scientist J. C. Licklider to provide a technology how soon goals to reshore manufacturing will be realized. Of course, if AI delivers on its promises, economic roadmap, the same year that President John F. Kennedy made his famous \u201cwithin this decade\u201d moonshot speech.<\/p>\n\n\n\n Futurists of the 1960s were not only inspired by rocket ships but also by the arrival of the mass production of transistors, the proliferation of mainframe computers and the first communications satellites. In 1962, there were about 2,000 computers in the world, then a seemingly remarkable number given that, just two decades earlier, there were only two, the ones built secretly here and in England during World War II.v<\/sup><\/p>\n<\/div><\/div>\n\n\n\n The possibilities of a computerized \u201cworld brain\u201d were clear to the prescient Professor Licklider, and he knew that it would be much more than a mere electronic \u201clibrary,\u201d that it would be an information system. He also wrote that it wouldn\u2019t be possible without radical technological progress, including new inventions.vi<\/sup><\/p>\n\n\n\n He was right. It turned out to be far easier and cheaper to put a dozen men on the moon, than to build an information infrastructure connecting, in real time, billions of people on earth. But now, global Cloud-centric information services businesses are approaching $1 trillion a year,vii<\/sup> built on tens of trillions of dollars of hardware, providing an entirely new classes of commerce, much more than libraries of cat videos or AI-created \u201cdeep fakes\u201d for fun (and malicious meddling). At the core of that infrastructure are the massive data centers\u2014the thousands of \u201cwarehouse-scale\u201d computers, each<\/em> consuming more power than a steel mill. For students of the history of technology forecasting, none of the futurists of only a few decades ago anticipated the nature and scale of today\u2019s Cloud infrastructure.<\/p>\n\n\n\n One thing that can be forecast today is that we\u2019re at the end of the beginning, not the beginning of the end, of building it all out. Since the Cloud is an energy-using, not energy-producing infrastructure, the implications are consequential. The future will see far more, and far bigger, data centers\u2014the digital cathedrals of our time.<\/p>\n\n\n\n The world\u2019s first modern data center was built in 1996 by Exodus Communications in Santa Clara, California, a half-century after the first computer centers. The Exodus facility was a 15,000-square-foot building dedicated to housing the silicon hardware for myriad Internet Service Providers (ISPs).viii<\/sup> By coincidence, that year also witnessed a massive power blackout over seven western states, shutting down everything including already internet-centric businesses and services. That is, except for those ISPs that had equipment housed in the Exodus data center, which remained online with its backup power system, enshrining one of the key benefits and design features of data centers.ix<\/sup><\/p>\n\n\n\n The term \u201cdata center\u201d is an anemic one, failing to telegraph the nature and scale of how those mammoth facilities have evolved. It\u2019s a little like calling a supertanker a boat. The data center term evolved naturally from the early days of computing, when buildings had rooms called computer centers in which banks, universities and some companies placed mainframes. But when it comes to the physical realities of scale, including energy use, there is a world of difference between a shopping center and a skyscraper. So too data centers, more aptly skyscraper-class energy demands are, in commerce terms, the digital cathedrals of our time.<\/p>\n\n\n\n Civilization now fabricates more than 10,000 times more transistors annually than the combined number of grains of wheat and rice grown on the planet.<\/em><\/p><\/blockquote>\n\n\n\n <\/p>\n<\/div><\/div>\n\n\n\n In 1913, the world witnessed the completion of the world\u2019s first skyscraper, the 792-foot-tall Woolworth building, then the world\u2019s tallest habitable structure. It had taken 600 years to best the 524-foot tower of England s Lincoln Cathedral (completed in 1311). Public awe wasn\u2019t only inspired by the height but also about the technologies\u2014electricity, elevators, engines\u2014that made it possible in the first place, and in particular the commercial implications of such structures. Hence, in 1913, The New York Times enthusiastically declared that building a \u201ccathedral of commerce.\u201dx<\/sup><\/p>\n\n\n\n In the three decades since the Exodus data center, the expansion and networking of digital cathedrals has led to the creation of an entirely new, and now essential infrastructure, the Cloud. It is an infrastructure that, even more so than in 1996, must be insulated from the vicissitudes of the (un)reliability of public power grids. But unlike skyscrapers, digital cathedrals are essentially invisible in daily life. That may help explain how easy it is to believe a popular trope that the digital revolution somehow promises a kind of dematerialization of our economy\u2014that the magic of cyberspace, or instantaneous banking and advice (from mapping to shopping), has de-linked economic growth from hardware and energy use. It has not.<\/p>\n\n\n\n Just as skyscrapers grew in scale and proliferated in number, so too have data centers, but only far more so. There are more than 5,000 enterprise-class data centers in the world now, compared to 1,500 \u201centerprise-class\u201d skyscrapers that is, Woolworth-sized and bigger (in square feet).xi <\/sup>Smaller data centers number some 10 million.xii<\/sup><\/p>\n\n\n\n In the U.S., the square footage of data centers\u2014under construction or planned for the next few years\u2014is greater than the entire existing inventory. Today\u2019s typical digital cathedrals is bigger by some tenfold, or more (in square feet) than those of three decades back. And each square foot of data center inhales 100 times more electricity than a square foot of a skyscraper.xiii<\/sup> The latter reality is intimately tied to the rise in computing horsepower, a trend that AI accelerated.<\/p>\n\n\n\n Because the Cloud is an information infrastructure, instead of square feet, one could count its growth and scale in terms of the metric of data traffic, the bytes created, moved and processed. Today, a few days of digital traffic is greater than the annual traffic of just 15 years ago. And the growth hasn\u2019t slowed; indeed, with AI, the appetite for and use of bytes has accelerated data traffic in a way that\u2019s impossible for the physical traffic of humans and automobiles. That unprecedented reality has implications when it comes to forecasting energy consumption.<\/p>\n<\/div><\/div>\n\n\n\n The energy cost to move one byte is miniscule and still shrinking, but there is an astronomical quantity of bytes. And the creation, transport and storage of bytes\u2014that is, their physical and energy costs\u2014rests with the power-using transistors that create, store and move bytes. Civilization now fabricates more than 10,000 times more transistors annually than the combined number of grains<\/em> of wheat and rice grown on the planet.xiv<\/sup><\/p>\n\n\n\n The nature of the Cloud s energy appetite is far different from that of many other infrastructures, especially transportation. For the latter, consumers literally see where 90 percent of energy is spent when they fill up their gas tank. (The other 10 percent or so is consumed in producing the hardware in the first place.) When it comes to smartphones or desktops, more than 90 percent of energy is spent remotely hidden, so to speak, in the electron-inhaling, digital cathedrals and in the sprawling information superhighways.<\/p>\n\n\n\n The physics of transporting bits leads to a surprising fact: An hour of video using the Cloud infrastructure uses more energy than a single person\u2019s share of fuel consumed on a 10-mile bus ride.xv <\/sup>That leads, at best, to a tiny net energy reduction if someone Zooms instead of commutes in a bus, and a net increase if a student, say, Zooms instead of walking or bicycling to class. But the fact is there are exponentially more uses for Zoom and all forms of software services, than for replacing older energy-using alternatives.<\/p>\n\n\n\n Apps\u2014application-specific programs\u2014provide a window on the appetite for software services. The power of apps resides in the fact that an easy-to-use interface (on a smartphone) taps into, seamlessly and invisibly, the Promethean compute power of remote data centers to provide all manner of services and advice that have become a staple of everyday life for billions of people. There are already millions of apps competing to meet consumer and business needs and desires. Those services, in every sector of the economy, are what collectively drive the scale of data centers that aren\u2019t just measured in bytes or square feet, but now more commonly in megawatts and even gigawatts. Hidden from sight within each<\/em> of the thousands of nondescript digital cathedrals, there are thousands of refrigerator-sized racks of silicon machines, the physical core of the Cloud. Each<\/em> such rack burns more electricity annually than do 50 Teslas.<\/p>\n\n\n\n The global information infrastructure has grown from non-existent several decades ago to one now using twice as much electricity as the entire country of Japan. And that\u2019s a stale estimate based on the state of hardware and traffic of several years ago. Some analysts claim that as digital traffic has soared in recent years, efficiency gains have muted or even flattened growth in data center energy use.xvi<\/sup> But such claims face countervailing factual trends. Over the past decade, there\u2019s been a dramatic acceleration in data-center spending on hardware and a huge jump in the power density of that hardware, not least now with the advent of widely useful but energy-hungry AI.<\/p>\n\n\n\n How much more power the Cloud infrastructure will demand depends on just how fast innovators innovate new uses and services that consumers and business want. The odds are the pace of that trend will exceed the pace of efficiency gains in the underlying silicon hardware. The history of the entire century of computing and communications shows that demand for bytes has grown far faster than engineers can improve efficiency. There\u2019s no evidence to suggest this will change, especially now with the proliferation of AI, the most data-hungry and power intensive-use of silicon yet invented.xvii<\/sup><\/p>\n\n\n\n As with all energy-intensive industries of every kind, ultimately any such business will seek to locate to paraphrase the great Walter Wriston\u2019s aphorism about capital\u2014\u201cwhere it\u2019s welcome and stays where it\u2019s well- treated.\u201d For data centers, that translates into sufficient power, and soon, that\u2019s both reliable and cheap enough. Thus, we should expect to see the rising attractiveness of those great shale basins, from Texas to North Dakota, where the on-site surplus of natural gas can be rapidly translated into a surplus of digital power. \u25c9<\/p>\n\n\n\n <\/p>\n","protected":false},"excerpt":{"rendered":" The year 2024 will go down as the pivot when the growth in U.S. electricity demand reverted to normal. After a two-decade interregnum of no growth, many forecasters, including those […]<\/p>\n","protected":false},"author":127,"featured_media":2053,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[21,280,4,225,870],"tags":[48,875,51,879,876,880,883,878,871,873,884,881,874,885,872,882,877],"_links":{"self":[{"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/posts\/2049"}],"collection":[{"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/users\/127"}],"replies":[{"embeddable":true,"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/comments?post=2049"}],"version-history":[{"count":3,"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/posts\/2049\/revisions"}],"predecessor-version":[{"id":2105,"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/posts\/2049\/revisions\/2105"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/media\/2053"}],"wp:attachment":[{"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/media?parent=2049"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/categories?post=2049"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dda.ndus.edu\/ddreview\/wp-json\/wp\/v2\/tags?post=2049"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}![\"\"](\"https:\/\/dda.ndus.edu\/ddreview\/wp-content\/uploads\/sites\/18\/2024\/10\/World-Brain-cover-725x1024.jpg\")
<\/figure>\u201cWorld Brain\u201d<\/span><\/strong><\/h2>\n\n\n\n
Data Centers as Digital Cathedrals<\/span><\/strong><\/h2>\n\n\n\n
![\"\"](\"https:\/\/dda.ndus.edu\/ddreview\/wp-content\/uploads\/sites\/18\/2024\/10\/Rice-Grains-Bowl-1024x682.jpg\")
<\/figure>![\"\"](\"https:\/\/dda.ndus.edu\/ddreview\/wp-content\/uploads\/sites\/18\/2024\/10\/View_of_Woolworth_Building_fixed_crop-703x1024.jpg\")
<\/figure>Energizing the Infrastructure<\/strong><\/span><\/h2>\n\n\n\n
Back to the Future Normal<\/strong><\/span><\/h2>\n\n\n\n
![\"\"](\"https:\/\/dda.ndus.edu\/ddreview\/wp-content\/uploads\/sites\/18\/2024\/10\/switch-gallery-00-1024x460.jpg\")
REFERENCES<\/strong><\/h2>\n\n\n\n
i<\/sup> https:\/\/oilprice.com\/Energy\/Energy-General\/Can-AI-Derail-the-Energy-Transition.html<\/a>\n ii<\/sup> https:\/\/dda.ndus.edu\/ddreview\/ais-energy-appetite-voracious-efficient\/<\/a>\n iii<\/sup> https:\/\/www.goldmansachs.com\/insights\/articles\/AI-poised-to-drive-160- increase-in-power-demand<\/a>\n iv<\/sup> https:\/\/www.govtech.com\/computing\/north-dakota-prepares-for-data- centers-to-come-online<\/a>\n v<\/sup> \u201cComputer History for 1960.\u201d Computer Hope, November 30, 2020. https:\/\/www.computerhope.com\/history\/1960.\n vi<\/sup> Licklider, J.C. Libraries of the Future<\/em>. Cambridge, Mass.: M.I.T. Press, 1965.\n vii<\/sup> https:\/\/www.idc.com\/getdoc.jsp?containerId=prUS52343224<\/a>\n viii<\/sup> Mitra, Sramana. \u201cAnatomy of Innovation: Exodus Founder B.V. Jagadeesh (Part 1).\u201d October 18, 2008. https:\/\/www.sramanamitra.com\/2008\/10\/13\/entrepreneurship-and-leadership-through-innovation-3leaf-ceo-bv-jagadeesh- part-1\/.\n ix<\/sup> Mitra, Sramana. \u201cAnatomy of Innovation: Exodus Founder B.V. Jagadeesh (Part 1).\u201d October 18, 2008. https:\/\/www.sramanamitra.com\/2008\/10\/13\/entrepreneurship-and-leadership-through-innovation-3leaf-ceo-bv-jagadeesh- part-1\/<\/a>.\n x<\/sup> Sutton, Philip. \u201cThe Woolworth Building: The Cathedral of Commerce.\u201d The New York Public Library, April 23, 2013. https:\/\/www.nypl.org\/ blog\/2013\/04\/22\/woolworth-building-cathedral-commerce<\/a>.\n xi <\/sup>https:\/\/data-economy.com\/data-centers-going-green-to-reduce-a-carbon- footprint-larger-than-the-airline-industry\/<\/a> https:\/\/www.skyscrapercenter.com\/ countries<\/a>\n xii<\/sup> https:\/\/www.statista.com\/statistics\/500458\/worldwide-data center-and-it- sites\/<\/a>\n xiii<\/sup> \u201cData Center Power Series 4\u2014Watts per Square Foot.\u201d Silverback Data Center Solutions, November 15, 2020. https:\/\/teamsilverback.com\/knowledge- base\/data-center-power-series-4-watts-per-square-foot\/<\/a>. Gould, Scott. Plug and Process Loads Capacity and Power Requirements Analysis. NREL, September 2014. http:\/\/www.nrel.gov\/docs\/fy14osti\/60266.pdf<\/a>.\n xiv<\/sup> Author calculation: credit for the idea of comparing transistors produced to grains grown belongs to: Hayes, Brian, \u201cThe Memristor,\u201d American Scientist, March-April 2011.\n Annual transistor production from: Hutcheson, \u201cGraphic: Transistor Production Has Reached Astronomical Scales,\u201d IEEE Spectrum, April 2, 2015.\n xv<\/sup> \u201cDoes online video streaming harm the environment?\u201d Accessed April 7, 2021. https:\/\/www.saveonenergy.com\/uk\/does-online-video-streaming-harm-the-environment\/<\/a>.\n xvi<\/sup> Jones, Nicola. \u201cHow to Stop Data Centers from Gobbling up the World\u2019s Electricity.\u201d Nature. September 12, 2018. https:\/\/www.nature.com\/articles\/ d41586-018-06610-y%20<\/a>.\n xvii<\/sup> Hao, Karen. \u201cThe Computing Power Needed to Train AI Is Now Rising Seven Times Faster than Ever Before.\u201d MIT Technology Review, April 2, 2020. https:\/\/www.technologyreview.com\/2019\/11\/11\/132004\/the-computing- power-needed-to-train-ai-is-now-rising-seven-times-faster-than-ever-before\/<\/a>. <\/pre>\n\n\n\n