Saturday, April 9, 2022

Why EleutherAI GPT-NeoX-20B Open-Source Language Model Matters


Natural language systems are important for many artificial intelligence use cases, ranging from chatbots, translations of  natural language into structured query language, application layouts and spreadsheets, and web search.

And one key to wider use of natural language machine learning is the availability of powerful open source tools. 

Up to this point, huge amounts of computer power and electrical power have been required to support natural language processing. EleuterAI's GPT-NeoX-20B removes that barrier for developers. 

Sunday, April 3, 2022

Metaverse Drives Edge Computing

As video content distribution has shaped global demand for inter-continental data transport and high-speed connections between major data centers, the metaverse will shape data center and connectivity network requirements. And the key words are “more” and “less.”


More bandwidth; less latency. More artificial intelligence; less centralized computing. More at the edtge; less in the core. More symmetrical bandwidth, less copper.


“Making the metaverse a reality will require significant advancements in network latency, symmetrical bandwidth and overall speed of networks,” says Dan Rabinovitsj, Meta VP for connectivity. 


The metaverse “will require innovations in fields like hybrid local and remote real-time rendering, video compression, edge computing, and cross-layer visibility, as well as spectrum advocacy, work on metaverse readiness of future connectivity and cellular standards, network optimizations, improved latency between devices and within radio access networks (RANs), and more,” he says. 


Already, experts predict Metaverse environments will require more data centers, more edge computing, more distributed computing, more collocation, more content distribution mechanisms, will require more power consumption and more cooling.


Eventually, fully-developed metaverses will require advances in chip technology as well. Beyond all that, blockchain will probably be necessary to support highly-decentralized value exchanges. And it is impossible to separate metaverse platforms and experiences from use of artificial intelligence, for business or consumer uses. 


source: iCapital Network 


If metaverses are built on persistent and immersive computing and tightly-integrated software stacks, platforms will be necessary. New developments in chip manufacturing also will be needed. 


For connectivity providers--especially internet service providers--far lower latency will be key. Today’s latency-sensitive applications such as video calling and cloud-based games have to meet a round-trip time latency of 75 milliseconds to 150 ms. Multi-player, complex games might require 30 ms latency. 


“A head-mounted mixed reality display, where graphics will have to be rendered on screen in response to where someone is focusing their eyes, things will need to move an order of magnitude faster: from single to low double digit ms,” says Rabinovitsj. 


Image rendering will require edge computing. “We envision a future where remote rendering over edge cloud, or some form of hybrid between local and remote rendering, plays a greater role,” he adds. “Enabling remote rendering will require both fixed and mobile networks to be rearchitected to create compute resources at a continuum of distances to end users.”


Bandwidth could increase by orders of magnitude over what is required to view 720p video on a standard smartphone screen. That might work with just 1.3 Mbps to 1.6 Mbps of downlink throughput. 


But a head-mounted display sitting just centimeters from the eyes required to display images at retina grade resolution will need to be many orders of magnitude larger, he notes. 


To be sure, most of what happens that is part of metaverse experiences rests on things that happen up the stack from computing and communications. 


source: Constellation Research


But we already can see how metaverse support will require changes in computing architecture and network capabilities.


MWC and AI Smartphones

Mobile World Congress was largely about artificial intelligence, hence largely about “AI” smartphones. Such devices are likely to pose issue...