Dealing with the memory problem in artificial intelligence

admin pypqskzmbfie , , , , , , ,

first_imgArtificial Intelligence (AI), which allows computers to learn and perform specific tasks such as image recognition and natural language processing, is loosely inspired by the human brain.The challenge is that while the human brain has evolved over the last 3 million years, Artificial Neural Networks, the very “brain” of AI, which have only been around for a few decades and aren’t nearly as finely tuned or as sophisticated as the gray matter in our heads, are expected to perform tasks associated with human intelligence. So in our quest to create AI systems that can benefit society — in areas from image classification to voice recognition and autonomous driving — we need to find new paths to speed up the evolution of AI.Part of this process is figuring out what types of memory work best for specific AI functions and discovering the best ways to integrate various memory solutions together. From this standpoint, AI faces two main memory limitations: density and power efficiency. AI’s need for power makes it difficult to scale AI outside of datacenters where power is readily available — particularly to the edge of the cloud where AI applications have the highest potential and value.To enable AI at the edge, developments are being made toward domain-specific architectures that facilitate energy-efficient hardware. However, the area that will open the way for the most dramatic improvements, and where a large amount of effort should be concentrated, is the memory technology itself.Driving AI to the Edge Over the last half-century, a combination of public and private interest has fueled the emergence of AI and, most recently, the advent of Deep Learning (DL). DL models have — due to the exceptional perception capabilities they offer — become one of the most widespread forms of AI. A typical DL model must first be trained on massive datasets (typically on GPU servers in datacenters) to tune the network parameters, an expensive and lengthy process, before it can be deployed to make its own inferences based on input data (from sensors, cameras, etc.). DL models require such massive amounts of memory to train their many parameters that it becomes necessary to utilize off-chip memory. Hence, much of the energy cost during training is incurred because of the inefficient shuffling of gigantic data loads between off-chip DRAM and on-chip SRAM (an approach that often exceeds 50% of the total energy use). Once the model is trained, the trained network parameters must be made available to perform inference tasks in other environments.Until recently AI applications had been confined to datacenters because of their large energy consumption and space requirements. However, over the past few years the growing demand for AI models at high scale, low latency and low cost has been pushing these applications to be run at the edge, namely in IoT and on mobile devices where power and performance are highly constrained.This is driving a rapidly expanding hardware ecosystem that supports edge applications for inference tasks and even a nascent effort at enabling distributed training (e.g., Google’s Federated Learning models). These new architectures are primarily driven by speech recognition and image classification applications.The growing demand combined with the increasing complexity of DL models is unsustainable in that it is causing a widening gap between what companies require in terms of energy dissipation, latency and size, and what current memory is capable of achieving. With the end of Moore’s Law and Dennard Scaling in the rear-view mirror exacerbating the issue, the semiconductor industry needs to diversify toward new memory technologies to address this paradigm shift and fulfill the demand for cheap, efficient AI hardware.The Opportunity for New Memories The AI landscape is a fertile ground for innovative memories with unique and improving characteristics and presents opportunities in both the datacenter and at the edge. New memory technologies can meet the demand for memory that will allow edge devices to perform DL tasks locally by both increasing the memory density and improving data access patterns, so that the need for transferring data to and from the cloud is minimized. The ability to perform perception tasks locally, with high accuracy and energy efficiency is key to the further advancement of AI.This realization has led to significant investment in alternative memory technologies, including NAND flash, 3D XPoint (Intel’s Optane), Phase-Change Memory (PCM), Resistive Memory (ReRAM), Magneto-Resistive Memory (MRAM) and others that offer benefits such as energy efficiency, endurance and non-volatility. While facilitating AI at the edge, such memories may also allow cloud environments to perform DL model training and inference more efficiently. Additional benefits include the potential improvements in reliability and processing speed. These improvements in the memory technology will make it possible to circumvent the current hardware limitations of devices at the edge.In particular, certain new memories offer distinct benefits due to specific inherent or unique qualities of the technology for a number of AI applications. ReRAM and PCM offer advantages for inference applications due to their superior speed (compared to Flash), density and non-volatility. MRAM offers similar advantages to ReRAM and PCM; furthermore, it exhibits ultra-high endurance such that it can compete with and complement SRAM as well as function as Flash replacement. Even at these early stages of their lifetime, these new memory technologies show enormous potential in the field of AI.And although we are still decades away from implementing the AI we’ve been promised in science fiction, we are presently on the cusp of significant breakthroughs that will affect many aspects of our lives and provide new efficient business models. As Rockwell Anyoha writes in a Harvard special edition blog on AI, “In the first half of the 20th century, science fiction familiarized the world with the concept of artificially intelligent robots. It began with the ‘heartless’ Tin Man from the Wizard of Oz and continued with the humanoid robot that impersonated Maria in Metropolis.”The next competitive battle is being fought in memory, and as a result, there is a tremendous amount of time, money and brain power being dedicated to figuring out how to fix AI’s memory problem. Ultimately, while these computerized brains don’t yet hold a candle to our human brains — especially pertaining to energy efficiency — it is that very uniqueness of our own minds that enables our capacity to create solutions to our many fantasies and bring artificial intelligence to life.— Andrew Walker is vice president of product at Spin Memory (formerly Spin Transfer Technologies). >> This article was originally published on our sister site, EE Times:”AI’s Memory Problem.” Share this:TwitterFacebookLinkedInMoreRedditTumblrPinterestWhatsAppSkypePocketTelegram Tags: Advanced Technology Continue Reading Previous Seven design challenges for ultrasound smart probesNext A logical method of debugging embedded systemscenter_img Leave a Reply Cancel reply You must Register or Login to post a comment. This site uses Akismet to reduce spam. Learn how your comment data is processed.last_img

You May Also Like..

UAAP: UP barges into top 4 after stunning FEU

first_imgView comments Carpio hits red carpet treatment for China Coast Guard PLAY LIST 02:14Carpio hits red carpet treatment for China Coast Guard02:56NCRPO pledges to donate P3.5 million to victims of Taal eruption00:56Heavy rain brings some relief in Australia02:37Calm moments allow Taal folks some respite03:23Negosyo sa Tagaytay City, bagsak sa pag-aalboroto ng Bulkang Taal01:13Christian Standhardinger wins PBA Best Player award Tim Cone, Ginebra set their sights on elusive All-Filipino crown LATEST STORIES Sports Related Videospowered by AdSparcRead Next Gretchen Barretto’s daughter Dominique graduates magna cum laude from California college Will you be the first P16 Billion Powerball jackpot winner from the Philippines? Lights inside SMX hall flicker as Duterte rants vs Ayala, Pangilinan anew University of the Philippines rallied its way to a share of the no. 4 spot after tripping Far Eastern University, 95-82, in the UAAP Season 81 men’s basketball tournament Wednesday at Smart Araneta Coliseum. ADVERTISEMENT Gov’t to employ 6,000 displaced by Taal Allen Durham still determined to help Meralco win 1st PBA titlecenter_img Japeth Aguilar embraces role, gets rewarded with Finals MVP plum Don’t miss out on the latest news and information. MOST READ The Fighting Maroons now share the fourth seed with the Tamaraws with both teams getting a 5-5 record. UP raced to a 15-2 run in the second quarter and built a 54-39 lead with 1:34 left in the half. FEATURED STORIESSPORTSGinebra beats Meralco again to capture PBA Governors’ Cup titleSPORTSJapeth Aguilar wins 1st PBA Finals MVP award for GinebraSPORTSGolden State Warriors sign Lee to multiyear contract, bring back ChrissThat 15-point lead was enough foundation for the Maroons as they notched their second straight win. Paul Desiderio lit up for 31 points with four assists and two steals to lead UP while Bright Akhuetie had 20 points, 11 rebounds, seven assists, and two blocks.  Nadine Lustre’s phone stolen in Brazil Juan Gomez De Liaño missed out on a second triple-double with 19 points, 10 rebounds, and nine assists. Barkley Eboña had 13 points and eight rebounds for the Tamaraws.  NU women’s basketball team stretches win streak to 73 games For the complete collegiate sports coverage including scores, schedules and stories, visit Inquirer Varsity. Lights inside SMX hall flicker as Duterte rants vs Ayala, Pangilinan anewlast_img

UN, AU, Others Want Anti-Domestic Violence, Affirmative Action Bills Approved

first_imgPartial view of women in the Mock Parliament of the Women Legislative Caucus of Liberia -Women Groups Grace ‘Mock Legislature’The United Nations (UN), African Union (AU), Swedish Embassy and Local Civil Society Organizations (CSOs) have requested the Liberian Senate and the House of Representatives to approve the Anti-Domestic and Affirmative Bills.The international organizations made the call yesterday in the Joint Chambers of the Legislature during a program marking the ‘Mock Session of Parliament’ of the Women Legislative Caucus of Liberia. The Program was supported by UN Women.The UN Resident Coordinator and Representative of the United Nations Development Program in Liberia Yacoub El Hillo urged the Liberian Senate and the House of Representatives to continue to lead in the global scene by making history and approve the Anti-Domestic and Affirmative Bills.Mr. Hillo said as of 1970, Liberia made the first history, with Madam Angie E. Brooks being the first and only African female President of the United Nations General Assembly. He said in 2005, Liberia made another history with the election of the first elected female President in Africa.“We believe Liberia can also make history again and pass this Anti-Domestic Violence and Affirmative Bills,” Mr. Hillo said.He added that the Sustainable Development Goals (SDGs), which were created and piloted by Liberia, is being emulated by many other countries.UN Women Representative Madam Goreth Nizigama said the passage of the Domestic Violence Bill and Affirmative Action Bill will bring diversity and other comparative advantages that are required in leadership and governance.Madam Nizigama said evidence shows gender inequalities remain intertwined to poverty and impoverishment.“For example, according to the 2016 Human Development Report, of 188 countries assessed, Liberia ranks 177 on the Gender Inequality Index; Rwanda ranks 84, while Senegal ranks 120,” Madam Nizigama said.“It’s no gainsaying, we are trailing these sister countries on development and it will be good for all of us if we match up and I daresay pass them,” she added.For his part, AU Political Officer Prosper Addo said the Affirmative Action Bill will be a “good thing” for Liberia to enable the women, people living with disability and the youth to have shared in governance and it should not be a hindrance in legalizing laws against domestic violence.Swedish Ambassador to Liberia Madam Ingrid Wittersqvist said the Swedish Government will remain supportive of programs that would promote the equality of women and was proud to form part of a forum to encourage the lawmakers to approve the Domestic Violence Bill and the Affirmative Action Bills.Women in Peace Building Network and other advocacy groups of the youth, women, and people living with disabilities were in attendance.During the Mock Session of the Parliament of the Women Legislative Caucus of Liberia, Rep. Samuel Kogar served as the Mock Speaker, while 10 Representatives and Senators served as the Mock Parliament. They were the pro and con during discussions of the Anti-Domestic Violence and Affirmative Action Bills.The lawmakers included Rep. Rosana Schaack, the President of Women Legislative Caucus of Liberia, Sen. Peter Coleman, Rep. Moima Briggs-Mensah, Rep. Ellen Attoh, Rep. Rustonlyn Dennis, Rep. Matthew Zarzar, Rep. Francis Doepoh, Rep. Julie Wiah, Rep. Tibelrosa Tarponweh and Rep. Gunpue Kargon.Those for the con said the Affirmative Action Bill contravenes the Constitution and does not seek to represent the interest of a vast majority of Liberians, while others said the Bill, if approved, will help to empower women, youths and people living with disabilities in the House of Representatives.The Affirmative Action Bill has undergone five attempts to get gender equality legislation at the different levels of the political process.Partial view of women in the Mock Parliament of the Women Legislative Caucus of LiberiaIn 2005 there was an attempt to revise the Electoral Law; in 2009, it was under the caption of a Fairness Bill; in 2010 it was the Gender Parity Bill; in 2013, it was an Act to amend the elections law of Liberia; in 2014, it was included in the Constitution Review Process and known as the “Women’s minimum agenda for constitutional review; and in the latest attempt it is called the Equal Participation and Representation Bill of 2016 which is part of the Affirmative Action Bill.The Bill, among others, seeks to set aside 21 Legislative seats for women, youths and people with disabilities in addition to the existing 73 seats.On the Domestic Violence Bill, it has also been a long haul. Currently, Executive Order 92, which has been issued by former President Ellen Johnson-Sirleaf on the eve of her departure, President George M. Weah is committed to passing into law as proclaimed during the European Development Days in Brussels.Share this:Click to share on Twitter (Opens in new window)Click to share on Facebook (Opens in new window) – Advertisement –last_img

Pipeline bombings evidence of larger discontent, author says

first_img Boras also says that EnCana pipelines have automatic emergency shutoff valves at regular intervals of the pipeline, which prevent a large amount of gas from being released if a leak does occur.For more on this story, check out these stories from Energeticcity.caPipeline bombings evidence of larger discontent, author saysAdvertisement RCMP already has suspects in pipeline bombingEnCana says residents not endangered by gas leak after bomb blastAdditional Information: Both bombings attacked the same pipeline; Map & PhotoPolice not linking explosion to terrorismExplosive detonated on Encana Pipeline The author of a book about the saga of Wiebo Ludwig says he’s not surprised that this week’s pipeline bombings have been directed specifically at sour gas. Andrew Nikiforuk says there is an extreme level of tension between sour gas developers, residents and first nations groups in the area due to issues surrounding safety and regulation. He says that many residents and First Nations living near oil and gas development also resent the reduction in property values and the constant threat of a potentially life-threatening leak or accident. – Advertisement – [asset|aid=450|format=mp3player|formatter=asset_bonus|title=e44909f40aa9a4e7bb16429e8dc151bb-Nikkiforuk-1_1_Pub.mp3] However, Alan Boras, spokesperson for EnCana, says that the risk of danger to residents from nearby pipelines is minimal. [asset|aid=451|format=mp3player|formatter=asset_bonus|title=e44909f40aa9a4e7bb16429e8dc151bb-Boras-1_1_Pub.mp3] Advertisementlast_img

Leave a Reply

Your email address will not be published. Required fields are marked *