SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts

no code implementations • 13 May 2024 • Raghu Prabhakar, Ram Sivaramakrishnan, Darshan Gandhi, Yun Du, Mingran Wang, XiangYu Song, Kejie Zhang, Tianren Gao, Angela Wang, Karen Li, Yongning Sheng, Joshua Brot, Denis Sokolov, Apurv Vivek, Calvin Leung, Arjun Sabnis, Jiayu Bai, Tuowen Zhao, Mark Gottscho, David Jackson, Mark Luttrell, Manish K. Shah, Edison Chen, Kaizhao Liang, Swayambhoo Jain, Urmish Thakker, Dawei Huang, Sumti Jairath, Kevin J. Brown, Kunle Olukotun

In this paper, we describe how combining CoE, streaming dataflow, and a three-tier memory system scales the AI memory wall.

Evaluation of a Recommender System for Assisting Novice Game Designers

no code implementations • 13 Aug 2019 • Tiago Machado, Daniel Gopstein, Oded Nov, Angela Wang, Andy Nealen, Julian Togelius

Game development is a complex task involving multiple disciplines and technologies.

Game Design Recommendation Systems

Evaluating Word Embedding Models: Methods and Experimental Results

no code implementations • 28 Jan 2019 • Bin Wang, Angela Wang, Fenxiao Chen, Yuncheng Wang, C. -C. Jay Kuo

Extensive evaluation on a large number of word embedding models for language processing applications is conducted in this work.

Word Embeddings

Post-Processing of Word Representations via Variance Normalization and Dynamic Embedding

1 code implementation • 20 Aug 2018 • Bin Wang, Fenxiao Chen, Angela Wang, C. -C. Jay Kuo

Although embedded vector representations of words offer impressive performance on many natural language processing (NLP) applications, the information of ordered input sequences is lost to some extent if only context-based samples are used in the training.