Search Results for author:
Found 4 papers, 2 papers with code
AquilaMoE: Efficient Training for MoE Models with Scale-Up and Scale-Out Strategies
In this paper, we present AquilaMoE, a cutting-edge bilingual 8*16B Mixture of Experts (MoE) language model that has 8 experts with 16 billion parameters each and is developed using an innovative training methodology called EfficientScale.
Video Infringement Detection via Feature Disentanglement and Mutual Information Maximization
We theoretically analyzed the mutual information between the label and the disentangled features, arriving at a loss that maximizes the extraction of task-relevant information from the original feature.
Linear Discriminant Analysis with High-dimensional Mixed Variables
Datasets containing both categorical and continuous variables are frequently encountered in many areas, and with the rapid development of modern measurement technologies, the dimensions of these variables can be very high.
Residential Floor Plan Recognition and Reconstruction
Recognition and reconstruction of residential floor plan drawings are important and challenging in design, decoration, and architectural remodeling fields.
