Search Results for author: De Wang

Found 6 papers, 4 papers with code

The Super Weight in Large Language Models

1 code implementation11 Nov 2024 Mengxia Yu, De Wang, Qi Shan, Colorado Reed, Alvin Wan

For weight quantization, we similarly find that by preserving the super weight and clipping other weight outliers, round-to-nearest quantization can scale to much larger block sizes than previously considered.

Language Modeling Language Modelling +2

On Inductive Biases That Enable Generalization of Diffusion Transformers

1 code implementation28 Oct 2024 Jie An, De Wang, Pengsheng Guo, Jiebo Luo, Alexander Schwing

Furthermore, we empirically find that both the placement and the effective attention size of these local attention windows are crucial factors.

Denoising Inductive Bias

Towards in-store multi-person tracking using head detection and track heatmaps

1 code implementation16 May 2020 Aibek Musaev, Jiangping Wang, Liang Zhu, Cheng Li, Yi Chen, Jialin Liu, Wanqi Zhang, Juan Mei, De Wang

In addition, we describe an illustrative example of the use of this dataset for tracking participants based on a head tracking model in an effort to minimize errors due to occlusion.

Head Detection

Argoverse: 3D Tracking and Forecasting with Rich Maps

3 code implementations CVPR 2019 Ming-Fang Chang, John Lambert, Patsorn Sangkloy, Jagjeet Singh, Slawomir Bak, Andrew Hartnett, De Wang, Peter Carr, Simon Lucey, Deva Ramanan, James Hays

In our baseline experiments, we illustrate how detailed map information such as lane direction, driveable area, and ground height improves the accuracy of 3D object tracking and motion forecasting.

3D Object Tracking Autonomous Vehicles +3

Inexact Proximal Gradient Methods for Non-convex and Non-smooth Optimization

no code implementations18 Dec 2016 Bin Gu, De Wang, Zhouyuan Huo, Heng Huang

The theoretical results show that our inexact proximal gradient algorithms can have the same convergence rates as the ones of exact proximal gradient algorithms in the non-convex setting.

BIG-bench Machine Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.