Exploring Neuron Interactions and Emergence in LLMs: From the Multifractal Analysis Perspective

1 code implementation • 14 Feb 2024 • Xiongye Xiao, Chenyu Zhou, Heng Ping, Defu Cao, Yaxing Li, Yizhuo Zhou, Shixuan Li, Paul Bogdan

Prior studies on the emergence in large models have primarily focused on how the functional capabilities of large language models (LLMs) scale with model size.

Towards Overcoming False Positives in Visual Relationship Detection

no code implementations • 23 Dec 2020 • Daisheng Jin, Xiao Ma, Chongzhi Zhang, Yizhuo Zhou, Jiashu Tao, Mingyuan Zhang, Haiyu Zhao, Shuai Yi, Zhoujun Li, Xianglong Liu, Hongsheng Li

We observe that during training, the relationship proposal distribution is highly imbalanced: most of the negative relationship proposals are easy to identify, e. g., the inaccurate object detection, which leads to the under-fitting of low-frequency difficult proposals.

Graph Attention Human-Object Interaction Detection +4