Search Results for author:
Found 29 papers, 14 papers with code
DATAP-SfM: Dynamic-Aware Tracking Any Point for Robust Structure from Motion in the Wild
To tackle these challenges, we propose a dynamic-aware tracking any point (DATAP) method that leverages consistent video depth and point tracking.
Knowledge-Guided Prompt Learning for Request Quality Assurance in Public Code Review
Public Code Review (PCR) is an assistant to the internal code review of the development team, in the form of a public Software Question Answering (SQA) community, to help developers access high-quality and efficient review services.
Correlating Time Series with Interpretable Convolutional Kernels
This study addresses the problem of convolutional kernel learning in univariate, multivariate, and multidimensional time series data, which is crucial for interpreting temporal patterns in time series and supporting downstream machine learning tasks.
VideoVista: A Versatile Benchmark for Video Understanding and Reasoning
Through a comprehensive and quantitative evaluation of cutting-edge models, we reveal that: 1) Video-LMMs face difficulties in fine-grained video tasks involving temporal location, object tracking, and anomaly detection; 2) Video-LMMs present inferior logical and relation reasoning abilities; 3) Open-source Video-LMMs' performance is significantly lower than GPT-4o and Gemini-1. 5, lagging by 20 points.
On Unified Prompt Tuning for Request Quality Assurance in Public Code Review
Public Code Review (PCR) can be implemented through a Software Question Answering (SQA) community, which facilitates high knowledge dissemination.
LLMs Meet Long Video: Advancing Long Video Question Answering with An Interactive Visual Adapter in LLMs
Long video understanding is a significant and ongoing challenge in the intersection of multimedia and artificial intelligence.
Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment
Evaluating and Rethinking the current landscape of Large Multimodal Models (LMMs), we observe that widely-used visual-language projection approaches (e. g., Q-former or MLP) focus on the alignment of image-text descriptions yet ignore the visual knowledge-dimension alignment, i. e., connecting visuals to their relevant knowledge.
A Comprehensive Evaluation of GPT-4V on Knowledge-Intensive Visual Question Answering
The emergence of multimodal large models (MLMs) has significantly advanced the field of visual understanding, offering remarkable capabilities in the realm of visual question answering (VQA).
Understanding Deep Neural Networks via Linear Separability of Hidden Layers
In this paper, we measure the linear separability of hidden layer outputs to study the characteristics of deep neural networks.
Optimal Weighted Random Forests
The random forest (RF) algorithm has become a very popular prediction method for its great flexibility and promising accuracy.
A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues
This makes the language model well-suitable for such multi-modal reasoning scenario on joint textual and visual clues.
LMEye: An Interactive Perception Network for Large Language Models
LMEye addresses this issue by allowing the LLM to request the desired visual information aligned with various human instructions, which we term as the dynamic visual information interaction.
Laplacian Convolutional Representation for Traffic Time Series Imputation
In this study, we first introduce a Laplacian kernel to temporal regularization for characterizing local trends in traffic time series, which can be formulated as a circular convolution.
Discovering Dynamic Patterns from Spatiotemporal Data with Time-Varying Low-Rank Autoregression
In the temporal context, the complex time-varying system behaviors can be revealed by the temporal modes in the proposed model.
TCBERT: A Technical Report for Chinese Topic Classification BERT
Bidirectional Encoder Representations from Transformers or BERT~\cite{devlin-etal-2019-bert} has been one of the base models for various NLP tasks due to its remarkable performance.
POViT: Vision Transformer for Multi-objective Design and Characterization of Nanophotonic Devices
In this work, we propose the first-ever Transformer model (POViT) to efficiently design and simulate semiconductor photonic devices with multiple objectives.
NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results
The aim was to design a network for single image super-resolution that achieved improvement of efficiency measured according to several metrics including runtime, parameters, FLOPs, activations, and memory consumption while at least maintaining the PSNR of 29. 00dB on DIV2K validation set.
Nonstationary Temporal Matrix Factorization for Multivariate Time Series Forecasting
Modern time series datasets are often high-dimensional, incomplete/sparse, and nonstationary.
A Semi-Supervised Deep Clustering Pipeline for Mining Intentions From Texts
The clustering quality exceeds the state-of-the-art results when BERT is fine-tuned with labeled subsets of only 2. 5% of the task data.
An Adaptive Deep Clustering Pipeline to Inform Text Labeling at Scale
Mining the latent intentions from large volumes of natural language inputs is a key step to help data analysts design and refine Intelligent Virtual Assistants (IVAs) for customer service and sales support.
Ultralow complexity long short-term memory network for fiber nonlinearity mitigation in coherent optical communication systems
In this paper, we propose a center-oriented long short-term memory network (Co-LSTM) incorporating a simplified mode with a recycling mechanism in the equalization operation, which can mitigate fiber nonlinearity in coherent optical communication systems with ultralow complexity.
Low-Rank Autoregressive Tensor Completion for Spatiotemporal Traffic Data Imputation
In this paper, we propose a low-rank autoregressive tensor completion (LATC) framework by introducing \textit{temporal variation} as a new regularization term into the completion of a third-order (sensor $\times$ time of day $\times$ day) tensor.
Scalable Low-Rank Tensor Learning for Spatiotemporal Traffic Data Imputation
Recent studies based on tensor nuclear norm have demonstrated the superiority of tensor learning in imputation tasks by effectively characterizing the complex correlations/dependencies in spatiotemporal data.
Incremental Bayesian tensor learning for structural monitoring data imputation and response forecasting
To address this fundamental issue, this paper presents an incremental Bayesian tensor learning method for reconstruction of spatiotemporal missing data in SHM and forecasting of structural response.
Low-Rank Autoregressive Tensor Completion for Multivariate Time Series Forecasting
In this paper, we propose a low-rank autoregressive tensor completion (LATC) framework to model multivariate time series data.
A Nonconvex Low-Rank Tensor Completion Model for Spatiotemporal Traffic Data Imputation
Sparsity and missing data problems are very common in spatiotemporal traffic data collected from various sensing systems.
Bayesian Temporal Factorization for Multidimensional Time Series Prediction
In this paper, we propose a Bayesian temporal factorization (BTF) framework for modeling multidimensional time series -- in particular spatiotemporal data -- in the presence of missing values.
A Survey on Graph Processing Accelerators: Challenges and Opportunities
Graph is a well known data structure to represent the associated relationships in a variety of applications, e. g., data science and machine learning.
Distributed, Parallel, and Cluster Computing
In situ TensorView: In situ Visualization of Convolutional Neural Networks
We present in situ TensorView to visualize the training and functioning of CNNs as if they are systems of scientific simulations.
