Search Results for author:
Found 164 papers, 35 papers with code
A Meta-framework for Spatiotemporal Quantity Extraction from Text
News events are often associated with quantities (e. g., the number of COVID-19 patients or the number of arrests in a protest), and it is often important to extract their type, time, and location from unstructured text in order to analyze these quantity events.
Cold Start Problem For Automated Live Video Comments
These comments have become a determining factor in the popularity of the videos.
Fast Gradient Computation for Gromov-Wasserstein Distance
In this way, the original computational bottleneck is broken and the new entropic solution can be obtained with total quadratic time, which is almost optimal complexity.
DIBS: Enhancing Dense Video Captioning with Unlabeled Videos via Pseudo Boundary Enrichment and Online Refinement
We present Dive Into the BoundarieS (DIBS), a novel pretraining framework for dense video captioning (DVC), that elaborates on improving the quality of the generated event captions and their associated pseudo event boundaries from unlabeled videos.
SLFNet: Generating Semantic Logic Forms from Natural Language Using Semantic Probability Graphs
Building natural language interfaces typically uses a semantic parser to parse the user's natural language and convert it into structured \textbf{S}emantic \textbf{L}ogic \textbf{F}orms (SLFs).
VCR-Graphormer: A Mini-batch Graph Transformer via Virtual Connections
Therefore, mini-batch training for graph transformers is a promising direction, but limited samples in each mini-batch can not support effective dense attention to encode informative representations.
LUWA Dataset: Learning Lithic Use-Wear Analysis on Microscopic Images
Most importantly, the LUWA dataset provides an underexplored opportunity for vision and learning communities and complements existing image classification problems on common objects.
Spatio-Temporal Fluid Dynamics Modeling via Physical-Awareness and Parameter Diffusion Guidance
This paper proposes a two-stage framework named ST-PAD for spatio-temporal fluid dynamics modeling in the field of earth sciences, aiming to achieve high-precision simulation and prediction of fluid dynamics through spatio-temporal physics awareness and parameter diffusion guidance.
Speech-driven Personalized Gesture Synthetics: Harnessing Automatic Fuzzy Feature Inference
Finally, we employ the diffusion model to train and infer various gestures.
Learning Hierarchical Color Guidance for Depth Map Super-Resolution
On the one hand, the low-level detail embedding module is designed to supplement high-frequency color information of depth features in a residual mask manner at the low-level stages.
A Survey of Learned Indexes for the Multi-dimensional Space
We present a taxonomy that classifies and categorizes each learned multi-dimensional index, and survey the existing literature on learned multi-dimensional indexes according to this taxonomy.
DynST: Dynamic Sparse Training for Resource-Constrained Spatio-Temporal Forecasting
In this paper, we introduce for the first time the concept of spatio-temporal data dynamic sparse training and are committed to adaptively, dynamically filtering important sensor distributions.
CaT-GNN: Enhancing Credit Card Fraud Detection via Causal Temporal Graph Neural Networks
Credit card fraud poses a significant threat to the economy.
NeuralDiffuser: Controllable fMRI Reconstruction with Primary Visual Feature Guided Diffusion
Reconstructing visual stimuli from functional Magnetic Resonance Imaging (fMRI) based on Latent Diffusion Models (LDM) provides a fine-grained retrieval of the brain.
Modeling Spatio-temporal Dynamical Systems with Neural Discrete Learning and Levels-of-Experts
In this paper, we address the issue of modeling and estimating changes in the state of the spatio-temporal dynamical systems based on a sequence of observations like video frames.
Coronary CTA and Quantitative Cardiac CT Perfusion (CCTP) in Coronary Artery Disease
CCTA in conjunction with a new automated quantitative CCTP approach can augment the interpretation of CAD, enabling the distinction of ischemia due to obstructive lesions and MVD.
CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models
For each of these CRUD categories, we have developed comprehensive datasets to evaluate the performance of RAG systems.
PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathology
To address this, we introduce PathMMU, the largest and highest-quality expert-validated pathology benchmark for Large Multimodal Models (LMMs).
AI prediction of cardiovascular events using opportunistic epicardial adipose tissue assessments from CT calcium score
Background: Recent studies have used basic epicardial adipose tissue (EAT) assessments (e. g., volume and mean HU) to predict risk of atherosclerosis-related, major adverse cardiovascular events (MACE).
Pericoronary adipose tissue feature analysis in CT calcium score images with comparison to coronary CTA
Preliminarily, PCAT features can be assessed from three main coronary arteries in non-contrast CTCS images with performance characteristics that are at the very least comparable to CCTA.
EEG Based Generative Depression Discriminator
In the test, a segment of EEG signal was put into the two generators separately, if the relationship between the EEG signal and brain activity conforms to the characteristics of a certain category, then the signal generated by the generator of the corresponding category is more consistent with the original signal.
Energy based diffusion generator for efficient sampling of Boltzmann distributions
We introduce a novel sampler called the energy based diffusion generator for generating samples from arbitrary target distributions.
Generalizing SDP-Based Barrier Certificate Synthesis to Unbounded Domains by Dropping Archimedean Condition
Barrier certificates, which serve as differential invariants that witness system safety, play a crucial role in the verification of cyber-physical systems (CPS).
Gemini: A Family of Highly Capable Multimodal Models
This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding.
Ranked #1 on
Multi-task Language Understanding
on MMLU
(using extra training data)
UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensation
In response to this, we introduce UCMCTrack, a novel motion model-based tracker robust to camera movements.
Ranked #1 on
Multiple Object Tracking
on KITTI Tracking test
Earthfarseer: Versatile Spatio-Temporal Dynamical Systems Modeling in One Model
Efficiently modeling spatio-temporal (ST) physical processes and observations presents a challenging problem for the deep learning community.
Revisiting Graph-Based Fraud Detection in Sight of Heterophily and Spectrum
This detector includes a hybrid filtering module and a local environmental constraint module, the two modules are utilized to solve heterophily and label utilization problem respectively.
Multi-Scale and Multi-Modal Contrastive Learning Network for Biomedical Time Series
Multi-modal biomedical time series (MBTS) data offers a holistic view of the physiological state, holding significant importance in various bio-medical applications.
LE-SSL-MOS: Self-Supervised Learning MOS Prediction with Listener Enhancement
In this paper, we proposed a novel fusion model for MOS prediction that combines supervised and unsupervised approaches.
Efficient Pyramid Channel Attention Network for Pathological Myopia Recognition
Moreover, motivated by the recent pretraining-and-finetuning paradigm, we attempt to adapt pre-trained natural image models for PM recognition by freezing them and treating the EPCA and other attention modules as adapters.
Reaction coordinate flows for model reduction of molecular kinetics
In this work, we introduce a flow based machine learning approach, called reaction coordinate (RC) flow, for discovery of low-dimensional kinetic models of molecular systems.
Enhancing cardiovascular risk prediction through AI-enabled calcium-omics
We used a Cox model with elastic-net regularization on 2457 CT calcium score (CTCS) enriched for MACE events obtained from a large no-cost CLARIFY program (ClinicalTri-als. gov Identifier: NCT04075162).
RIS-assisted High-Speed Railway Integrated Sensing and Communication System
One technology that has the potential to improve wireless communications in years to come is integrated sensing and communication (ISAC).
MM-GEF: Multi-modal representation meet collaborative filtering
In modern e-commerce, item content features in various modalities offer accurate yet comprehensive information to recommender systems.
Real-time FPGA Implementation of CNN-based Distributed Fiber Optic Vibration Event Recognition Method
Utilizing optical fibers to detect and pinpoint vibrations, Distributed Optical Fiber Vibration Sensing (DVS) technology provides real-time monitoring and surveillance of wide-reaching areas.
AI-GOMS: Large AI-Driven Global Ocean Modeling System
Here, we present AI-GOMS, a large AI-driven global ocean modeling system, for accurate and efficient global ocean daily prediction.
An Intelligent Remote Sensing Image Quality Inspection System
Due to the inevitable presence of quality problems, quality inspection of remote sensing images is indeed an indispensable step between the acquisition and the application of them.
Cardiac CT perfusion imaging of pericoronary adipose tissue (PCAT) highlights potential confounds in coronary CTA
HU, blood flow, and radiomics were assessed over time.
Towards Language-guided Interactive 3D Generation: LLMs as Layout Interpreter with Generative Feedback
Generating and editing a 3D scene guided by natural language poses a challenge, primarily due to the complexity of specifying the positional relations and volumetric changes within the 3D space.
PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Prediction
In this paper, we investigate the challenge of spatio-temporal video prediction, which involves generating future videos based on historical data streams.
A Constrained BA Algorithm for Rate-Distortion and Distortion-Rate Functions
The Blahut-Arimoto (BA) algorithm has played a fundamental role in the numerical computation of rate-distortion (RD) functions.
Efficient Bayesian inference using physics-informed invertible neural networks for inverse problems
Simultaneously, the INN is designed to partition the parameter vector linked to the input physical field into two distinct components: the expansion coefficients representing the forward problem solution and the Gaussian latent noise.
Immune Defense: A Novel Adversarial Defense Mechanism for Preventing the Generation of Adversarial Examples
Therefore, we propose a novel adversarial defense mechanism, which is referred to as immune defense and is the example-based pre-defense.
Do We Really Need Complicated Model Architectures For Temporal Networks?
Recurrent neural network (RNN) and self-attention mechanism (SAM) are the de facto methods to extract spatial-temporal information for temporal graph learning.
IB-UQ: Information bottleneck based uncertainty quantification for neural function regression and neural operator learning
We propose a novel framework for uncertainty quantification via information bottleneck (IB-UQ) for scientific machine learning tasks, including deep neural network (DNN) regression and neural operator learning (DeepONet).
A Closer Look at Few-shot Classification Again
Few-shot classification consists of a training phase where a model is learned on a relatively large dataset and an adaptation phase where the learned model is adapted to previously-unseen tasks with limited labeled samples.
Vision Learners Meet Web Image-Text Pairs
In this work, given the excellent scalability of web data, we consider self-supervised pre-training on noisy web sourced image-text paired data.
A Simple Framework for Text-Supervised Semantic Segmentation
LoDA and SimSeg jointly ameliorate a vanilla CLIP to produce impressive semantic segmentation results.
MoQuad: Motion-focused Quadruple Construction for Video Contrastive Learning
Learning effective motion features is an essential pursuit of video representation learning.
Online Handbook of Argumentation for AI: Volume 3
This volume contains revised versions of the papers selected for the third volume of the Online Handbook of Argumentation for AI (OHAAI).
An ADMM-Incorporated Latent Factorization of Tensors Method for QoS Prediction
We maintain the non-negativity of the model by constructing an augmented Lagrangian function with the ADMM optimization framework.
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
We propose SmoothQuant, a training-free, accuracy-preserving, and general-purpose post-training quantization (PTQ) solution to enable 8-bit weight, 8-bit activation (W8A8) quantization for LLMs.
Track Targets by Dense Spatio-Temporal Position Encoding
Experiments on video multi-object tracking (MOT) and multi-object tracking and segmentation (MOTS) datasets demonstrate the effectiveness of the proposed DST position encoding.
Multi-Object Tracking
Multi-Object Tracking and Segmentation
+2
Enhancing Spatiotemporal Prediction Model using Modular Design and Beyond
In this paper, a modular design is proposed, which decomposes spatiotemporal sequence model into two modules: a spatial encoder-decoder and a predictor.
FP8 Formats for Deep Learning
FP8 is a natural progression for accelerating deep learning training inference beyond the 16-bit formats common in modern processors.
A detail-enhanced sampling strategy in Hadamard single-pixel imaging
Hadamard single-pixel imaging (HSI) is an appealing imaging technique due to its features of low hardware complexity and industrial cost.
Exploiting Unlabeled Data for Target-Oriented Opinion Words Extraction
Limited labeled data increase the risk of distribution shift between test data and training data.
\b{eta}-Divergence-Based Latent Factorization of Tensors model for QoS prediction
A nonnegative latent factorization of tensors (NLFT) model can well model the temporal pattern hidden in nonnegative quality-of-service (QoS) data for predicting the unobserved ones with high accuracy.
Distinctive Image Captioning via CLIP Guided Group Optimization
Image captioning models are usually trained according to human annotated ground-truth captions, which could generate accurate but generic captions.
Dual Power Spectrum Manifold and Toeplitz HPD Manifold: Enhancement and Analysis for Matrix CFAR Detection
These advantages benefit from the geometry of the Toeplitz Hermitian positive definite (HPD) manifold $\mathcal{M}_{\mathcal{T}H_{++}}$, but the sophisticated geometry also results in some challenges for geometric detectors, such as the implementation of the enhanced detector to improve the SCR (signal-to-clutter ratio) and the analysis of the detection performance.
Priors in Deep Image Restoration and Enhancement: A Survey
Image restoration and enhancement is a process of improving the image quality by removing degradations, such as noise, blur, and resolution degradation.
Resilience in Industrial Internet of Things Systems: A Communication Perspective
Industrial Internet of Things is an ultra-large-scale system that is much more sophisticated and fragile than conventional industrial platforms.
Edge YOLO: Real-Time Intelligent Object Detection System Based on Edge-Cloud Cooperation in Autonomous Vehicles
Driven by the ever-increasing requirements of autonomous vehicles, such as traffic monitoring and driving assistant, deep learning-based object detection (DL-OD) has been increasingly attractive in intelligent transportation systems.
A New Outlier Removal Strategy Based on Reliability of Correspondence Graph for Fast Point Cloud Registration
We use a simple and intuitive method to describe the 6-DOF (degree of freedom) curtailment process in point cloud registration and propose an outlier removal strategy based on the reliability of the correspondence graph.
CODE-MVP: Learning to Represent Source Code from Multiple Views with Contrastive Pre-Training
Specifically, we first extract multiple code views using compiler tools, and learn the complementary information among them under a contrastive learning framework.
Towards Practical and Efficient Long Video Summary
Recently, video summarization (VS) techniques are widely used to alleviate huge processing pressure brought by numerous long videos.
Digging into Primary Financial Market: Challenges and Opportunities of Adopting Blockchain
Since the emergence of blockchain technology, its application in the financial market has always been an area of focus and exploration by all parties.
GMSS: Graph-Based Multi-Task Self-Supervised Learning for EEG Emotion Recognition
GMSS has the ability to learn more general representations by integrating multiple self-supervised tasks, including spatial and frequency jigsaw puzzle tasks, and contrastive learning tasks.
Monte Carlo PINNs: deep learning approach for forward and inverse problems involving high dimensional fractional partial differential equations
We introduce a sampling based machine learning approach, Monte Carlo physics informed neural networks (MC-PINNs), for solving forward and inverse fractional partial differential equations (FPDEs).
Beyond the Limitation of Pulse Width in Optical Time-domain Reflectometry
Here, we propose and experimentally demonstrate an OTDR deconvolution neural network based on deep convolutional neural networks.
Compilable Neural Code Generation with Compiler Feedback
Automatically generating compilable programs with (or without) natural language descriptions has always been a touchstone problem for computational linguistics and automated software engineering.
Contrastive Vision-Language Pre-training with Limited Resources
However, these works require a tremendous amount of data and computational resources (e. g., billion-level web data and hundreds of GPUs), which prevent researchers with limited resources from reproduction and further exploration.
Deeptime: a Python library for machine learning dynamical models from time series data
Generation and analysis of time-series data is relevant to many quantitative fields ranging from economics to fluid mechanics.
FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labeling
However, like other modern SSL algorithms, FixMatch uses a pre-defined constant threshold for all classes to select unlabeled data that contribute to the training, thus failing to consider different learning status and learning difficulties of different classes.
Positional-Spectral-Temporal Attention in 3D Convolutional Neural Networks for EEG Emotion Recognition
The proposed module, denoted by PST-Attention, consists of Positional, Spectral and Temporal Attention modules to explore more discriminative EEG features.
Aspect-driven User Preference and News Representation Learning for News Recommendation
News recommender systems are essential for helping users to efficiently and effectively find out those interesting news from a large amount of news.
Enabling variable high spatial resolution retrieval from a long pulse BOTDA sensor
We propose a convolutional neural network (CNN) to process the data of conventional Brillouin optical time domain analysis (BOTDA) sensors, which achieves unprecedented performance improvement that allows to directly retrieve higher spatial resolution (SR) from the sensing system that use long pump pulses.
Normalizing field flows: Solving forward and inverse stochastic differential equations using physics-informed flow models
We introduce in this work the normalizing field flows (NFF) for learning random fields from scattered measurements.
Cooperative Learning for Noisy Supervision
Learning with noisy labels has gained the enormous interest in the robust deep learning area.
SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation
Code representation learning, which aims to encode the semantics of source code into distributed vectors, plays an important role in recent deep-learning-based models for code intelligence.
Conjugate Energy-Based Models
In this paper, we propose conjugate energy-based models (CEBMs), a new class of energy-based models that define a joint density over data and latent variables.
Nested Variational Inference
We develop nested variational inference (NVI), a family of methods that learn proposals for nested importance samplers by minimizing an forward or reverse KL divergence at each level of nesting.
Boosting Offline Reinforcement Learning with Residual Generative Modeling
While most research focuses on the state-action function part through reducing the bootstrapping error in value function approximation induced by the distribution shift of training data, the effects of error propagation in generative modeling have been neglected.
Mathematical Modeling of Chemotaxis Guided Amoeboid Cell Swimming
Cells and microorganisms adopt various strategies to migrate in response to different environmental stimuli.
Collaborative Label Correction via Entropy Thresholding
Deep neural networks (DNNs) have the capacity to fit extremely noisy labels nonetheless they tend to learn data with clean labels first and then memorize those with noisy labels.
XRJL-HKUST at SemEval-2021 Task 4: WordNet-Enhanced Dual Multi-head Co-Attention for Reading Comprehension of Abstract Meaning
This paper presents our submitted system to SemEval 2021 Task 4: Reading Comprehension of Abstract Meaning.
LiGCN: Label-interpretable Graph Convolutional Networks for Multi-label Text Classification
Besides, the model allows better interpretability for predicted labels as the token-label edges are exposed.
Minimization of ion micromotion with artificial neural network
Minimizing the micromotion of the single trapped ion in a linear Paul trap is a tedious and time-consuming work, but is of great importance in cooling the ion into the motional ground state as well as maintaining long coherence time, which is crucial for quantum information processing and quantum computation.
Atomic Physics Quantum Physics
Learning Proposals for Probabilistic Programs with Inference Combinators
Proposals in these samplers can be parameterized using neural networks, which in turn can be trained by optimizing variational objectives.
A Convergent Semi-Proximal Alternating Direction Method of Multipliers for Recovering Internet Traffics from Link Measurements
Our model can be divided into a series of subproblems, which only relate to the traffics in a certain individual time interval.
Optimization and Control
LEAP: TrustZone Based Developer-Friendly TEE for Intelligent Mobile Apps
ARM TrustZone is widely deployed on commercial-off-the-shelf mobile devices for secure execution.
Cryptography and Security
Coalition Game Based Full-duplex Popular Content Distribution in mmWave Vehicular Networks
We evaluate the proposed scheme by extensive simulations in mmWave vehicular networks.
Fairness
Information Theory
Networking and Internet Architecture
Information Theory
Adaptive Tree Wasserstein Minimization for Hierarchical Generative Modeling
In this work, we consider OT over tree metrics, which is more general than the sliced Wasserstein and includes the sliced Wasserstein as a special case, and we propose a fast minimization algorithm in $O(n)$ for the optimal Wasserstein-1 transport plan between two distributions in the tree structure.
Warren at SemEval-2020 Task 4: ALBERT and Multi-Task Learning for Commonsense Validation
This paper describes our system in subtask A of SemEval 2020 Shared Task 4.
Learning the Best Pooling Strategy for Visual Semantic Embedding
Visual Semantic Embedding (VSE) is a dominant approach for vision-language retrieval, which aims at learning a deep embedding space such that visual data are embedded close to their semantic text labels or descriptions.
Memory Group Sampling Based Online Action Recognition Using Kinetic Skeleton Features
First, we combine the spatial and temporal skeleton features to depict the actions, which include not only the geometrical features, but also multi-scale motion features, such that both the spatial and temporal information of the action are covered.
A Relaxed Matching Procedure for Unsupervised BLI
Recently unsupervised Bilingual Lexicon Induction (BLI) without any parallel corpus has attracted much research interest.
Semi-Supervised Bilingual Lexicon Induction with Two-way Interaction
In this paper, we propose a new semi-supervised BLI framework to encourage the interaction between the supervised signal and unsupervised alignment.
Easy, Reproducible and Quality-Controlled Data Collection with CROWDAQ
High-quality and large-scale data are key to success for AI systems.
Improving the spatial resolution of a BOTDA sensor using deconvolution algorithm
The frequency dependency of Brillouin gain temporal envelope is investigated by simulation, and its impact on the recovered results of deconvolution algorithm is thoroughly analyzed.
DanHAR: Dual Attention Network For Multimodal Human Activity Recognition Using Wearable Sensors
Recently, two attention methods are proposed via combining with Gated Recurrent Units (GRU) and Long Short-Term Memory (LSTM) network, which can capture the dependencies of sensing signals in both spatial and temporal domains simultaneously.
Learning Based Distributed Tracking
Inspired by the great success of machine learning in the past decade, people have been thinking about the possibility of improving the theoretical results by exploring data distribution.
Data Structures and Algorithms
Real-time Human Activity Recognition Using Conditionally Parametrized Convolutions on Mobile and Wearable Devices
For deep learning, improvements in performance have to heavily rely on increasing model size or capacity to scale to larger and larger datasets, which inevitably leads to the increase of operations.
Response to LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
Recently the Chinese video sharing platform Bilibili, has popularised a novel captioning system where user comments are displayed as streams of moving subtitles overlaid on the video playback screen and broadcast to all viewers in real-time.
Modeling nanoconfinement effects using active learning
At this scale, the fluid properties are affected by nanoconfinement effects due to the increased fluid-solid interactions.
TORQUE: A Reading Comprehension Dataset of Temporal Ordering Questions
A critical part of reading is being able to understand the temporal relationships between events described in a passage of text, even when those relationships are not explicitly stated.
Ranked #2 on
Question Answering
on Torque
Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation
Quantization techniques can reduce the size of Deep Neural Networks and improve inference latency and throughput by taking advantage of high throughput integer instructions.
Masked Face Recognition Dataset and Application
These datasets are freely available to industry and academia, based on which various applications on masked faces can be developed.
Fully Convolutional Networks for Automatically Generating Image Masks to Train Mask R-CNN
This paper proposes a novel automatically generating image masks method for the state-of-the-art Mask R-CNN deep learning method.
DeepDualMapper: A Gated Fusion Network for Automatic Map Extraction using Aerial Images and Trajectories
We propose a deep convolutional neural network called DeepDualMapper which fuses the aerial image and trajectory data in a more seamless manner to extract the digital map.
Stochastic Normalizing Flows
The sampling of probability distributions specified up to a normalization constant is an important problem in both machine learning and statistical mechanics.
Structural-Aware Sentence Similarity with Recursive Optimal Transport
Moreover, we further develop Recursive Optimal Similarity (ROTS) for sentences with the valuable semantic insights from the connections between cosine similarity of weighted average of word vectors and optimal transport.
Mastering Complex Control in MOBA Games with Deep Reinforcement Learning
We study the reinforcement learning problem of complex action control in the Multi-player Online Battle Arena (MOBA) 1v1 games.
Deep learning Markov and Koopman models with physical constraints
Here we develop theory and methods for deep learning Markov and Koopman models that can bear such physical constraints.
Computational Physics
Structured Multi-Hashing for Model Compression
Despite the success of deep neural networks (DNNs), state-of-the-art models are too large to deploy on low-resource devices or common server configurations in which multiple models are held in memory.
Amortized Population Gibbs Samplers with Neural Sufficient Statistics
We develop amortized population Gibbs (APG) samplers, a class of scalable methods that frames structured variational inference as adaptive importance sampling.
Continuous Convolutional Neural Network forNonuniform Time Series
Convolutional neural network (CNN) for time series data implicitly assumes that the data are uniformly sampled, whereas many event-based and multi-modal data are nonuniform or have heterogeneous sampling rates.
Learning Latent Parameters without Human Response Patterns: Item Response Theory with Artificial Crowds
We demonstrate a use-case for latent difficulty item parameters, namely training set filtering, and show that using difficulty to sample training data outperforms baseline methods.
An encoding framework with brain inner state for natural image identification
The framework comprises two parts: forward encoding model that deals with visual stimuli and inner state model that captures influence from intrinsic connections in the brain.
Detecting 11K Classes: Large Scale Object Detection without Fine-Grained Bounding Boxes
However, these methods require fully annotated object bounding boxes for training, which are incredibly hard to scale up due to the high annotation cost.
Learning to Reconstruct and Understand Indoor Scenes from Sparse Views
This paper proposes a new method for simultaneous 3D reconstruction and semantic segmentation of indoor scenes.
Joint Reasoning for Temporal and Causal Relations
Understanding temporal and causal relations between events is a fundamental natural language understanding task.
A Variational Approach for Learning from Positive and Unlabeled Data
Learning binary classifiers only from positive and unlabeled (PU) data is an important and challenging task in many real-world applications, including web text classification, disease gene identification and fraud detection, where negative samples are difficult to verify experimentally.
Unified Visual-Semantic Embeddings: Bridging Vision and Language With Structured Meaning Representations
We propose the Unified Visual-Semantic Embeddings (Unified VSE) for learning a joint space of visual representation and textual semantics.
ZQM at SemEval-2019 Task9: A Single Layer CNN Based on Pre-trained Model for Suggestion Mining
In our system, the input of convolutional neural network is the embedding vectors which are drawn from the pre-trained BERT model.
Adaptive Learning Material Recommendation in Online Language Education
Recommending personalized learning materials for online language learning is challenging because we typically lack data about the student's ability and the relative difficulty of learning materials.
Uneven illumination surface defects inspection based on convolutional neural network
Surface defect inspection based on machine vision is often affected by uneven illumination.
Free Component Analysis: Theory, Algorithms & Applications
We describe a method for unmixing mixtures of freely independent random variables in a manner analogous to the independent component analysis (ICA) based method for unmixing independent random variables from their additive mixtures.
Wasserstein-Fisher-Rao Document Distance
As a fundamental problem of natural language processing, it is important to measure the distance between different documents.
UniVSE: Robust Visual Semantic Embeddings via Structured Semantic Representations
We propose Unified Visual-Semantic Embeddings (UniVSE) for learning a joint space of visual and textual concepts.
Boltzmann Generators -- Sampling Equilibrium States of Many-Body Systems with Deep Learning
Computing equilibrium states in condensed-matter many-body systems, such as solvated proteins, is a long-standing challenge.
Variational Selection of Features for Molecular Kinetics
The modeling of atomistic biomolecular simulations using kinetic models such as Markov state models (MSMs) has had many notable algorithmic advances in recent years.
Composing Modeling and Inference Operations with Probabilistic Program Combinators
We assume that models are dynamic, but that model composition is static, in the sense that combinator application takes place prior to evaluating the model on data.
NLP at IEST 2018: BiLSTM-Attention and LSTM-Attention via Soft Voting in Emotion Classification
This paper describes our method that competed at WASSA2018 \textit{Implicit Emotion Shared Task}.
NLPZZX at SemEval-2018 Task 1: Using Ensemble Method for Emotion and Sentiment Intensity Determination
We participate in two subtasks for English tweets: EI-reg and V-reg.
Zewen at SemEval-2018 Task 1: An Ensemble Model for Affect Prediction in Tweets
This paper presents a method for Affect in Tweets, which is the task to automatically determine the intensity of emotions and intensity of sentiment of tweets.
Deep Generative Markov State Models
We propose a deep generative Markov State Model (DeepGenMSM) learning framework for inference of metastable dynamical systems and prediction of trajectories.
A Multi-Axis Annotation Scheme for Event Temporal Relations
Existing temporal relation (TempRel) annotation schemes often have low inter-annotator agreements (IAA) even between experts, suggesting that the current annotation task needs a better definition.
Improving Temporal Relation Extraction with a Globally Acquired Statistical Resource
We argue that this task would gain from the availability of a resource that provides prior knowledge in the form of the temporal order that events usually follow.
Loss Rank Mining: A General Hard Example Mining Method for Real-time Detectors
LRM is a general method for real-time detectors, as it utilizes the final feature map which exists in all real-time detectors to mine hard examples.
Structured Disentangled Representations
Deep latent-variable models learn representations of high-dimensional data in an unsupervised manner.
DeepTravel: a Neural Network Based Travel Time Estimation Model with Auxiliary Supervision
Estimating the travel time of a path is of great importance to smart urban mobility.
A Novel Brain Decoding Method: a Correlation Network Framework for Revealing Brain Connections
Analyzing the correlations of collected data from human brain activities and representing activity patterns are two problems in brain decoding based on functional magnetic resonance imaging (fMRI) signals.
MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks
We present MorphNet, an approach to automate the design of neural network structures.
VAMPnets: Deep learning of molecular kinetics
There is an increasing demand for computing the relevant structures, equilibria and long-timescale kinetics of biomolecular processes, such as protein-drug binding, from high-throughput molecular dynamics simulations.
Mixed Precision Training
Using this approach, we can reduce the memory consumption of deep learning models by nearly 2x.
Network Vector: Distributed Representations of Networks with Global Context
We propose a neural embedding algorithm called Network Vector, which learns distributed representations of nodes and the entire networks simultaneously.
BIT at SemEval-2017 Task 1: Using Semantic Information Space to Evaluate Semantic Textual Similarity
This paper presents three systems for semantic textual similarity (STS) evaluation at SemEval-2017 STS task.
Variational approach for learning Markov processes from time series data
This leads to the definition of a family of score functions called VAMP-r which can be calculated from data, and can be employed to optimize a Markovian model.
Soft Label Memorization-Generalization for Natural Language Inference
Often when multiple labels are obtained for a training example it is assumed that there is an element of noise that must be accounted for.
Understanding Deep Learning Performance through an Examination of Test Set Difficulty: A Psychometric Case Study
We examine the impact of a test set question's difficulty to determine if there is a relationship between difficulty and performance.
Variational Koopman models: slow collective variables and molecular kinetics from short off-equilibrium simulations
Recently, a powerful generalization of MSMs has been introduced, the variational approach (VA) of molecular kinetics and its special case the time-lagged independent component analysis (TICA), which allow us to approximate slow collective variables and molecular kinetics by linear combinations of smooth basis functions or order parameters.
Spectral learning of dynamic systems from nonequilibrium data
Observable operator models (OOMs) and related models are one of the most important and powerful tools for modeling and analyzing stochastic systems.
Hierarchical Neural Language Models for Joint Representation of Streaming Documents and their Content
In particular, we exploit the context of documents in streams and use one of the language models to model the document sequences, and the other to model word sequences within them.
Building an Evaluation Scale using Item Response Theory
Evaluation of NLP methods requires testing against a previously vetted gold-standard test set and reporting standard metrics (accuracy/precision/recall/F1).
Sparse Estimation of Multivariate Poisson Log-Normal Models from Count Data
Modeling data with multivariate count responses is a challenging problem due to the discrete nature of the responses.
The Computational Principles of Learning Ability
It has been quite a long time since AI researchers in the field of computer science stop talking about simulating human intelligence or trying to explain how brain works.
What is Learning? A primary discussion about information and Representation
While for AI and machine learning researchers, it is a consensus that we are not anywhere near the core technique which could bring the Terminator, Number 5 or R2D2 into real life, and there is not even a formal definition about what is intelligence, or one of its basic properties: Learning.
Clustering Assisted Fundamental Matrix Estimation
In computer vision, the estimation of the fundamental matrix is a basic problem that has been extensively studied.
Maximum Margin Clustering for State Decomposition of Metastable Systems
When studying a metastable dynamical system, a prime concern is how to decompose the phase space into a set of metastable states.
ILLINOISCLOUDNLP: Text Analytics Services in the Cloud
Natural Language Processing (NLP) continues to grow in popularity in a range of research and commercial applications.
