Search Results for author:
Found 147 papers, 55 papers with code
PCEE-BERT: Accelerating BERT Inference via Patient and Confident Early Exiting
In this work, we propose Patient and Confident Early Exiting BERT (PCEE-BERT), an off-the-shelf sample-dependent early exiting method that can work with different PLMs and can also work along with popular model compression methods.
HwTscSU’s Submissions on WAT 2022 Shared Task
In this paper we describe our submission to the shared tasks of the 9th Workshop on Asian Translation (WAT 2022) on NICT–SAP under the team name ”HwTscSU”.
Hybrid Polynomial Zonotopes: A Set Representation for Reachability Analysis in Hybrid Nonaffine Systems
Reachability analysis for hybrid nonaffine systems remains computationally challenging, as existing set representations--including constrained, polynomial, and hybrid zonotopes--either lose tightness under high-order nonaffine maps or suffer exponential blow-up after discrete jumps.
TTrace: Lightweight Error Checking and Diagnosis for Distributed Training
Effectively detecting and localizing such silent bugs in distributed training is challenging.
Manipulating Elasto-Plastic Objects With 3D Occupancy and Learning-Based Predictive Control
Manipulating elasto-plastic objects remains a significant challenge due to severe self-occlusion, difficulties of representation, and complicated dynamics.
Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space
In this work, we introduce Soft Thinking, a training-free method that emulates human-like "soft" reasoning by generating soft, abstract concept tokens in a continuous concept space.
APEX: Empowering LLMs with Physics-Based Task Planning for Real-time Insight
Large Language Models (LLMs) demonstrate strong reasoning and task planning capabilities but remain fundamentally limited in physical interaction modeling.
LGBQPC: Local Granular-Ball Quality Peaks Clustering
These modifications substantially improve the performance of GBDPC on datasets with complex manifold structures or non-uniform density distributions.
Replication and Exploration of Generative Retrieval over Dynamic Corpora
We observe that the more fine-grained the docid design in the GR model, the better its performance over dynamic corpora, surpassing BM25 and even being comparable to dense retrieval methods.
Equilibrium Conserving Neural Operators for Super-Resolution Learning
We evaluate this ECO-based super-resolution framework that strongly enforces conservation-laws in the predicted solutions on two working examples: embedded pores in a homogenized matrix and randomly textured polycrystalline materials.
On the Value of Cross-Modal Misalignment in Multimodal Representation Learning
Multimodal representation learning, exemplified by multimodal contrastive learning (MMCL) using image-text pairs, aims to learn powerful representations by aligning cues across modalities.
Data-Driven Nonconvex Reachability Analysis using Exact Multiplication
We propose a novel approach using constrained polynomial zonotopes to describe reachable sets for unknown LTI systems.
Exploring Training and Inference Scaling Laws in Generative Retrieval
Generative retrieval has emerged as a novel paradigm that leverages large language models (LLMs) to autoregressively generate document identifiers.
Analytic DAG Constraints for Differentiable DAG Learning
By developing the necessary theory to establish a connection between analytic functions and DAG constraints, we demonstrate that analytic functions from the set $\{f(x) = c_0 + \sum_{i=1}^{\infty}c_ix^i | \forall i > 0, c_i > 0; r = \lim_{i\rightarrow \infty}c_{i}/c_{i+1} > 0\}$ can be employed to formulate effective DAG constraints.
PyGDA: A Python Library for Graph Domain Adaptation
As the first comprehensive library in this area, PyGDA covers more than 20 widely used graph domain adaptation methods together with different types of graph datasets.
I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data?
The remarkable achievements of large language models (LLMs) have led many to conclude that they exhibit a form of intelligence.
Learning Cascade Ranking as One Network
Recent advances such as RankFlow and FS-LTR have introduced interaction-aware training paradigms but still struggle to 1) align training objectives with the goal of the entire cascade ranking (i. e., end-to-end recall) and 2) learn effective collaboration patterns for different stages.
Online Pseudo-average Shifting Attention(PASA) for Robust Low-precision LLM Inference: Algorithms and Numerical Analysis
To accelerate this process, we developed a low-precision, mathematically-equivalent algorithm called PASA, based on Flash Attention.
Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inference
To mitigate the dependence on retrieval and simultaneously maintain, or even improve, the performance benefits provided by retrieval, we propose a method to detect the knowledge boundary of VLLMs, allowing for more efficient use of techniques like RAG.
MaZO: Masked Zeroth-Order Optimization for Multi-Task Fine-Tuning of Large Language Models
Large language models have demonstrated exceptional capabilities across diverse tasks, but their fine-tuning demands significant memory, posing challenges for resource-constrained environments.
Aggregate to Adapt: Node-Centric Aggregation for Multi-Source-Free Graph Domain Adaptation
Unsupervised graph domain adaptation (UGDA) focuses on transferring knowledge from labeled source graph to unlabeled target graph under domain discrepancies.
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
We introduce our first-generation reasoning models, DeepSeek-R1-Zero and DeepSeek-R1.
Ranked #1 on
Mathematical Reasoning
on AIME24
Physics-Informed Machine Learning for Efficient Reconfigurable Intelligent Surface Design
To verify the proposed method, the RIS has also been fabricated and measured.
Unsupervised Query Routing for Retrieval Augmented Generation
This evaluation enables the decision of the most suitable search engine for a given query.
A wideband amplifying and filtering reconfigurable intelligent surface for wireless relay
Programmable metasurfaces have garnered significant attention due to their exceptional ability to manipulate electromagnetic (EM) waves in real time, leading to the emergence of a prominent area in wireless communication, namely reconfigurable intelligent surfaces (RISs), to control the signal propagation and coverage.
DeepSeek-V3 Technical Report
We present DeepSeek-V3, a strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token.
SDM-Car: A Dataset for Small and Dim Moving Vehicles Detection in Satellite Videos
Vehicle detection and tracking in satellite video is essential in remote sensing (RS) applications.
Adaptive$^2$: Adaptive Domain Mining for Fine-grained Domain Adaptation Modeling
To the best of our knowledge, Adaptive$^2$ is the first approach to automatically learn both domain identification and adaptation in online advertising, opening new research directions for this area.
Scaling Laws for Online Advertisement Retrieval
To the best of our knowledge, this is the first work to study the scaling laws for online advertisement retrieval of real-world systems, showing great potential for scaling law in advertising system optimization.
Exploring Knowledge Boundaries in Large Language Models for Retrieval Judgment
Actually, we find that the impact of RAG on the question answering capabilities of LLMs can be categorized into three groups: beneficial, neutral, and harmful.
Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent
To bridge the dataset gap, we first construct Dyn-VQA dataset, consisting of three types of "dynamic" questions, which require complex knowledge retrieval strategies variable in query, tool, and time: (1) Questions with rapidly changing answers.
DOFS: A Real-world 3D Deformable Object Dataset with Full Spatial Information for Dynamics Model Learning
This work proposes DOFS, a pilot dataset of 3D deformable objects (DOs) (e. g., elasto-plastic objects) with full spatial information (i. e., top, side, and bottom information) using a novel and low-cost data collection platform with a transparent operating plane.
ChannelGPT: A Large Model to Generate Digital Twin Channel for 6G Environment Intelligence
In practice, we also establish a ChannelGPT prototype to generate high-fidelity channel data for varied scenarios to validate the accuracy and generalization ability based on environment intelligence.
Towards Dynamic Graph Neural Networks with Provably High-Order Expressive Power
Our theoretical results demonstrate that HopeDGN can achieve expressive power equivalent to the 2-DWL test.
Wireless Environment Information Sensing, Feature, Semantic, and Knowledge: Four Steps Towards 6G AI-Enabled Air Interface
The air interface technology plays a crucial role in optimizing the communication quality for users.
PipeFill: Using GPUs During Bubbles in Pipeline-parallel LLM Training
Unfortunately, PP model training can use GPUs inefficiently, especially at large scale, due to idle GPU time caused by pipeline bubbles, which are often 15-30% and can exceed 60% of the training job's GPU allocation.
Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modeling
We integrate neural operators with diffusion models to address the spectral limitations of neural operators in surrogate modeling of turbulent flows.
An incremental preference elicitation-based approach to learning potentially non-monotonic preferences in multi-criteria sorting
Specifically, we first construct a max-margin optimization-based model to model potentially non-monotonic preferences and inconsistent assignment example preference information in each iteration of the incremental preference elicitation process.
Lexicographic optimization-based approaches to learning a representative model for multi-criteria sorting with non-monotonic criteria
Deriving a representative model using value function-based methods from the perspective of preference disaggregation has emerged as a prominent and growing topic in multi-criteria sorting (MCS) problems.
SympGNNs: Symplectic Graph Neural Networks for identifiying high-dimensional Hamiltonian systems and node classification
Herein, we introduce Symplectic Graph Neural Networks (SympGNNs) that can effectively handle system identification in high-dimensional Hamiltonian systems, as well as node classification.
Rethinking State Disentanglement in Causal Reinforcement Learning
We revisit this research line and find that incorporating RL-specific context can reduce unnecessary assumptions in previous identifiability analyses for latent states.
Can Wireless Environmental Information Decrease Pilot Overhead: A CSI Prediction Example
Finally, a CNN-based channel prediction network is designed to predict the complete CSI, using the environmental feature map and partial CSI.
Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encoding
To this end, we propose a novel Correlated Spatial-Temporal Positional encoding that incorporates a parameter-free personalized interaction intensity estimation under the weak assumption of the Poisson Point Process.
Revisiting, Benchmarking and Understanding Unsupervised Graph Domain Adaptation
Unsupervised Graph Domain Adaptation (UGDA) involves the transfer of knowledge from a label-rich source graph to an unlabeled target graph under domain discrepancies.
Resource Allocation and Workload Scheduling for Large-Scale Distributed Deep Learning: A Survey
The large-scale environment with large volumes of datasets, models, and computational and communication resources raises various unique challenges for resource allocation and workload scheduling in distributed deep learning, such as scheduling complexity, resource and workload heterogeneity, and fault tolerance.
Highway Graph to Accelerate Reinforcement Learning
Building on this observation, we introduce the highway graph to model state transitions.
Generation of Granular-Balls for Clustering Based on the Principle of Justifiable Granularity
Efficient and robust data clustering remains a challenging task in the field of data analysis.
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
MLA guarantees efficient inference through significantly compressing the Key-Value (KV) cache into a latent vector, while DeepSeekMoE enables training strong models at an economical cost through sparse computation.
Cross-IQA: Unsupervised Learning for Image Quality Assessment
Automatic perception of image quality is a challenging problem that impacts billions of Internet and social media users daily.
Advancing the Robustness of Large Language Models through Self-Denoised Smoothing
Although large language models (LLMs) have achieved significant success, their vulnerability to adversarial perturbations, including recent jailbreak attacks, has raised considerable concerns.
Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey
Due to intensive synchronization of models and sharing of data across GPUs and computing nodes during distributed training and inference processes, communication efficiency becomes the bottleneck for achieving high performance at a large scale.
The Double-Edged Sword of Input Perturbations to Robust Accurate Fairness
Deep neural networks (DNNs) are known to be sensitive to adversarial input perturbations, leading to a reduction in either prediction accuracy or individual fairness.
Identifiable Latent Neural Causal Models
This work establishes a {sufficient} and {necessary} condition characterizing the types of distribution shifts for identifiability in the context of latent additive noise models.
A Causal Inspired Early-Branching Structure for Domain Generalization
By d-separation, we observe that the causal feature can be further characterized by being independent of the domain conditioned on the object, and we propose the following two strategies as complements for the basic framework.
Collaborate to Adapt: Source-Free Graph Domain Adaptation via Bi-directional Adaptation
Unsupervised Graph Domain Adaptation (UGDA) has emerged as a practical solution to transfer knowledge from a label-rich source graph to a completely unlabelled target graph.
BuffGraph: Enhancing Class-Imbalanced Node Classification via Buffer Nodes
Class imbalance in graph-structured data, where minor classes are significantly underrepresented, poses a critical challenge for Graph Neural Networks (GNNs).
Distillation Enhanced Generative Retrieval
Generative retrieval is a promising new paradigm in text retrieval that generates identifier strings of relevant passages as the retrieval target.
LinkNER: Linking Local Named Entity Recognition Models to Large Language Models using Uncertainty
Named Entity Recognition (NER) serves as a fundamental task in natural language understanding, bearing direct implications for web content analysis, search engines, and information retrieval systems.
Beyond DAGs: A Latent Partial Causal Model for Multimodal Learning
In this work, we propose a novel latent partial causal model for multimodal data, featuring two latent coupled variables, connected by an undirected edge, to represent the transfer of knowledge across modalities.
Rethinking Propagation for Unsupervised Graph Domain Adaptation
Motivated by our empirical analysis, we reevaluate the role of GNNs in graph domain adaptation and uncover the pivotal role of the propagation process in GNNs for adapting to different graph domains.
PolyTOPS: Reconfigurable and Flexible Polyhedral Scheduler
Different scenarios, depending on the target architecture, compilation environment, and application domain, may require different kinds of optimization to best exploit the architecture feature set.
A Video Coding Method Based on Neural Network for CLIC2024
Meanwhile, the deep learning methods propose a convolutional neural network-based loop filter (CNNLF), which is turned on/off based on the rate-distortion optimization at the CTU and frame level.
GBSS:a global building semantic segmentation dataset for large-scale remote sensing building extraction
Semantic segmentation techniques for extracting building footprints from high-resolution remote sensing images have been widely used in many fields such as urban planning.
Coreference Graph Guidance for Mind-Map Generation
Then we employ a coreference graph encoder to mine the potential governing relations between sentences.
CLAP: Isolating Content from Style through Contrastive Learning with Augmented Prompts
To address this limitation, we adopt a causal generative perspective for multimodal data and propose contrastive learning with data augmentation to disentangle content features from the original representations.
Identifiable Latent Polynomial Causal Models Through the Lens of Change
However, this progress rests on the assumption that the causal relationships among latent causal variables adhere strictly to linear Gaussian models.
Interactive Navigation in Environments with Traversable Obstacles Using Large Language and Vision-Language Models
This paper proposes an interactive navigation framework by using large language and vision-language models, allowing robots to navigate in environments with traversable obstacles.
EX-Graph: A Pioneering Dataset Bridging Ethereum and X
While numerous public blockchain datasets are available, their utility is constrained by an exclusive focus on blockchain data.
Oobleck: Resilient Distributed Training of Large Models Using Pipeline Templates
Oobleck enables resilient distributed training of large DNN models with guaranteed fault tolerance.
RADE: Reference-Assisted Dialogue Evaluation for Open-Domain Dialogue
To this end, we propose the Reference-Assisted Dialogue Evaluation (RADE) approach under the multi-task learning framework, which leverages the pre-created utterance as reference other than the gold response to relief the one-to-many problem.
CFDBench: A Large-Scale Benchmark for Machine Learning Methods in Fluid Dynamics
Appropriate modifications were made to apply popular deep neural networks to CFDBench and enable the accommodation of more changing inputs.
Depth analysis of battery performance based on a data-driven approach
Capacity attenuation is one of the most intractable issues in the current of application of the cells.
Factor Graph Neural Networks
In recent years, we have witnessed a surge of Graph Neural Networks (GNNs), most of which can learn powerful representations in an end-to-end fashion with great success in many real-world applications.
Discovering a reaction-diffusion model for Alzheimer's disease by combining PINNs with symbolic regression
Specifically, we integrate physics informed neural networks (PINNs) and symbolic regression to discover a reaction-diffusion type partial differential equation for tau protein misfolding and spreading.
Certified Robustness for Large Language Models with Self-Denoising
This largely falls into the study of certified robust LLMs, i. e., all predictions of LLM are certified to be correct in a local region around the input.
OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models
The scale of large pre-trained models (PTMs) poses significant challenges in adapting to downstream tasks due to the high optimization overhead and storage costs associated with full-parameter fine-tuning.
Uncertainty in Natural Language Processing: Sources, Quantification, and Applications
Therefore, in this survey, we provide a comprehensive review of uncertainty-relevant works in the NLP field.
DataAI-6G: A System Parameters Configurable Channel Dataset for AI-6G Research
A common and accurate dataset is essential for the research of AI communication.
Uncertainty-Aware Unlikelihood Learning Improves Generative Aspect Sentiment Quad Prediction
We further propose marginalized unlikelihood learning to suppress the uncertainty-aware mistake tokens.
E-NER: Evidential Deep Learning for Trustworthy Named Entity Recognition
Most named entity recognition (NER) systems focus on improving model performance, ignoring the need to quantify model uncertainty, which is critical to the reliability of NER systems in open environments.
RobustFair: Adversarial Evaluation through Fairness Confusion Directed Gradient Search
This matrix categorizes predictions as true fair, true biased, false fair, and false biased, and the perturbations guided by it can produce a dual impact on instances and their similar counterparts to either undermine prediction accuracy (robustness) or cause biased predictions (individual fairness).
Parameter-Efficient Cross-lingual Transfer of Vision and Language Models via Translation-based Alignment
Extensive experiments on XTD and Multi30K datasets, covering 11 languages under zero-shot, few-shot, and full-dataset learning scenarios, show that our framework significantly reduces the multilingual disparities among languages and improves cross-lingual transfer results, especially in low-resource scenarios, while only keeping and fine-tuning an extremely small number of parameters compared to the full model (e. g., Our framework only requires 0. 16\% additional parameters of a full-model for each language in the few-shot learning scenario).
Tool Learning with Foundation Models
Considering the lack of a systematic tool learning evaluation in prior works, we experiment with 18 representative tools and show the potential of current foundation models in skillfully utilizing tools.
A robust design of time-varying internal model principle-based control for ultra-precision tracking in a direct-drive servo stage
By means of the ESO feedback, the plant model is kept as nominal, and hence the structural robustness is achieved for the time-varying internal model.
BERT4ETH: A Pre-trained Transformer for Ethereum Fraud Detection
As various forms of fraud proliferate on Ethereum, it is imperative to safeguard against these malicious activities to protect susceptible users from being victimized.
Multi-pooling 3D Convolutional Neural Network for fMRI Classification of Visual Brain States
Neural decoding of visual object classification via functional magnetic resonance imaging (fMRI) data is challenging and is vital to understand underlying brain mechanisms.
Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training
Specifically, Slapo works on a PyTorch model and uses a set of schedule primitives to convert the model for common model training optimizations such as high-performance kernels, effective 3D parallelism, and efficient activation checkpointing.
Cost-minimization predictive energy management of a postal-delivery fuel cell electric vehicle with intelligent battery State-of-Charge Planner
Fuel cell electric vehicles have earned substantial attentions in recent decades due to their high-efficiency and zero-emission features, while the high operating costs remain the major barrier towards their large-scale commercialization.
Sparse Structure Search for Delta Tuning
Generally, DT methods exquisitely design delta modules (DT modules) which could be applied to arbitrary fine-grained positions inside PTMs.
Uncertainty Sentence Sampling by Virtual Adversarial Perturbation
Active learning for sentence understanding attempts to reduce the annotation cost by identifying the most informative examples.
How to Define the Propagation Environment Semantics and Its Application in Scatterer-Based Beam Prediction
Inspired by task-oriented semantic communication and machine learning (ML) powered environment-channel mapping methods, this work aims to provide a new view of the environment from the semantic level, which defines the propagation environment semantics (PES) as a limited set of propagation environment semantic symbols (PESS) for diverse application tasks.
Latent Covariate Shift: Unlocking Partial Identifiability for Multi-Source Domain Adaptation
Within this new paradigm, we present an intricate causal generative model by introducing latent noises across domains, along with a latent content variable and a latent style variable to achieve more nuanced rendering of observational data.
Truncated Matrix Power Iteration for Differentiable DAG Learning
Recovering underlying Directed Acyclic Graph (DAG) structures from observational data is highly challenging due to the combinatorial nature of the DAG-constrained optimization problem.
Identifying Weight-Variant Latent Causal Models
The task of causal representation learning aims to uncover latent higher-level causal representations that affect lower-level observations.
Sparse Structure Search for Parameter-Efficient Tuning
The searched structures preserve more than 99\% fine-tuning performance with 0. 01\% trainable parameters.
RMT-Net: Reject-aware Multi-Task Network for Modeling Missing-not-at-random Data in Financial Credit Scoring
Accordingly, we for the first time propose to model the biased credit scoring data with Multi-Task Learning (MTL).
NTIRE 2022 Challenge on High Dynamic Range Imaging: Methods and Results
The challenge is composed of two tracks with an emphasis on fidelity and complexity constraints: In Track 1, participants are asked to optimize objective fidelity scores while imposing a low-complexity constraint (i. e. solutions can not exceed a given number of operations).
MolMiner: You only look once for chemical structure recognition
Due to a backlog of decades and an increasing amount of these printed literature, there is a high demand for the translation of printed depictions into machine-readable formats, which is known as Optical Chemical Structure Recognition (OCSR).
Adversarial Training-Aided Time-Varying Channel Prediction for TDD/FDD Systems
In this paper, a time-varying channel prediction method based on conditional generative adversarial network (CPcGAN) is proposed for time division duplexing/frequency division duplexing (TDD/FDD) systems.
Sequence-Based Target Coin Prediction for Cryptocurrency Pump-and-Dump
With the proliferation of pump-and-dump schemes (P&Ds) in the cryptocurrency market, it becomes imperative to detect such fraudulent activities in advance to alert potentially susceptible investors.
Enhanced Contour Tracking: a Time-Varying Internal Model Principle-Based Approach
The proposed TV-IMCC is twofold, including an extended position domain framework with master-slave structures for contour regulation, and a time-varying internal model principle-based controller for each axial tracking precision improvement.
Systems Biology: Identifiability analysis and parameter identification via systems-biology informed neural networks
The dynamics of systems biological processes are usually modeled by a system of ordinary differential equations (ODEs) with many unknown parameters that need to be inferred from noisy and sparse measurements.
SympOCnet: Solving optimal control problems with applications to high-dimensional multi-agent path planning problems
Solving high-dimensional optimal control problems in real-time is an important but challenging problem, with applications to multi-agent path planning problems, which have drawn increased attention given the growing popularity of drones in recent years.
MyoPS: A Benchmark of Myocardial Pathology Segmentation Combining Three-Sequence Cardiac Magnetic Resonance Images
Assessment of myocardial viability is essential in diagnosis and treatment management of patients suffering from myocardial infarction, and classification of pathology on myocardium is the key to this assessment.
GFINNs: GENERIC Formalism Informed Neural Networks for Deterministic and Stochastic Dynamical Systems
We propose the GENERIC formalism informed neural networks (GFINNs) that obey the symmetric degeneracy conditions of the GENERIC formalism.
Adaptive Optimizers with Sparse Group Lasso for Neural Networks in CTR Prediction
We develop a novel framework that adds the regularizers of the sparse group lasso to a family of adaptive optimizers in deep learning, such as Momentum, Adagrad, Adam, AMSGrad, AdaHessian, and create a new class of optimizers, which are named Group Momentum, Group Adagrad, Group Adam, Group AMSGrad and Group AdaHessian, etc., accordingly.
Uncertainty-Guided Mixup for Semi-Supervised Domain Adaptation without Source Data
Present domain adaptation methods usually perform explicit representation alignment by simultaneously accessing the source data and target data.
Semi-Supervised Hypothesis Transfer for Source-Free Domain Adaptation
Domain Adaptation has been widely used to deal with the distribution shift in vision, language, multimedia etc.
Automatic Pulmonary Artery-Vein Separation in CT Images using Twin-Pipe Network and Topology Reconstruction
We propose a novel method for automatic separation of pulmonary arteries and veins from chest CT images.
Adaptive Optimizers with Sparse Group Lasso
We develop a novel framework that adds the regularizers to a family of adaptive optimizers in deep learning, such as MOMENTUM, ADAGRAD, ADAM, AMSGRAD, ADAHESSIAN, and create a new class of optimizers, which are named GROUP MOMENTUM, GROUP ADAGRAD, GROUP ADAM, GROUP AMSGRAD and GROUP ADAHESSIAN, etc., accordingly.
Market Impact in Trader-Agents: Adding Multi-Level Order-Flow Imbalance-Sensitivity to Automated Trading Systems
We demonstrate that the new imbalance-sensitive trader-agents introduced here do exhibit market impact effects, and hence are better-suited to operating in markets where impact is a factor of concern or interest, but do not suffer the weaknesses of the methods used by Church & Cliff.
Learning Poisson systems and trajectories of autonomous systems via Poisson neural networks
We propose the Poisson neural networks (PNNs) to learn Poisson systems and trajectories of autonomous systems from data.
Cyclic Label Propagation for Graph Semi-supervised Learning
To overcome these limitations, we introduce a novel framework for graph semi-supervised learning termed as Cyclic Label Propagation (CycProp for abbreviation), which integrates GNNs into the process of label propagation in a cyclic and mutually reinforcing manner to exploit the advantages of both GNNs and LPA.
Deep Reinforcement Learning of Transition States
Combining reinforcement learning (RL) and molecular dynamics (MD) simulations, we propose a machine-learning approach (RL$^\ddag$) to automatically unravel chemical reaction mechanisms.
CL-MAPF: Multi-Agent Path Finding for Car-Like Robots with Kinematic and Spatiotemporal Constraints
In this paper, we give a mathematical formalization of Multi-Agent Path Finding for Car-Like robots (CL-MAPF) problem.
Robotics Multiagent Systems
Brain Tumor Segmentation Network Using Attention-based Fusion and Spatial Relationship Constraint
Considering that multi-modal MR images can reflect different tumor biological properties, we develop a novel multi-modal tumor segmentation network (MMTSN) to robustly segment brain tumors based on multi-modal MR images.
Kagome quantum anomalous Hall effect with high Chern number and large band gap
For the bilayer compound Co6Sn5Se4, it becomes a half-metal, with a relatively flat plateau in its anomalous Hall conductivity corresponding to |C| = 3 near the Fermi level.
Materials Science
Multi-Modality Pathology Segmentation Framework: Application to Cardiac Magnetic Resonance Images
The PRSN is designed to segment pathological region based on the result of ASSN, in which a fusion block based on channel attention is proposed to better aggregate multi-modality information from multi-modality CMR images.
Distributed Linguistic Representations in Decision Making: Taxonomy, Key Elements and Applications, and Challenges in Data Science and Explainable Artificial Intelligence
Distributed linguistic representations are powerful tools for modelling the uncertainty and complexity of preference information in linguistic decision making.
FADACS: A Few-shot Adversarial Domain Adaptation Architecture for Context-Aware Parking Availability Sensing
We quantify the strength of our proposed framework in different cases and compare it to the existing data-driven approaches.
Is Network the Bottleneck of Distributed Training?
As such, we advocate that the real challenge of distributed training is for the network community to develop high-performance network transport to fully utilize the network capacity and achieve linear scale-out.
Time-Stretched Femtosecond Lidar Using Microwave Photonic Signal Processing
After that, the frequency variation of the microwave pulse is uploaded to the first order sidebands.
A Perspective on Deep Learning for Molecular Modeling and Simulations
Deep learning is transforming many areas in science, and it has great potential in modeling molecular systems.
Adaptive-Step Graph Meta-Learner for Few-Shot Graph Classification
The shared sub-structures between training classes and test classes are essential in few-shot graph classification.
Multiplicative Gaussian Particle Filter
We propose a new sampling-based approach for approximate inference in filtering problems.
SympNets: Intrinsic structure-preserving symplectic networks for identifying Hamiltonian systems
We propose new symplectic networks (SympNets) for identifying Hamiltonian systems from data based on a composition of linear, activation and gradient modules.
Scalable Global Alignment Graph Kernel Using Random Features: From Node Embedding to Graph Embedding
In particular, RGE is shown to achieve \emph{(quasi-)linear scalability} with respect to the number and the size of the graphs.
KerGM: Kernelized Graph Matching
Graph matching plays a central role in such fields as computer vision, pattern recognition, and bioinformatics.
Visual Relationship Detection with Low Rank Non-Negative Tensor Decomposition
We address the problem of Visual Relationship Detection (VRD) which aims to describe the relationships between pairs of objects in the form of triplets of (subject, predicate, object).
Hierarchical Graph Pooling with Structure Learning
HGP-SL incorporates graph pooling and structure learning into a unified module to generate hierarchical representations of graphs.
Ranked #1 on
Graph Classification
on PROTEINS
Deep Graphical Feature Learning for the Feature Matching Problem
Rich local representation is a key part of efficient feature matching methods.
Learning Clustered Representation for Complex Free Energy Landscapes
In this paper we first analyzed the inductive bias underlying the data scattered across complex free energy landscapes (FEL), and exploited it to train deep neural networks which yield reduced and clustered representation for the FEL.
Factor Graph Neural Network
Most of the successful deep neural network architectures are structured, often consisting of elements like convolutional neural networks and gated recurrent neural networks.
phq: a Fortran code to compute phonon quasiparticle properties and dispersions
We here introduce a Fortran code that computes anharmonic free energy of solids from first-principles based on our phonon quasiparticle approach.
Materials Science
RetGK: Graph Kernels based on Return Probabilities of Random Walks
Graph-structured data arise in wide applications, such as computer vision, bioinformatics, and social networks.
Aligning Infinite-Dimensional Covariance Matrices in Reproducing Kernel Hilbert Spaces for Domain Adaptation
Domain shift, which occurs when there is a mismatch between the distributions of training (source) and testing (target) datasets, usually results in poor performance of the trained model on the target domain.
Convolutional Sequence to Sequence Model for Human Dynamics
Human motion modeling is a classic problem in computer vision and graphics.
OmicsMapNet: Transforming omics data to take advantage of Deep Convolutional Neural Network for discovery
We developed OmicsMapNet approach to take advantage of existing deep leaning frameworks to analyze high-dimensional omics data as 2-dimensional images.
Learning Deep Gradient Descent Optimization for Image Deconvolution
Extensive experiments on synthetic benchmarks and challenging real-world images demonstrate that the proposed deep optimization method is effective and robust to produce favorable results as well as practical for real-world image deblurring applications.
Depth and Image Restoration From Light Field in a Scattering Medium
First, we present a new single image restoration algorithm which removes backscatter and attenuation from images better than existing methods, and apply it to each view in the light field.
Pairwise Matching Through Max-Weight Bipartite Belief Propagation
Feature matching is a key problem in computer vision and pattern recognition.
Joint Probabilistic Matching Using m-Best Solutions
Matching between two sets of objects is typically approached by finding the object pairs that collectively maximize the joint matching score.
Joint Probabilistic Data Association Revisited
In this paper, we revisit the joint probabilistic data association (JPDA) technique and propose a novel solution based on recent developments in finding the m-best solutions to an integer linear program.
Learning Graph Structure for Multi-Label Image Classification via Clique Generation
Exploiting label dependency for multi-label image classification can significantly improve classification performance.
Managing Multi-Granular Linguistic Distribution Assessments in Large-Scale Multi-Attribute Group Decision Making
Linguistic large-scale group decision making (LGDM) problems are more and more common nowadays.
Constraint Reduction using Marginal Polytope Diagrams for MAP LP Relaxations
We show that using Marginal Polytope Diagrams allows the number of constraints to be reduced without loosening the LP relaxations.
A feasible roadmap for unsupervised deconvolution of two-source mixed gene expressions
Tissue heterogeneity is a major confounding factor in studying individual populations that cannot be resolved directly by global profiling.
