Search Results for author: Pekka Marttinen

Found 38 papers, 12 papers with code

Improving Medical Multi-modal Contrastive Learning with Expert Annotations

no code implementations15 Mar 2024 Yogesh Kumar, Pekka Marttinen

We introduce eCLIP, an enhanced version of the CLIP model that integrates expert annotations in the form of radiologist eye-gaze heatmaps.

Contrastive Learning Cross-Modal Retrieval +3

Mixture of Coupled HMMs for Robust Modeling of Multivariate Healthcare Time Series

1 code implementation14 Nov 2023 Onur Poyraz, Pekka Marttinen

Experiments on challenging real-world epidemiological and semi-synthetic data demonstrate the advantages of the M-CHMM: improved data fit, capacity to efficiently handle missing and noisy measurements, improved prediction accuracy, and ability to identify interpretable subsets in the data.

Time Series

Nonparametric modeling of the composite effect of multiple nutrients on blood glucose dynamics

1 code implementation6 Nov 2023 Arina Odnoblyudova, Çağlar Hızlı, ST John, Andrea Cognolato, Anne Juuti, Simo Särkkä, Kirsi Pietiläinen, Pekka Marttinen

By differentiating treatment components, incorporating their dosages, and sharing statistical information across patients via a hierarchical multi-output Gaussian process, our method improves prediction accuracy over existing approaches, and allows us to interpret the different effects of carbohydrates and fat on the overall glucose response.

Content Reduction, Surprisal and Information Density Estimation for Long Documents

no code implementations12 Sep 2023 Shaoxiong Ji, Wei Sun, Pekka Marttinen

We consider two interesting research questions: 1) how is information distributed over long documents, and 2) how does content reduction, such as token selection and text summarization, affect the information density in long documents.

Density Estimation Text Summarization

Identifiable causal inference with noisy treatment and no side information

no code implementations18 Jun 2023 Antti Pöllänen, Pekka Marttinen

Building on existing results for measurement error models, we prove that our model's causal effect estimates are identifiable, even without knowledge of the measurement error variance or other side information.

Causal Inference Econometrics +1

SITReg: Multi-resolution architecture for symmetric, inverse consistent, and topology preserving image registration

1 code implementation17 Mar 2023 Joel Honkamaa, Pekka Marttinen

Deep learning has emerged as a strong alternative for classical iterative methods for deformable medical image registration, where the goal is to find a mapping between the coordinate systems of two images.

Deformable Medical Image Registration Image Registration +1

Causal Modeling of Policy Interventions From Sequences of Treatments and Outcomes

no code implementations9 Sep 2022 Çağlar Hızlı, ST John, Anne Juuti, Tuure Saarinen, Kirsi Pietiläinen, Pekka Marttinen

Our model enables the estimation of a treatment policy from observational sequences of treatments and outcomes, and it can predict the interventional and counterfactual progression of the outcome after an intervention on the treatment policy (in contrast with the causal effect of a single treatment).

counterfactual Decision Making +3

Incorporating functional summary information in Bayesian neural networks using a Dirichlet process likelihood approach

1 code implementation4 Jul 2022 Vishnu Raj, Tianyu Cui, Markus Heinonen, Pekka Marttinen

We present a simple approach to incorporate prior knowledge in BNNs based on external summary information about the predicted classification probabilities for a given dataset.

Variational Inference

EEG based Emotion Recognition: A Tutorial and Review

no code implementations16 Mar 2022 Xiang Li, Yazhou Zhang, Prayag Tiwari, Dawei Song, Bin Hu, Meihong Yang, Zhigang Zhao, Neeraj Kumar, Pekka Marttinen

Hence, in this paper, we review from the perspective of researchers who try to take the first step on this topic.

EEG Emotion Recognition

Deconfounded Representation Similarity for Comparison of Neural Networks

no code implementations31 Jan 2022 Tianyu Cui, Yogesh Kumar, Pekka Marttinen, Samuel Kaski

Similarity metrics such as representational similarity analysis (RSA) and centered kernel alignment (CKA) have been used to compare layer-wise representations between neural networks.

Transfer Learning

A Unified Review of Deep Learning for Automated Medical Coding

no code implementations8 Jan 2022 Shaoxiong Ji, Wei Sun, Xiaobo Li, Hang Dong, Ara Taalas, Yijia Zhang, Honghan Wu, Esa Pitkänen, Pekka Marttinen

Automated medical coding, an essential task for healthcare operation and delivery, makes unstructured data manageable by predicting medical codes from clinical documents.

Patient Outcome and Zero-shot Diagnosis Prediction with Hypernetwork-guided Multitask Learning

no code implementations7 Sep 2021 Shaoxiong Ji, Pekka Marttinen

Multitask deep learning has been applied to patient outcome prediction from text, taking clinical notes as input and training deep neural networks with a joint loss function of multiple tasks.

Multitask Balanced and Recalibrated Network for Medical Code Prediction

2 code implementations6 Sep 2021 Wei Sun, Shaoxiong Ji, Erik Cambria, Pekka Marttinen

Nevertheless, automated medical coding is still challenging because of the imbalanced class problem, complex code association, and noise in lengthy documents.

Medical Code Prediction Multi-Task Learning

SANSformers: Self-Supervised Forecasting in Electronic Health Records with Attention-Free Models

no code implementations31 Aug 2021 Yogesh Kumar, Alexander Ilin, Henri Salo, Sangita Kulathinal, Maarit K. Leinonen, Pekka Marttinen

Despite the proven effectiveness of Transformer neural networks across multiple domains, their performance with Electronic Health Records (EHR) can be nuanced.

Multi-Task Learning

Deep Learning for Depression Recognition with Audiovisual Cues: A Review

no code implementations27 May 2021 Lang He, MingYue Niu, Prayag Tiwari, Pekka Marttinen, Rui Su, Jiewei Jiang, Chenguang Guo, Hongyu Wang, Songtao Ding, Zhongmin Wang, Wei Dang, Xiaoying Pan

Consequently, to improve current medical care, many scholars have used deep learning to extract a representation of depression cues in audio and video for automatic depression detection.

Depression Detection

Multitask Recalibrated Aggregation Network for Medical Code Prediction

1 code implementation2 Apr 2021 Wei Sun, Shaoxiong Ji, Erik Cambria, Pekka Marttinen

Medical coding translates professionally written medical reports into standardized codes, which is an essential part of medical information systems and health insurance reimbursement.

Medical Code Prediction Representation Learning

Does the Magic of BERT Apply to Medical Code Assignment? A Quantitative Study

no code implementations11 Mar 2021 Shaoxiong Ji, Matti Hölttä, Pekka Marttinen

In the clinical application of medical code assignment, diagnosis and procedure codes are inferred from lengthy clinical notes such as hospital discharge summaries.

Medical Code Prediction Transfer Learning

A Critical Look at the Consistency of Causal Estimation With Deep Latent Variable Models

no code implementations NeurIPS 2021 Severi Rissanen, Pekka Marttinen

Using deep latent variable models in causal inference has attracted considerable interest recently, but an essential open question is their ability to yield consistent causal estimates.

Causal Inference Open-Ended Question Answering

Medical Code Assignment with Gated Convolution and Note-Code Interaction

no code implementations Findings (ACL) 2021 Shaoxiong Ji, Shirui Pan, Pekka Marttinen

However, these methods are still ineffective as they do not fully encode and capture the lengthy and rich semantic information of medical notes nor explicitly exploit the interactions between the notes and codes.

Management

Dilated Convolutional Attention Network for Medical Code Assignment from Clinical Text

no code implementations EMNLP (ClinicalNLP) 2020 Shaoxiong Ji, Erik Cambria, Pekka Marttinen

Medical code assignment, which predicts medical codes from clinical texts, is a fundamental task of intelligent medical information systems.

Informative Bayesian Neural Network Priors for Weak Signals

no code implementations24 Feb 2020 Tianyu Cui, Aki Havulinna, Pekka Marttinen, Samuel Kaski

Encoding domain knowledge into the prior over the high-dimensional weight space of a neural network is challenging but essential in applications with limited data and weak signals.

A Survey on Knowledge Graphs: Representation, Acquisition and Applications

1 code implementation2 Feb 2020 Shaoxiong Ji, Shirui Pan, Erik Cambria, Pekka Marttinen, Philip S. Yu

In this survey, we provide a comprehensive review of knowledge graph covering overall research topics about 1) knowledge graph representation learning, 2) knowledge acquisition and completion, 3) temporal knowledge graph, and 4) knowledge-aware applications, and summarize recent breakthroughs and perspective directions to facilitate future research.

Knowledge Graph Embedding Relational Reasoning +1

Errors-in-variables Modeling of Personalized Treatment-Response Trajectories

1 code implementation10 Jun 2019 Guangyi Zhang, Reza Ashrafi, Anne Juuti, Kirsi Pietiläinen, Pekka Marttinen

Estimating the effect of a treatment on a given outcome, conditioned on a vector of covariates, is central in many applications.

Learning Global Pairwise Interactions with Bayesian Neural Networks

1 code implementation24 Jan 2019 Tianyu Cui, Pekka Marttinen, Samuel Kaski

Estimating global pairwise interaction effects, i. e., the difference between the joint effect and the sum of marginal effects of two input features, with uncertainty properly quantified, is centrally important in science applications.

A Bayesian model of acquisition and clearance of bacterial colonization

no code implementations27 Nov 2018 Marko Järvenpää, Mohamad R. Abdul Sater, Georgia K. Lagoudas, Paul C. Blainey, Loren G. Miller, James A. McKinnell, Susan S. Huang, Yonatan H. Grad, Pekka Marttinen

Bacterial populations that colonize a host play important roles in host health, including serving as a reservoir that transmits to other hosts and from which invasive strains emerge, thus emphasizing the importance of understanding rates of acquisition and clearance of colonizing populations.

Efficient acquisition rules for model-based approximate Bayesian computation

no code implementations3 Apr 2017 Marko Järvenpää, Michael U. Gutmann, Arijus Pleska, Aki Vehtari, Pekka Marttinen

We propose to compute the uncertainty in the ABC posterior density, which is due to a lack of simulations to estimate this quantity accurately, and define a loss function that measures this uncertainty.

Bayesian Inference Bayesian Optimisation +1

Gaussian process modeling in approximate Bayesian computation to estimate horizontal gene transfer in bacteria

no code implementations20 Oct 2016 Marko Järvenpää, Michael Gutmann, Aki Vehtari, Pekka Marttinen

Approximate Bayesian computation (ABC) can be used for model fitting when the likelihood function is intractable but simulating from the model is feasible.

Model Selection

Multiple Output Regression with Latent Noise

no code implementations27 Oct 2014 Jussi Gillberg, Pekka Marttinen, Matti Pirinen, Antti J. Kangas, Pasi Soininen, Mehreen Ali, Aki S. Havulinna, Marjo-Riitta Marjo-Riitta Järvelin, Mika Ala-Korpela, Samuel Kaski

In high-dimensional data, structured noise caused by observed and unobserved factors affecting multiple target variables simultaneously, imposes a serious challenge for modeling, by masking the often weak signal.

regression Time Series +1

Bayesian Information Sharing Between Noise And Regression Models Improves Prediction of Weak Effects

no code implementations16 Oct 2013 Jussi Gillberg, Pekka Marttinen, Matti Pirinen, Antti J. Kangas, Pasi Soininen, Marjo-Riitta Järvelin, Mika Ala-Korpela, Samuel Kaski

To facilitate the prediction of the weak effects, we constrain our model structure by introducing a novel Bayesian approach of sharing information between the regression model and the noise model.

regression

Cannot find the paper you are looking for? You can Submit a new open access paper.