Search Results for author: Frank Cwitkowitz

Found 9 papers, 7 papers with code

Toward Fully Self-Supervised Multi-Pitch Estimation

1 code implementation23 Feb 2024 Frank Cwitkowitz, Zhiyao Duan

Multi-pitch estimation is a decades-long research problem involving the detection of pitch activity associated with concurrent musical events within multi-instrument mixtures.

Self-Supervised Learning

Timbre-Trap: A Low-Resource Framework for Instrument-Agnostic Music Transcription

no code implementations27 Sep 2023 Frank Cwitkowitz, Kin Wai Cheuk, Woosung Choi, Marco A. Martínez-Ramírez, Keisuke Toyama, Wei-Hsiang Liao, Yuki Mitsufuji

Several works have explored multi-instrument transcription as a means to bolster the performance of models on low-resource tasks, but these methods face the same data availability issues.

Music Transcription

SynthTab: Leveraging Synthesized Data for Guitar Tablature Transcription

no code implementations16 Sep 2023 Yongyi Zang, Yi Zhong, Frank Cwitkowitz, Zhiyao Duan

Guitar Tablature Transcription (GTT) is an important task with broad applications in music education, composition, and entertainment.

Specificity

FretNet: Continuous-Valued Pitch Contour Streaming for Polyphonic Guitar Tablature Transcription

1 code implementation6 Dec 2022 Frank Cwitkowitz, Toni Hirvonen, Anssi Klapuri

In this paper, we present a GTT formulation that estimates continuous-valued pitch contours, grouping them according to their string and fret of origin.

Music Transcription Quantization

A Data-Driven Methodology for Considering Feasibility and Pairwise Likelihood in Deep Learning Based Guitar Tablature Transcription Systems

2 code implementations17 Apr 2022 Frank Cwitkowitz, Jonathan Driedger, Zhiyao Duan

This naturally enforces playability constraints for guitar, and yields tablature which is more consistent with the symbolic data used to estimate pairwise likelihoods.

Information Retrieval Music Information Retrieval +1

Skipping the Frame-Level: Event-Based Piano Transcription With Neural Semi-CRFs

1 code implementation NeurIPS 2021 Yujia Yan, Frank Cwitkowitz, Zhiyao Duan

When formulating piano transcription in this way, we eliminate the need to rely on disjoint frame-level estimates for different stages of a note event.

Multi-Task Learning

A study of the robustness of raw waveform based speaker embeddings under mismatched conditions

1 code implementation8 Oct 2021 Ge Zhu, Frank Cwitkowitz, Zhiyao Duan

In this paper, we conduct a cross-dataset study on parametric and non-parametric raw-waveform based speaker embeddings through speaker verification experiments.

Speaker Verification

Learning Sparse Analytic Filters for Piano Transcription

2 code implementations23 Aug 2021 Frank Cwitkowitz, Mojtaba Heydari, Zhiyao Duan

In this work, several variations of a frontend filterbank learning module are investigated for piano transcription, a challenging low-level music information retrieval task.

Information Retrieval Music Information Retrieval +1

BeatNet: CRNN and Particle Filtering for Online Joint Beat Downbeat and Meter Tracking

4 code implementations8 Aug 2021 Mojtaba Heydari, Frank Cwitkowitz, Zhiyao Duan

The online estimation of rhythmic information, such as beat positions, downbeat positions, and meter, is critical for many real-time music applications.

Online Beat Tracking Online Downbeat Tracking

Cannot find the paper you are looking for? You can Submit a new open access paper.