Search Results for author: Cosma Rohilla Shalizi

Found 11 papers, 4 papers with code

Conditional Mutual Information Estimation for Mixed Discrete and Continuous Variables with Nearest Neighbors

1 code implementation6 Dec 2019 Octavio César Mesner, Cosma Rohilla Shalizi

One reason conditional mutual information is not more widely used for these tasks is the lack of estimators which can handle combinations of continuous and discrete random variables, common in applications.

Statistics Theory Methodology Statistics Theory

The LICORS Cabinet: Nonparametric Algorithms for Spatio-temporal Prediction

no code implementations8 Jun 2015 George D. Montanez, Cosma Rohilla Shalizi

Spatio-temporal data is intrinsically high dimensional, so unsupervised modeling is only feasible if we can exploit structure in the process.

Predictive PAC Learning and Process Decompositions

no code implementations NeurIPS 2013 Cosma Rohilla Shalizi, Aryeh Kontorovich

We informally call a stochastic process learnable if it admits a generalization error approaching zero in probability for any concept class with finite VC-dimension (IID processes are the simplest example).

PAC learning

Mixed LICORS: A Nonparametric Algorithm for Predictive State Reconstruction

no code implementations15 Nov 2012 Georg M. Goerg, Cosma Rohilla Shalizi

We introduce 'mixed LICORS', an algorithm for learning nonlinear, high-dimensional dynamics from spatio-temporal data, suitable for both prediction and simulation.

Clustering

Model Selection for Degree-corrected Block Models

no code implementations17 Jul 2012 Xiaoran Yan, Cosma Rohilla Shalizi, Jacob E. Jensen, Florent Krzakala, Cristopher Moore, Lenka Zdeborova, Pan Zhang, Yaojia Zhu

We present the first principled and tractable approach to model selection between standard and degree-corrected block models, based on new large-graph asymptotics for the distribution of log-likelihood ratios under the stochastic block model, finding substantial departures from classical results for sparse graphs.

Model Selection Stochastic Block Model

Rademacher complexity of stationary sequences

no code implementations3 Jun 2011 Daniel J. McDonald, Cosma Rohilla Shalizi

We show how to control the generalization error of time series models wherein past values of the outcome are used to predict future values.

Time Series Time Series Analysis

Power-law distributions in empirical data

7 code implementations7 Jun 2007 Aaron Clauset, Cosma Rohilla Shalizi, M. E. J. Newman

Power-law distributions occur in many situations of scientific interest and have significant consequences for our understanding of natural and man-made phenomena.

Data Analysis, Statistics and Probability Disordered Systems and Neural Networks Applications Methodology

Blind Construction of Optimal Nonlinear Recursive Predictors for Discrete Sequences

2 code implementations6 Jun 2004 Cosma Rohilla Shalizi, Kristina Lisa Shalizi

We present a new method for nonlinear prediction of discrete random sequences under minimal structural assumptions.

Methods and Techniques of Complex Systems Science: An Overview

no code implementations9 Jul 2003 Cosma Rohilla Shalizi

In this chapter, I review the main methods and techniques of complex systems science.

Adaptation and Self-Organizing Systems Statistical Mechanics Chaotic Dynamics Cellular Automata and Lattice Gases Data Analysis, Statistics and Probability Quantitative Methods

Cannot find the paper you are looking for? You can Submit a new open access paper.