Search Results for author: Mark Tygert

Found 11 papers, 3 papers with code

Guarantees of confidentiality via Hammersley-Chapman-Robbins bounds

1 code implementation3 Apr 2024 Kamalika Chaudhuri, Chuan Guo, Laurens van der Maaten, Saeed Mahloujifar, Mark Tygert

The HCR bounds appear to be insufficient on their own to guarantee confidentiality of the inputs to inference with standard deep neural nets, "ResNet-18" and "Swin-T," pre-trained on the data set, "ImageNet-1000," which contains 1000 classes.

Image Classification

Metrics of calibration for probabilistic predictions

1 code implementation19 May 2022 Imanol Arrieta-Ibarra, Paman Gujral, Jonathan Tannen, Mark Tygert, Cherie Xu

The canonical reliability diagrams histogram the observed and expected values of the predictions; replacing the hard histogram binning with soft kernel density estimation is another common practice.

Density Estimation

Calibration of P-values for calibration and for deviation of a subpopulation from the full population

1 code implementation31 Jan 2022 Mark Tygert

The author's recent research papers, "Cumulative deviation of a subpopulation from the full population" and "A graphical method of cumulative differences between two subpopulations" (both published in volume 8 of Springer's open-access "Journal of Big Data" during 2021), propose graphical methods and summary statistics, without extensively calibrating formal significance tests.

Mathematical Proofs

An optimizable scalar objective value cannot be objective and should not be the sole objective

no code implementations3 Jun 2020 Isabel Kloumann, Mark Tygert

This paper concerns the ethics and morality of algorithms and computational systems, and has been circulating internally at Facebook for the past couple years.

BIG-bench Machine Learning Ethics

Plots of the cumulative differences between observed and expected values of ordered Bernoulli variates

no code implementations3 Jun 2020 Mark Tygert

The canonical reliability diagrams are based on histogramming the observed and expected values of the predictions; several variants of the standard reliability diagrams propose to replace the hard histogram binning with soft kernel density estimation using smooth convolutional kernels of widths similar to the widths of the bins.

Density Estimation

Secure multiparty computations in floating-point arithmetic

no code implementations9 Jan 2020 Chuan Guo, Awni Hannun, Brian Knott, Laurens van der Maaten, Mark Tygert, Ruiyu Zhu

Secure multiparty computations enable the distribution of so-called shares of sensitive data to multiple parties such that the multiple parties can effectively process the data while being unable to glean much information about the data (at least not without collusion among all parties to put back together all the shares).

Mathematical Proofs Privacy Preserving +1

Regression-aware decompositions

no code implementations11 Oct 2017 Mark Tygert

Linear least-squares regression with a "design" matrix A approximates a given matrix B via minimization of the spectral- or Frobenius-norm discrepancy ||AX-B|| over every conformingly sized matrix X.

Dimensionality Reduction regression

A hierarchical loss and its problems when classifying non-hierarchically

no code implementations1 Sep 2017 Cinna Wu, Mark Tygert, Yann Lecun

We define a metric that, inter alia, can penalize failure to distinguish between a sheepdog and a skyscraper more than failure to distinguish between a sheepdog and a poodle.

General Classification

Poor starting points in machine learning

no code implementations9 Feb 2016 Mark Tygert

Poor (even random) starting points for learning/training/optimization are common in machine learning.

BIG-bench Machine Learning

Convolutional networks and learning invariant to homogeneous multiplicative scalings

no code implementations26 Jun 2015 Mark Tygert, Arthur Szlam, Soumith Chintala, Marc'Aurelio Ranzato, Yuandong Tian, Wojciech Zaremba

The conventional classification schemes -- notably multinomial logistic regression -- used in conjunction with convolutional networks (convnets) are classical in statistics, designed without consideration for the usual coupling with convnets, stochastic gradient descent, and backpropagation.

Classification General Classification +1

A mathematical motivation for complex-valued convolutional networks

no code implementations11 Mar 2015 Joan Bruna, Soumith Chintala, Yann Lecun, Serkan Piantino, Arthur Szlam, Mark Tygert

Courtesy of the exact correspondence, the remarkably rich and rigorous body of mathematical analysis for wavelets applies directly to (complex-valued) convnets.

Cannot find the paper you are looking for? You can Submit a new open access paper.