Codes and Expansions (CodEx) Seminar

Sinan Gunturk (New York University)
Approximation with one-bit polynomials and one-bit neural networks

In the first part of this talk, we will show how any continuous function \(f:[0,1]\rightarrow[-1,1]\) can be approximated arbitrarily well on \((0,1)\) by polynomials with \(\{+1,-1\}\)-coefficients in the Bernstein basis, providing quantitative bounds on the degree of their approximation. In the second part of the talk, we will extend our method to the multivariate setting. We will also show how these multivariate polynomial approximants can be realized by means of neural networks whose parameters are chosen from the set \(\{+1,-1\}\) only.

Joint work with Weilin Li. Preprints available at arXiv:2112.09183 and arXiv:2112.09181.