Tight Analyses for Non-Smooth Stochastic Gradient Descent
- Nicholas J. A. HarveyChristopher LiawY. PlanSikander Randhawa
- 1 December 2018
Mathematics
It is proved that after $T$ steps of stochastic gradient descent, the error of the final iterate is $O(\log(T)/T)$ with high probability, and there exists a function from this class for which the errors of the last iterate of deterministic gradient descent is $\Omega(\log (T)/\sqrt{T})$.
Approximating submodular functions everywhere
- M. GoemansNicholas J. A. HarveyS. IwataV. Mirrokni
- 4 January 2009
Mathematics, Computer Science
The problem of approximating a non-negative, monotone, submodular function f on a ground set of size n everywhere is considered, after only poly(n) oracle queries, and it is shown that no algorithm can achieve a factor better than Ω(√n/log n), even for rank functions of a matroid.
Semi-matchings for bipartite graphs and load balancing
- Nicholas J. A. HarveyRichard E. LadnerL. LovászTami Tamir
- 30 July 2003
Computer Science, Mathematics
J. Algorithms
On the capacity of information networks
- Nicholas J. A. HarveyRobert D. KleinbergA. Lehman
- 1 June 2006
Computer Science, Mathematics
An outer bound on the rate region of noise-free information networks is given and it is shown that multicommodity flow solutions achieve the capacity in an infinite class of undirected graphs, thereby making progress on a conjecture of Li and Li.
An Algorithmic Proof of the Lovasz Local Lemma via Resampling Oracles
- Nicholas J. A. HarveyJ. Vondrák
- 8 April 2015
Computer Science, Mathematics
It is shown that, in all scenarios to which the original Lovasz Local Lemma applies, there exist resampling oracles, although they are not necessarily efficient, and for essentially all known applications of the LovasZ Local LemMA and its generalizations, these oracles are designed.
Non-Adaptive Fault Diagnosis for All-Optical Networks via Combinatorial Group Testing on Graphs
- Nicholas J. A. HarveyM. PatrascuYonggang WenS. YekhaninV. Chan
- 1 May 2007
Computer Science, Engineering
IEEE INFOCOM 2007 - 26th IEEE International…
This work considers the problem of detecting failures for all-optical networks, and considers a non-adaptive approach where all the probes are sent in parallel, to minimize the number of parallel probes, so as to keep network cost low.
Deterministic network coding by matrix completion
- Nicholas J. A. HarveyDavid R KargerK. Murota
- 23 January 2005
Computer Science
A new deterministic algorithm to construct network codes for multicast problems, a particular class of network information ow problems, based on a new algorithm for maximum-rank completion of mixed matrices, which is faster than existing deterministic algorithms and can operate over a smaller field.
Learning submodular functions
- Maria-Florina BalcanNicholas J. A. Harvey
- 12 August 2010
Computer Science, Mathematics
ECML/PKDD
To prove the general lower bound of Omega(n1/3), a surprising Omega(n1/3) lower bound is provided based on a new interesting class of matroids based on lossless expanders which can take wildly varying rank values on superpolynomially many sets; no such construction was previously known.
Algebraic Algorithms for Matching and Matroid Problems
- Nicholas J. A. Harvey
- 1 June 2009
Mathematics
SIAM journal on computing (Print)
New algebraic approaches for two well-known combinatorial problems: nonbipartite matching and matroid intersection are presented and new randomized algorithms that exceed or match the efficiency of existing algorithms are yielded.
Sketching and Streaming Entropy via Approximation Theory
- Nicholas J. A. HarveyJelani NelsonKrzysztof Onak
- 25 April 2008
Computer Science, Mathematics
2008 49th Annual IEEE Symposium on Foundations of…
This work gives near-optimal sketching and streaming algorithms for estimating Shannon entropy in the most general streaming model, with arbitrary insertions and deletions, and yields the best-known and near-Optimal additive approximations for entropy, and hence also for conditional entropy and mutual information.
...
...