Change Actions: Models of Generalised Differentiation — mentioned by bmc7505

Mon, 04 Nov 2019 06:27:27 GMT

Thanks for checking out our project! Completely understand where you're coming from, I also struggled with imagining how differentiable programs could work, after all, computer programs implement discrete functions! When building it, I learned two surprising facts: (1) We can perform gradient descent on integer functions! [1] There are rigorous assumptions for differentiability (e.g. Lipschitz-continuity, β-smoothness), but most often, these don't apply in the real world. Although many discrete optimization problems can relaxed to semi-differentiable ones, even if a function is not strictly…

Paper and discussion history. A mention is not an endorsement.

Change Actions: Models of Generalised Differentiation · HackerPapers discussions

Change Actions: Models of Generalised Differentiation — mentioned by bmc7505