Finish NN Design, NN Applications




CS256

Chris Pollett

Dec 4, 2017

Outline

Introduction

Debugging NNs

Common Debugging Strategies

Street Map Example Revisited

Quiz

Which of the following is true?

  1. LSTMs have forget components/gates.
  2. Clipping the gradient by norm is the easiest to compute form of gradient clipping under all performance measures.
  3. Increasing the learning rate of your neural net always increases its effective capacity.

Applications

Infrastructure for Deep Learning

GPU Implementations

Distributed Implementations

Model Compression

Computer Vision

Preprocessing