zoukankan      html  css  js  c++  java
  • 吴恩达深度学习笔记 第三章测验

    Week 3 Quiz - Shallow Neural Networks

    1. Which of the following are true? (Check all that apply.) Notice that I only list correct options.

      • X is a matrix in which each column is one training example.
      • a^[2]_4 is the activation output by the 4th neuron of the 2nd layer
      • a^[2](12) denotes the activation vector of the 2nd layer for the 12th training example.
      • a^[2] denotes the activation vector of the 2nd layer.
    2. The tanh activation usually works better than sigmoid activation function for hidden units because the mean of its output is closer to zero, and so it centers the data better for the next layer. True/False?

      • [x] True
      • [ ] False

      As seen in lecture the output of the tanh is between -1 and 1, it thus centers the data which makes the learning simpler for the next layer.

    3. Which of these is a correct vectorized implementation of forward propagation for layer l, where 1鈮�鈮�?

      • Z^[l]=W^[l]A^[l−1]+b^[l]
      • A^[l]=g^[l](Z^[l])
    4. You are building a binary classifier for recognizing cucumbers (y=1) vs. watermelons (y=0). Which one of these activation functions would you recommend using for the output layer?

      • [ ] ReLU
      • [ ] Leaky ReLU
      • [x] sigmoid
      • [ ] tanh

      Note: The output value from a sigmoid function can be easily understood as a probability.

      Sigmoid outputs a value between 0 and 1 which makes it a very good choice for binary classification. You can classify as 0 if the output is less than 0.5 and classify as 1 if the output is more than 0.5. It can be done with tanh as well but it is less convenient as the output is between -1 and 1.

    5. Consider the following code:

      A = np.random.randn(4,3)
      B = np.sum(A, axis = 1, keepdims = True)
      • 1
      • 2

      What will be B.shape?

      B.shape = (4, 1)

      we use (keepdims = True) to make sure that A.shape is (4,1) and not (4, ). It makes our code more rigorous.

    6. Suppose you have built a neural network. You decide to initialize the weights and biases to be zero. Which of the following statements are True? (Check all that apply)

      • Each neuron in the first hidden layer will perform the same computation. So even after multiple iterations of gradient descent each neuron in the layer will be computing the same thing as other neurons.
      • Each neuron in the first hidden layer will perform the same computation in the first iteration. But after one iteration of gradient descent they will learn to compute different things because we have “broken symmetry”.
      • Each neuron in the first hidden layer will compute the same thing, but neurons in different layers will compute different things, thus we have accomplished “symmetry breaking” as described in lecture.
      • The first hidden layer’s neurons will perform different computations from each other even in the first iteration; their parameters will thus keep evolving in their own way.
    7. Logistic regression’s weights w should be initialized randomly rather than to all zeros, because if you initialize to all zeros, then logistic regression will fail to learn a useful decision boundary because it will fail to “break symmetry”, True/False?

      • [ ] True
      • [x] False

      Logistic Regression doesn’t have a hidden layer. If you initialize the weights to zeros, the first example x fed in the logistic regression will output zero but the derivatives of the Logistic Regression depend on the input x (because there’s no hidden layer) which is not zero. So at the second iteration, the weights values follow x’s distribution and are different from each other if x is not a constant vector.

    8. You have built a network using the tanh activation for all the hidden units. You initialize the weights to relative large values, using np.random.randn(..,..)*1000. What will happen?

      • [ ] It doesn’t matter. So long as you initialize the weights randomly gradient descent is not affected by whether the weights are large or small.

      • [ ] This will cause the inputs of the tanh to also be very large, thus causing gradients to also become large. You therefore have to set 伪 to be very small to prevent divergence; this will slow down learning.

      • [ ] This will cause the inputs of the tanh to also be very large, causing the units to be “highly activated” and thus speed up learning compared to if the weights had to start from small values.

      • [x] This will cause the inputs of the tanh to also be very large, thus causing gradients to be close to zero. The optimization algorithm will thus become slow.

      tanh becomes flat for large values, this leads its gradient to be close to zero. This slows down the optimization algorithm.

    9. Consider the following 1 hidden layer neural network:

    10. b[1] will have shape (4, 1)
      • W[1] will have shape (4, 2)
      • W[2] will have shape (1, 4)
      • b[2] will have shape (1, 1)
    11. In the same network as the previous question, what are the dimensions of Z^[1] and A^[1]?

      • Z[1] and A[1] are (4,m)
  • 相关阅读:
    ssh时传递环境变量
    linux删除文件后磁盘空间未释放的问题
    gitlab-ci配置疑难备忘
    javac老提示无效的标记
    unity5.6里Baked Lighting下面几个Lighting Mode的解释
    屌爆的xamarin,一人单挑google/apple/windows
    xamarin.droid自己的示例工程有些都装不上模拟器,是因为它的architectures选项没设对
    使用NFC读卡器ACR122u读取银行卡信息
    【转】Gnirehtet – 为 Android 设备提供反向网络连接[Windows、macOS、Linux]
    【转】1分钟学会U盘启动安装Linux系统
  • 原文地址:https://www.cnblogs.com/Dar-/p/9356771.html
Copyright © 2011-2022 走看看