zoukankan      html  css  js  c++  java
  • CN_Week1_Receptive_Field

    0. The introduction:

    1. An example: Models of "Receptive Fields".
    
    2. An intuitive method of showing the electrical activities of neurons -- converting them to audio signals.
    

    1. Descriptive Model of Receptive Field

    Maybe it's a center-surrond RF:
    or ,
    But, the experiment showed that the signals got strongest when the beam was moving like:

    So, here comes the "oriented receptive fields":

    2. Mechanistic Model of RF:

    Whereas the lateral geniculate nucleus (LGN) has the basically center-surrond RFs, just like those in retina. So, how does it come out like:
    ->

    Ahh, here it is:
    ( -- It's the Mechanistic Model, designed to describe how the neuron system does what we have observed it to do)
    So, it just looks like that the two base vectors ((0, 1), (1, 0)) can make up all coords in a two-dimensional axis.
    附脑图:


    Brain_pic

    3. Interpretive Model of RF:

    1. Efficient Coding Hypothesis: suppose that the goal is to represent images as faithfully and effectively as possible using neurons with (RF_1), (RF_2), ...

    2. Given image I, we can reconstruct I using neural reponses (r_1), (r_2),
      , like:

    3. Idea: What are the $RF_i that minimize the total squared pixelwise errors between I and I_hat and are as independent as possible.

    4. Solution: Start out with random (RF_i) and run your efficient coding algorithm on natural image patches.
      Optimization methods: Sparse coding, ICA(Independent Component Analysis), Predictive coding...

    5. "Remember the 'features' in CNN?":

    CNN_features
    , they are 'oriented poles', very similar to ' ![](http://images2017.cnblogs.com/blog/1204038/201710/1204038-20171010200720777-1322677086.jpg)![](http://images2017.cnblogs.com/blog/1204038/201710/1204038-20171010200752590-691733184.jpg)'.

    4. Neurons, Synapses, and Brain Region

    1. Brain Cell and Neurons:

    First of all, take a look at "The Brain Cell":

    brain_cell

    while mostly, we see the neurons ideally as this one:

    the_idea_neuron

    2. Synapses:

    1. The reason why synapses can control the ions in or out is that it has a good "gatekeeper".
      Ionic Channel: The Gatekeeper:
      Characteristics: Selective and allowing only specific ions to pass through(e.g. Pass Na+ but not K+ or Cl-).

    2. 3 factors of "being gated":

      • Voltage-gated;
      • Chemically-gated(Synapses);
      • Mechanically-gated.

    3. Myelination of Axon:

      Enable fast long-range spike communication like active wiring(e.g. Reacting to the pain of feet needs to transport potential at once through a long distance, and the Myelination is used.)

    4. Definition: A synapse is a "connection" or junction between two neurons:

    • Electrical synapses use gap junctions:
    electrical_synapses
    + Chemical synapses use neuron transmitters:
    neuron_transmitters

    5. The Synapse Doctrine:

      Synapses are the basis for memory abd learning.

    6. Hebbian Plasticity:

      If neuron A repeatedly takes part in firing neuron B, then the synapse from A to B is strengthened:

    Hebbian_Plasticity

    7. Synaptic Plasticity depends on Spike Timing!

    Spiking_Timing
  • 相关阅读:
    关于C#中timer类 (转)
    AutoResetEvent (转)
    给韬哥的回复
    sql中的case when 的用法涉及到大于小于号
    vba中获取当前日期
    vba中的小技巧
    sql server2000中的两个整数相除保留十位小数
    vba中新建文件,关闭文件,锁屏,覆盖同名文件
    无法切换到google.com的解决办法
    mysql 常用命令
  • 原文地址:https://www.cnblogs.com/ZhengPeng7/p/7647544.html
Copyright © 2011-2022 走看看