zoukankan      html  css  js  c++  java
  • Unsupervised Image-to-Image Translation Networks --- Reading Writing

    Unsupervised Image-to-Image Translation Networks --- Reading Writing

    2017.03.03 

      Motivations: most existing image to image translation algorithms are all need image pairs as training data for deep neural network, such as CGANs or VAEs. But in some cases, it is rather difficult to collect such training data. For example, the night and day image pairs, the perfect aligned thermal RGB image pairs, or sunning rainning, fogging, et al, which provide us a new challenging problem: 

      How to do image to image translation in a unsupervised fashion which do not need aligned image pairs ?

     This paper proposed the UNIT framework (UNsupervised Image-to-image Translation network) to deal with this problem which combine VAE and GANs. The whole framework can be described as the following figures which seems complex but rather easy to understand. 

      

      There are two most important assumptions about the proposed framework: 

      1. we assume that the relationship between X1 and X2 does not only exist at the image level but also at the level of local patches or regions. 

      2. for any given images x1 and x2,  there exists a common underlying representation z, such that we can cover both images from this underlying representation from each of the two input images. 

      VAEs: the encoder-generator pair {E1, G1} constitutes a VAE for the X1 domain, termed VAE1. Another pair of {E2, G2} constitutes a VAE for the X2 domain VAE2. 

        Weight-sharing : we enforce a weight-sharing constraint to relate the representations in the two VAEs. 

      GANs :  two GANs are used to output the two domains. 

      

      

      

      


        Experiments: 

      

      

        

      

       

      

  • 相关阅读:
    npm 一些常用的命令
    Angular Encapsulation
    隐藏scrollbar
    Vue生命周期详解(1)- 单个组件
    如何自己制作iconfont
    day07-2018-10--25 深浅拷贝
    day06-2018-10--24 小数据池和编码
    day05-2018-10--23 字典
    day04-2018-10--22python基础
    day03-2018-10-19-python基础
  • 原文地址:https://www.cnblogs.com/wangxiaocvpr/p/6498198.html
Copyright © 2011-2022 走看看