将1*(1024*128)降维为(1*1024),将(1*1024)降维为(1*512);
将(1*512)升维为(1*1024),将(1*1024)升维为1*(1024*128);
self.fc = nn.Sequential( nn.Linear(1024*128, 1024), nn.Linear(1024, 512) ) self.upfc = nn.Sequential( nn.Linear(512, 1024), nn.Linear(1024, 1024*128), )
x6 = self.fc(x5)
x7 = self.upfc(x6)