Deep Canonically Correlated Autoencoders

MATLAB package for Deep Canonically Correlated Autoencoders (DCCAE)

(C) 2015 by Weiran Wang, Raman Arora, Karen Livescu and Jeff Bilmes

Download the package here.

This Matlab code implements the Deep Canonically Correlated Autoencoders 
  (DCCAE) algorithm described in the paper:

  Weiran Wang, Raman Arora, Karen Livescu, and Jeff Bilmes. 
  On Deep Multi-View Representation Learning. 
  The 32nd International Conference on Machine Learning (ICML 2015).

Quick start:
- demo.m: demonstrates the usage of linear/kernel/deep CCA/DCCAE on noisy
  MNIST images (random rotation and background) as two views.

List of functions:
- DCCA_grad.m: computes the gradient of total correlation with respect to 
  the neural network weights for each view.
- DCCA_train.m: DCCA training with stochastic minibatch optimization.
- DCCAE_train.m: DCCAE training with stochastic minibatch optimization.
- linCCA.m: linear CCA.
- randKCCA.m: randomized kernel CCA, proposed in 
  David Lopez-Paz, Suvrit Sra, Alex Smola, Zoubin Ghahramani, and 
  Bernhard Schoelkopf.
  Randomized Nonlinear Component Analysis.
  The 31th International Conference on Machine Learning (ICML) 2014.
- svmclassify.m: one-versus-one linear SVM by calling libsvm. The libsvm
  package is available from http://www.csie.ntu.edu.tw/~cjlin/libsvm/.
- createMNIST.m: generates the MNIST images used in demo.m (the random 
  seed used to generate our data is saved in demoseed.mat, so that you can 
  achieve exactly the same result).

The following are used internally by other functions (in ./deepnet)
- deepnetfwd.m: feed-forwards the inputs through deep neural networks to 
  obtain outputs.
- deepnetinit.m: initializes the neural network weight parameters.
- deepnetgrad.m: computes gradient of reconstruction error with respect to 
  neural network weights.

External packages/data:
- mnist_all.mat: the MATLAB format of all MNIST images, can be downloaded 
  from Sam Roweis's webpage http://www.cs.nyu.edu/~roweis/data.html.
- RBMPRETRAIN_K=10.mat: pretrained deep autocencoders using restricted 
  Boltzmann machines (RBMs), we use the following code for pretraining:
  http://www.cs.toronto.edu/~hinton/MatlabForSciencePaper.html
  Reference: 
    G. E. Hinton and R. R. Salakhutdinov. 
    Reducing the Dimensionality of Data with Neural Networks.
    Science, 2006.

TTI-Chicago | Weiran Wang's Home Page