I was looking at two papers
- Graph Attention Networks (GAT) by Petar Veličković and
- GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs by Jiani Zhang.
I'm trying to implement the second paper and I'm having some troubles understanding the differences between GAT and GaAN. By looking at equation 1 in GaAN paper I can see only two differences from GAT.
- The first difference is that they are doing a dot product with the initial feature map and
- Have another fully connected layer to project the result.
Is there something else that I'm missing?
