Discussion about this post

User's avatar
Oscar's avatar

Hi Devin, nice write up as usual. Re footnote 9 it looks like the convolution might not really be typical convolution (given it's being applied to specific elements alone?) and it's more the pooling that effectively makes the behaviour "set-like" through aggregation as opposed to an ordered calculation.

https://www.kaggle.com/c/nfl-big-data-bowl-2020/discussion/119400#727631

To add to the possible player order invariance options there's an interesting paper deploying set-attention which looks like a promising direction you may be interested in:

https://arxiv.org/abs/2410.17785

Expand full comment
2 more comments...

No posts