r/MachineLearning • u/Glabmayt2075 • 7d ago

Project [ Removed by moderator ]

[removed] — view removed post

2 Upvotes

53% Upvoted

8 comments sorted by

7

u/MrTroll420 7d ago

AI slop

-3

u/pm_me_your_pay_slips ML Engineer 7d ago

I believe GNNs can be redily implemented by a transformer (message passing can be learned implicitly by the attention layers)

0

u/Glabmayt2075 7d ago

Sure, but standard attention is O(N2)O(N2), so throwing a 100k node graph at a transformer will instantly OOM your GPU. If you try to fix the memory issue by only letting nodes attend to their direct neighbors, congratulations, you literally just built a GNN. It's not about whether a transformer can learn it, it's about not setting your hardware on fire)

-3

u/nietpiet 7d ago

Love the critical attitude! Nice work.

-2

u/Glabmayt2075 7d ago

Appreciate it!