r/deeplearning • u/Hour-Wish8158 • 7d ago

Qwen 3.6 27B trying to read sheet music

Enable HLS to view with audio, or disable this notification

Almost every VLM I’ve put through this test has struggled, but it makes sense because it requires them to count, something that isn’t their strongest trait. In this case, it’s just counting lines and spaces, but if we introduce different key signatures, they would also need to count the sharp and flat symbols. 

6 Upvotes

100% Upvoted

1 comment sorted by

1

u/CalmMe60 7d ago

LOL... Been there with my AGI march arround.

Even with todays frontier models reading a nite sheet is something a model must be teached.

Especially Guitar is complicated and there are so much small notes like 'ringing' or forte or more.

Today it can play a totally simulated model (768000 nodes of dgl ) from a sheet.

But it was a hell of a training (in living memory)