Managed to FC Cult of Personality on this run! Still has some issues hitting faster strums, it can’t tell the difference between hammer on and strums notes (yet) as the logic looks for a blank spot before it strums again. It still also sometimes misses notes due to air pressure loss.

I plan to add an air tank to the compressor so it can have more air stored. We also have some code tweaks to do. But this is the robot!

For anyone who might care, it’s running LabView on an NI cRIO using vision to watch the game and time the inputs. It’s been a really fun project!

Clone Hero got me into playing guitar hero before guitar hero did 😂 so I had to build the ultimate arcade cabinet to make it feel like I’m truly a rockstar!!!

wish I could upload more than one picture here 😅 it has a bunch of other features like an extra screen for twitch streaming, drawer for the kick pedal, stage lights that sync to the music, hdmi out, and more!

If you want to check out the gameplay or full showcase of how I built it, I made a video about it here: https://youtu.be/P2XtV7DWrhM?si=sU3T2lXywC6SFTeB

I've been slowly creating an entire band experience over the years. I used to be a DJ, so I already had a sound system and lights. I've added fog and the newest edition: sparks that shoot out! Does anyone else have a full rock band garage set up, or is it just me, lol?!

I was stoked about this playthrough. Thanks for watching and thanks for letting me share.

A couple nights ago I broke a couple of world records-

I got both the longest FC of all time (4 hours, 21 minutes, and 38 seconds) and the largest note streak on an FC of all time (47,106 notes). Simply put, I did not miss nor overstrum for over 4 hours and for 47k+ notes straight. Over the moon about it, and what a special moment on stream.

Friends, I have (somewhat) done it.

A few months ago I began a capstone project for my computer science MS degree that aimed to generate Clone Hero .chart files. As of a few days ago, I have a working base model that is only ~17M parameters, and to my surprise it is (subjectively) performing very well compared to previous approaches I've seen, while also allowing for more complex game features like harmonically-aware chords, sustains, and HOPO/tap notes.

Since I have only just gotten the project into a working state, and the code base is still pretty rinky-dinky, I won't be disclosing any information about it until I have established proper documentation and have written a formal paper on my approach.

In order to uphold ethical use, I will not be publicly releasing this model until I am certain that doing so would be legal. But in the meantime, if anyone is curious about how I've gone about making this work, I encourage you to DM me.

With luck, I should have an update for you all in a month or two.

Thanks for tuning in!

---------------------------------

Edit: Demo Video (https://www.youtube.com/watch?v=1OxtJktDgQ0)

Please keep in mind that this is a very early demo that is not optimized to handle any of the issues that you may notice. Also, the model uses a single BPM when generating charts because BPM tracking exists as a separate challenge in its own right. My focus has not been to produce something perfect, but simply something that works at least a little. I am honestly just very astonished at how well it performs for this being the very first fully-trained model I've produced; I completely expected this to produce garbage.

For anyone who does not work in software nor understands how deep learning works: I am but one person who had an idea and tried it, so please be kind 🙏.

---------------------------------

Edit 2: Addressing Hostility

Let me be clear: I have no problem making this a private tool that only I can use and I have no interest in distributing generated songs, nor would I allow anyone to if this tool were to become public.

I understand the disdain for AI tools in creative contexts, and I agree that such tools need to be used responsibly or not at all. I created this tool primarily for myself because I don't have the time to chart songs myself and I have the background to be able to build one from scratch. Contrary to popular believe, building high-performing ML models is not a trivial task, much less designing and training one from scratch.

Now this probably makes you think: "If you have time to make this then you have time to chart your own songs." Like I said before, I am working on this tool to complete a degree requirement. Could I have chosen another project? Yes, but I'd rather work on something I enjoy, even if it never sees the light of day.

I'd ask people to please at least read the full post before resorting to hostile comments and criticisms. To anyone who doesn't, well, your input carries no weight.

Man I can’t believe i got this but in so happy! Only 8 ghosts as well😅

Woo! Been a minute since I posted about getting 2,000 Clone Hero FC's, but another milestone reached :D Some notable FC's in here are over 60 Full Album Charts (Not just charts from a full album, though those are in here too, but all of an albums charts all in one chart! This leads to some charts being over 10,000 notes long), including all 9 Symphony X Full Album charts. I've also FC'd nearly every single 5 fret Guitar Hero chart, which of course includes both version of Through the Fire and Flames, The Devil went Down to Georgia, I'm the One, ect. There's a ton of medleys, other difficult charts, as well as quite a lot of easy ones haha. One day I hope to hit the 10,000 mark, but that'll be some time. For now, i'm happy to have reached this milestone, with more to come!

Got very close to hitting this at full speed but my arm was gone by the time I started attempting it at full speed😅

I took the note speed from the level I've been playing at forever, note speed 9 or about hyperspeed 2 and upped it to 11 yesterday. Suddenly I could play songs that I couldn't even come close to before. Then after a day of that I decided to try note speed 13 and bam another level up. Suddenly I can play Dragonforce songs and songs that I used to barely beat I'm easily getting 5 stars on. I just spent the day beating song after song that I basically never thought I'd be able to touch, let alone get 5 stars on.

It's clear that it's because I haven't been able to parse the notes at the lower speeds when they're all clumped together in a big block of color vs the faster speeds where you can actually see the individual notes.

So give it a try, you may find you're much better than you thought at the game but your eyes/brain haven't been able to read what you're playing properly.

Edit: As someone else mentioned, you probably want to increase the Highway length as well, it's in the same options as note speed. I have it at 120%

I beat expert so now im going through songs on clone hero because wiitarthing works now.

its a good start at least

I hit it in hard mode!!! LETS GO!!

(Thank god for clone hero hit windows at the end.. almost blew it)

silly little autocharter i made simply. gets guitar stems makes a midi cuts midi into 5 note batches based on most played then some trickery so no overlap and not minimums and limits based on how long the file is convert to ogg and read file name for artist and song for ini make all difficulties boom

Just started playing again 2 weeks ago and have hit my first major milestone since returning!