06-11-2023, 08:02 AM
yes, yes they can. how did i make mine? i used rwkv for my music ai and fine-tuned it on some type of midi encoders. i used 12k midi files from the LAKH midi dataset for fine-tuning. When i was fine-tuning my model at 3 epochs my model couldn't really make music well, then at 7 epochs it started to understand what notes were and how to compose music. i ended fine-tuning at a loss of 0.83 for my model. here is something it made 
