SUBMOTIVE AI – Guide + files

Hi all 👋

Resubbed for the month to check this out, and been experimenting a bit the past few days. I’m sure I’ll have questions as I experiment more, but a couple things I ran in to already and wanted to point out, in case anyone else runs in to something that stops them. I’m not a programmer, so I’m coming in this very inexperienced, but determined to get it to work.

In general, for the Install Dependencies on the sheets, where you get a Restart Session prompt, yes you’ll have to hit Restart Session, but I found I need to wait a few seconds after that prompt before clicking on it, so it does what is supposed to do. At first I was hitting it pretty soon after it popped up, and it would fail. Found that if I just took a breath, waited a few seconds, it did what it was supposed to do. Also there is a Restart Session button in the code, I usually hit that too.

For step 6, the Finetune Dance Diffusion sheet, there is a point in the Train section where you have to manually input some of the paths in the code. I was running in to an issue where it would not get it to run, even after manually entering paths. Then I started trying things, and one thing is there is a line that says:

$save_wandb_str \

Take that out, then run the code again and you’ll be fine, from what I’ve seen.

I ended up buying 100 compute units for the training process, and with those it was about every 45 minutes that a new checkpoint (ckpt) was generated. Also, before the chunking process, I would build up a folder on my computer, and then run all the samples through Adobe Auditions batch process to get them to 44.1k 16-bit, in case there were any sounds that were outside of those rates, i.e. lots of 24-bit, the occasional 48k.

And thanks to James Submotive for going through all this, found it very interesting.

It’s great to see Harry back here for a bit hope all is well with you

JOPPA wrote:

It’s great to see Harry back here for a bit hope all is well with you

Thanks! Working on a lot of music projects, some solo stuff and some collabs with various friends. Have had some cool releases over the past year, and more lined up.

GENIE HQ wrote:

Agreed, Joppa! Nice to see a new Harry post!
Thanks for the sharing of your experiences with it H.
Yes it’s a much more demanding tutorial this month, but we hope people stick it out and get their heads around it as the potentials are incredible.

Right now it feels like a new approach to resampling, and not just giving a prompt to an existing AI platform. The training is interesting to me, already thinking about things to try, like creating a model based on samples I like, but then creating a chunked folder of my own sounds, then running the model cpkt on those sounds to hear what happens. Already did training on one set of sounds I like, and then using that model on a chunked folder of other sounds, to hear what it creates.

When dl and saving the model, do I extract the zip and upload the files to drive, or upload the zip itself ? Thanks for any advice

Jarrod wrote:

When dl and saving the model, do I extract the zip and upload the files to drive, or upload the zip itself ? Thanks for any advice

The jmann-small-190k.ckpt should download just as that, about a 3 gig file. Then upload the .ckpt file to your Google Drive. When you run Finetune_Dance_Diffusion.ipynb, on the form for training you have to point to a .ckpt file. I have mine set up like this:

Also, not sure how I’m a moderator again, maybe old role came in to play? LOL

Easy lads,

First time posting! Hope everyone is good

I am proper stuck on this…. On the training part. I have followed everything Submotive said to do yet I am still getting an error that reads –

–name “dd-SG-Machine” \
–training-dir “$TRAININ/content/drive/MyDrive/TRAIN/SGchunkedAIBasses” \
–sample-size $65536 \
–accum-batches $4 \
–sample-rate $44100 \
–batch-size $2 \
–demo-every $250 \
–checkpoint-every $500 \
–num-workers 2 \
–num-gpus 1 \
$random_crop_str \
–save-path “/content/drive/MyDrive/TRAIN/SG-Sample-Machine”

/content/sample-generator
usage: train_uncond.py [-h] [–config-file CONFIG_FILE] [–wandb-config WANDB_CONFIG]
[–name NAME] [–training-dir TRAINING_DIR] [–batch-size BATCH_SIZE]
[–num-gpus NUM_GPUS] [–num-nodes NUM_NODES] [–num-workers NUM_WORKERS]
[–sample-size SAMPLE_SIZE] [–demo-every DEMO_EVERY]
[–demo-steps DEMO_STEPS] [–num-demos NUM_DEMOS] [–ema-decay EMA_DECAY]
[–seed SEED] [–accum-batches ACCUM_BATCHES] [–sample-rate SAMPLE_RATE]
[–checkpoint-every CHECKPOINT_EVERY] [–latent-dim LATENT_DIM]
[–cache-training-data [CACHE_TRAINING_DATA]] [–random-crop [RANDOM_CROP]]
[–ckpt-path CKPT_PATH] [–save-path SAVE_PATH]
[–start-method START_METHOD] [–save-wandb SAVE_WANDB]
train_uncond.py: error: argument –accum-batches: expected one argument

So the issue is accum-batches – I have tried to change that value both lower (2) and higher (6) but still the same problem

Anyone else having this issue or know a fix?

Hello, seems like everyone is running into different problems but we all stuck at the training section. Seems like Dance Diffussion suffering still problems… My Problem is this and I dont have a Idea what to do:

/content/sample-generator
Using device: cpu
Random crop: False
Traceback (most recent call last):
File “/content/sample-generator/train_uncond.py”, line 228, in <module>
main()
File “/content/sample-generator/train_uncond.py”, line 199, in main
train_dl = data.DataLoader(train_set, args.batch_size, shuffle=True,
File “/usr/local/lib/python3.10/dist-packages/torch/utils/data/dataloader.py”, line 350, in __init__
sampler = RandomSampler(dataset, generator=generator) # type: ignore[arg-type]
File “/usr/local/lib/python3.10/dist-packages/torch/utils/data/sampler.py”, line 143, in __init__
raise ValueError(f”num_samples should be a positive integer value, but got num_samples={self.num_samples}”)
ValueError: num_samples should be a positive integer value, but got num_samples=0

I’m also having a problem here, last night I got it to run and made 1 file of basses, this morning I’m having trouble with the GPU (step 1 in Dance Diffusion Fine Tune) saying: FileNotFoundError: [Errno 2] No such file or directory: ‘nvidia-smi’

Then when I try to run the train mmodule it says: lightning_fabric.utilities.exceptions.MisconfigurationException: No supported gpu backend found!

I’ve not changed anything so not sure why it’s not working now. Ideas anyone?

Ok I give up on this… too many errors and no idea what to do! lets hope for a new version of this AI soon! Im done for now it not even makes fun like tweaking a synth!

Right guys I have successfully managed to get it going. I didn’t do anything different settings wise apart from I did change browsers from Safari to Edge (you can’t use Chrome or I should say I couldn’t because it was trying to log me into something really random that I’m guessing is possibly for some sort of moderator or something!)

I’m going to leave it going for a few hours and repost back if I run into any errors.

Thanks to @,Harry for the reply and @Saltbreef for your reply.

I do hear you though Marek. It is very clunky and annoying haha. If it’s causing too much procrastination it’s definitely best to get in the DAW and crack on!

Submotive should’ve spend the 45 minutes on going more in depth into bass design than wasting time on that AI crap.

I have created a pad machine and its good to take time to train the model. The other thing I found out about pads is that it makes sense to use the Dance Diffusion (the last step) cause you might end up in getting too short pad sounds you can adjust the length so. For this month I was running out of ressources. NExt month im going to train the bass and pads a little more! Good luck everyone 🙂

Today I trained the AI on Snares. It only took like 4 checkpoints to get a proper result. It went faster than with the Bass I guess. I ll use those results in the next tune.