How to manipulate video with sound in Izzy?

Michel

@joejdrums

You could use something like Soundflower or SoundSyphon to route the sound of the movie back into Isadora.

Best Michel

JetJaguar

That is a good idea. I'll check it out.

DusX

I have been experimenting with using Imitone ( https://imitone.com/ )

It converts sound to midi.. lots of interesting potential.

leben

oooh, looks interesting, cheers for this : )

leben

@DusX

Will Izzy pick this up in the input ports of the midi set up, as it would any piece of midi hardware?

DusX

yes.. its just a midi source.

JetJaguar

Looks cool. Thanks man

vanakaru

Meanwhile you can test existing audio to midi apps. Ones like WIDI has been around for some time. You can convert audio(singing into the mic) to midi in real time and play a synth accordingly.

http://www.widisoft.com/english/mp3-midi-products.html

Max/MSP can be set up as such as well

https://youtu.be/BiEBN17ZnNI

PD (PureData)

http://forum.pdpatchrepo.info/topic/9816/audio-to-midi-in-pd

leben

@jhoepffner

This Max patch looks interesting, I know nothing about max, I assume one would be able to tweak this patch so that is sends data from a live audio feed into izzy, instead of from a synth...

Thank you : )

vanakaru

Try WIDI it does it "out of the box". Just choose MIDI output "Isadora..."

You can handcraft this with Isadora as well: Frequency Watcer for each note(usable voice range is about 2 octaves - 24 notes)

JetJaguar

Thanks Vanakura. I have looked into Imitone. Very, very Beta. Not too accurate as far as I can tell yet. I will look into the Max patch.

There is one thing I'm trying to understand with the audio conversion to midi. This is for a live situation? I think I understand the live signal flow.

Audio streams > gets converted to a binary code that Isadora reads and then can process via Sound Frequency Watcher.

Yes?

Also, Vanakura. Would you happen to have have any patches you're able to pass along for Max or PD?

vanakaru

look, this may help you

http://www.ernestomalaca.com/uncategorized/audio-trigger-a-midi-puredata-ableton-live/

Klawrence

So is there not a way that voices speaking can be translated into numbers for parameter changes?

Or something that takes the audio decibel level and uses that to change parameters?

Thanks, Kedar

vanakaru

@Klawrence

Isadora has actors for that - Sound Level and Sound Freq Watcher.

vanakaru

@joejdrums

I strongly suggest to try to study PD(PureData). It is really rewarding to create something with it. There is a patch that takes mic input and makes midi notes according to sound frequency. You may need help with getting fiddle to work / I have my question answered on their forum. Pure Fun.

Armando

There is also a free app that works very well. Midi guitar

JetJaguar

@Vanakuru

Thanks.. I have created some random note generating synths in PD. It is cool. Finding the time to go deeper is always the challenge. I work with lots of software. That said, here is an amazing book on Pure Data (lots of tutorial I've found online) but mainly on creating sound via computers. I found the book on Amazon.

Thanks as always for a robust and helpful forum. I'm hoping to work on some of these suggestions this week. Back with results when done.

http://www.amazon.com/Designing-Sound-Andy-Farnell/dp/0262014416

JetJaguar

@Armando

How are you pulling Midi guitar into Isadora? I see the AU version is not available unless you purchase.

vanakaru

Midi Guitar has also a nag-screen that interrupts the process - until you buy. It outs midi that can be listened in Isadora.