Forum

Hi John,

If the agent just has an audio input, you can use the audio agent to get audio into EigenD (it supports both in and out now). This could allow you to use your Mac microphone and wire it into the agent, just as you would wire the Alpha microphone into it. The audio agent allows you to create channels that it streams audio from, if those channels can be found on your actual audio device, you'll get the audio.

How to send the Belcanto, how to determine the context, etc etc ... is probably going to take quite a bit of discussion. I'm sure that John L has some good ideas about that.

The result of the operation is probably something that you don't want to wrap in a statusdata_t as that's tailored towards indicators on a 2D plane. I suspect this will tie into the better error reporting we're going to add to executing Belcanto phrases and using Workbench. That's still under discussion here though, we'll keep you posted.

Take care,

Geert

Can't seem to get that working. Can you send me a wiring diagram of a working version? (or script)

Stefan - Yes, we think so too. We'd actually like to get error feedback happening from Agents using Belcanto. This could then be either spoken (via speech synthesis) to the musician in their in-ear monitoring, or played as the note sequences (which are fairly easily learned) in the same way. There's no particular need for that feedback to be syntactically correct so the lexicon could be used pretty freely.

John - Belcanto can be input direct into the Interpreter as notes on it's keygroup in, which would be the neat way to do it from a speech Agent - one could do all sorts of fun learning type things then as well. It would also make the data stream routable via the normal mechanisms in Workbench.

John

Agent sending out Belcanto phrase as note sequence. Nice! Didn't think of that - cheers Stefan/John

(have changed spec on wiki)

Hi John,

I forgot that Apple dissociated the built-in output and inputs. A way to get this to work is to use the Audio Midi Setup application and to create an aggregate device in the 'Audio Devices' section.

Here are some screenshots that should make this easier to set up.

http://eigenzone.org/eigend_aggregate_1.png
http://eigenzone.org/eigend_aggregate_2.png
http://eigenzone.org/eigend_aggregate_3.png

Hope this helps,

Geert

Add a 'HowTo Tip' to the 2.0 Documentation wiki on this technique for audio cpature

We tend to use the 'toggle start ' idiom for that.

Ill dig out an example from the code next week. Youll want it fast from end to end to ensure a snappy response to the 'talk ' key.

And I would have thought a helper thread (not the main slow thread) would be the best place for the actual analysis. You dont want to hang up the slow thread for too long either.

Oh, and also, it's possible for talker actions to control the talker light directly. An example is how the metronome toggle start can flash the light on the beat.

So having the light go from standby to working to suceeded/failed is perfectly doable.

I'm less sure about feeding the interpreter via notes. if we want a success/fail from the interp to be reflected in the light, might be easier just to rpc the interp.

Hi John

It occurs to me that the momentary diversion of an audio signal from one path to another could be usefully another, independent agent. It'd be a really simple agent, audio in to 2 x audio out and a control input, but I think it would have wider uses than just diverting the mic signal for your agent and it might be worth implementing it for that reason rather then building something like it into a voice recogniser. One could also use it to talk to the mix engineer, or another band member for example. I'm sure here are a multitude of possible uses, if you did it that way.

John