virtual machine sonification

Hi--

     http://thiscontext.com/2013/12/09/virtual-machine-sonification


-C

--
Craig Latta
www.netjam.org/resume
+1 510 984 8117
(Skype rings this until 31 January 2014)

Earcons return!!  My first exposure was to the ARKOLA audio debugging tools....inspirational.  I currently use PluckedSound at different pitches.... the arpeggios are very informative.


Reference to the ARKOLA simulator paper:
http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&cad=rja&ved=0CDkQFjAB&url=http%3A%2F%2Fwww.researchgate.net%2Fpublication%2F221517098_Effective_sounds_in_complex_systems_the_ARKOLA_simulation%2Ffile%2Fe0b4951837b5fd2fb7.pdf&ei=wR-mUumxC5LTkQeekICYCQ&usg=AFQjCNHLB9Kld88gAG0mmy9n9mU_Xw2oAg&sig2=EGCxnRgUEhf5zxQFnQWeoA&bvm=bv.57752919,d.eW0


Sam S. Adams, CTO - Contextual Computing
IBM Distinguished Engineer, IBM Research
Mobile: 919-696-6064, email: [hidden email]
Assistant: Linda R. Morrison. (720) 395-0460 Fax: (845) 491-4318, Tie: 676-0460, [hidden email]
<<Hebrews 11:6, Proverbs 3:5-6, Romans 1:16-17, 1 Corinthians 1:10>>

gettimothy ---12/09/2013 02:36:55 PM--->From your link:

From: gettimothy <[hidden email]>
To: The general-purpose Squeak developers list <[hidden email]>
Date: 12/09/2013 02:36 PM
Subject: Re: [squeak-dev] virtual machine sonification
Sent by: [hidden email]

---

From your link:

"Now I’m designing instrumentations for sonification, so that the virtual machine will generate sound as it runs.... "

Whatever you come up with, I am eagerly awaiting hearing the sound of this gem from page 11 of Tim Rowledge's A Tour of the Squeak Object Engine: 

[burp + self wonk] value


cheers.

tty.


> ---- On Mon, 09 Dec 2013 11:14:52 -0800 Craig Latta <[hidden email]> wrote ----
>
>
>
> Hi--
>
> http://thiscontext.com/2013/12/09/virtual-machine-sonification 
>
>
> -C
>
> --
> Craig Latta
> www.netjam.org/resume 
> +1 510 984 8117
> (Skype rings this until 31 January 2014)
>
>
>

On 9 December 2013 19:14, Craig Latta <[hidden email]> wrote:
>
> Hi--
>
>      http://thiscontext.com/2013/12/09/virtual-machine-sonification
>
Have you been talking to Tim Mackinnon? Because he's been working on
very, very similar stuff. I don't know what he's allowed to say about
the project, so I'll leave it to him to talk about his work.

Tim?

frank

I've always wondered if sonic interfaces might be a useful accessibility feature. Particularly the spatial qualities of stereo audio.

Most interfaces for the blind are centered around speaking text (screen readers,) but things like tone, rhythm, harmony, timbre, dynamics, counterpoint, and spatial orientation could have dramatic and empowering  effects. If it was me I'd actually be looking for ways to map object interactions to musical ideas.

I've enjoyed the *hell* out of your visualizations. I'm excited to see where you take this idea.

Here's my suggestion: combine them. Maybe use the Oculus Rift and some flavor of Croquet.

One place I've found that can be really useful for gathering research papers and prior good ideas is here, and if I was you, I'd ask this question there too:

http://vpri.org/mailman/listinfo/fonc

Cheers!

--Casey

Wow, thanks Sam!

For instance just he title of reference [9]  "The Alternate Reality Kit: an example of tension between literalism and magic." is mind blowing! Deeply inspiring stuff!

This makes me want to abandon everything else and try to replicate this.

Quoting Sam Adams <[hidden email]>:

Earcons return!!  My first exposure was to the ARKOLA audio debugging tools....inspirational.  I currently use PluckedSound at different pitches.... the arpeggios are very informative.


Reference to the ARKOLA simulator paper:
http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&cad=rja&ved=0CDkQFjAB&url=http%3A%2F%2Fwww.researchgate.net%2Fpublication%2F221517098_Effective_sounds_in_complex_systems_the_ARKOLA_simulation%2Ffile%2Fe0b4951837b5fd2fb7.pdf&ei=wR-mUumxC5LTkQeekICYCQ&usg=AFQjCNHLB9Kld88gAG0mmy9n9mU_Xw2oAg&sig2=EGCxnRgUEhf5zxQFnQWeoA&bvm=bv.57752919,d.eW0


Sam S. Adams, CTO - Contextual Computing
IBM Distinguished Engineer, IBM Research
Mobile: 919-696-6064, email: [hidden email]
Assistant: Linda R. Morrison. (720) 395-0460 Fax: (845) 491-4318, Tie: 676-0460, [hidden email]
<<Hebrews 11:6, Proverbs 3:5-6, Romans 1:16-17, 1 Corinthians 1:10>>

gettimothy ---12/09/2013 02:36:55 PM--->From your link:

From: gettimothy <[hidden email]>
To: The general-purpose Squeak developers list <[hidden email]>
Date: 12/09/2013 02:36 PM
Subject: Re: [squeak-dev] virtual machine sonification
Sent by: [hidden email]

---

From your link:

"Now I?m designing instrumentations for sonification, so that the virtual machine will generate sound as it runs.... "

Whatever you come up with, I am eagerly awaiting hearing the sound of this gem from page 11 of Tim Rowledge's A Tour of the Squeak Object Engine:

[burp + self wonk] value


cheers.

tty.


> ---- On Mon, 09 Dec 2013 11:14:52 -0800 Craig Latta <[hidden email]> wrote ----
>
>
>
> Hi--
>
> http://thiscontext.com/2013/12/09/virtual-machine-sonification
>
>
> -C
>
> --
> Craig Latta
> www.netjam.org/resume
> +1 510 984 8117
> (Skype rings this until 31 January 2014)
>
>
>

Cheers,
Juan Vuletich

Juan,

> For instance just he title of reference [9]  "The Alternate Reality Kit: an example of
> tension between literalism and magic." is mind blowing! Deeply inspiring stuff!

That was a very important paper and I really recomend it. Not everyone
is familiar with the role of ARK in the history of Squeak. The Alternate
Reality Kit was a simulator for physics experiments which attempted to
be a visual implementation of Smalltalk-80. Almost every concept in the
textual language had a concrete, visual counterpart in the simulator
environment. Messages became buttons, for example, and classes were
shown as little factories that could build you instances of different
kinds of objects.

An interesting thing happened: users mostly ignored the factories and
instead created new objects by using the "copy" button on an existing
instance of the kind of object that they wanted. The attempt to see if
the underlying textual language couldn't reflect this style that the
users seemed to find more natural resulted in Self. The attempt to make
Self more visual like the original ARK resulted in Morphic and Kansas.

-- Jecel