Smalltalk › Squeak › Squeak - Beginners

How can I play a sound from time A to time B?

_‹ Previous Topic Next Topic _›

Classic

List

Threaded

5 messages Options

Steve Thomas

How can I play a sound from time A to time B?

So I figured out how to read in a paragraph of text and split it into separate words I can highlight as I read. Still need to play around a bit to handle the different fonts/sizes and kerning.

Each word is its own Text object embedded in a Rectangle which "highlights" the words as I read. I set the "highlight timing" by using the keyboard as I record the sound. Then make minor adjustments as needed. This will play fine in reading the whole sentence/paragraph.

But I want the user to be able to click on a word and hear that word spoken. Rather than re-record each word, I would like to be able to play a snippet of the recording.

So... How do a play a sound recorded in Etoys from time A to time B?

Cheers,

Stephen

_______________________________________________
Beginners mailing list
[hidden email]
http://lists.squeakfoundation.org/mailman/listinfo/beginners

Steve Thomas

Re: [etoys-dev] How can I play a sound from time A to time B?

Mike,

Actually my goal is to create something kids and their parents can use. Where a child can tell a story (which is recorded). Then the parent can type it in and the child and/or parent can work together to create the "word highlighted when its read" feature for that particular story.

So no SMIL/XML although the article you sent me (http://apex.infogridpacific.com/dcp/SMIL-production.html#rw-h3_67543-060614180) did give me some good points on the need for highlighting at the phrase/sentence/paragraph levels instead of just word level, depending on the needs of the learner.

Cheers,

Stephen

On Sat, Jan 19, 2013 at 10:35 PM, Mike Lee <[hidden email]> wrote:

It would be sweet if these time markers could be captured manually from within Etoys, perhaps in one of the sound tools then read by a script that links them to your named text blocks. Audacity can be used for this.

_______________________________________________
Beginners mailing list
[hidden email]
http://lists.squeakfoundation.org/mailman/listinfo/beginners

Herbert König

Re: How can I play a sound from time A to time B?

In reply to this post by Steve Thomas

Hi Steven,

as a start: there's SampedSound>>playSilentlyUntil: to fast forward a sound. #resumePlaying will play the sound from there and #pause will stop playing after the word. There's more useful methods in sampledSound and AbstractSound. But you'll have to figure out how to get the time for the beginning of each word.

Cheers

Herbert

Am 20.01.2013 04:00, schrieb Steve Thomas:

So I figured out how to read in a paragraph of text and split it into separate words I can highlight as I read. Still need to play around a bit to handle the different fonts/sizes and kerning.

Each word is its own Text object embedded in a Rectangle which "highlights" the words as I read. I set the "highlight timing" by using the keyboard as I record the sound. Then make minor adjustments as needed. This will play fine in reading the whole sentence/paragraph.

But I want the user to be able to click on a word and hear that word spoken. Rather than re-record each word, I would like to be able to play a snippet of the recording.

So... How do a play a sound recorded in Etoys from time A to time B?

Cheers,

Stephen
_______________________________________________
Beginners mailing list
[hidden email]
http://lists.squeakfoundation.org/mailman/listinfo/beginners

_______________________________________________
Beginners mailing list
[hidden email]
http://lists.squeakfoundation.org/mailman/listinfo/beginners

Karl Ramberg

Re: [etoys-dev] How can I play a sound from time A to time B?

In reply to this post by Steve Thomas

Open a graph on the sound.

You may need to edit the sound to get a graph of it.

A graph is much like a holder so you can play sound from a sample location to another sample location.

Keep an eye out for the length of the sound you load. I'm sure a long sound will be a big hog of memory and make your project sluggish.

Karl

On Sun, Jan 20, 2013 at 4:00 AM, Steve Thomas <[hidden email]> wrote:

So I figured out how to read in a paragraph of text and split it into separate words I can highlight as I read. Still need to play around a bit to handle the different fonts/sizes and kerning.

Each word is its own Text object embedded in a Rectangle which "highlights" the words as I read. I set the "highlight timing" by using the keyboard as I record the sound. Then make minor adjustments as needed. This will play fine in reading the whole sentence/paragraph.

But I want the user to be able to click on a word and hear that word spoken. Rather than re-record each word, I would like to be able to play a snippet of the recording.

So... How do a play a sound recorded in Etoys from time A to time B?

Cheers,
Stephen

_______________________________________________
etoys-dev mailing list
[hidden email]
http://lists.squeakland.org/mailman/listinfo/etoys-dev

_______________________________________________
Beginners mailing list
[hidden email]
http://lists.squeakfoundation.org/mailman/listinfo/beginners

Steve Thomas

Re: [etoys-dev] How can I play a sound from time A to time B?

Karl,

I did try that not sure how much that will help. I even thought of trying to walk through the "sound" and check volume levels, but not sure how well that will work. Might help as a first approximation, but would require I figure out how to get the sound and walk through the levels by time slices. If you code provide a code snippet, that would be nice :)

I also tried key strokes to set the start/end times, but timing the keystrokes proved really hard to do.

Basically each word is in a "Text Rectangle" and each "Text Rectangle" has a start and end time variables to know when to "highlight" the word.

I wound up using a piano roll type approach, where I have my "cursor" move across the piano roll and when it detects a color under, it sets a words start/end times. That worked fairly well, but really the hard part is word timing. Phrase (highlighting groups of words) timing is a lot easier.

In any case I'll probably share something later this week to get some feedback on what might be simplest for kids (old and young) to use.

Stephen

On Mon, Jan 28, 2013 at 4:02 PM, karl ramberg <[hidden email]> wrote:

Open a graph on the sound.
You may need to edit the sound to get a graph of it.
A graph is much like a holder so you can play sound from a sample location to another sample location.

Keep an eye out for the length of the sound you load. I'm sure a long sound will be a big hog of memory and make your project sluggish.

Karl

On Sun, Jan 20, 2013 at 4:00 AM, Steve Thomas <[hidden email]> wrote:

So I figured out how to read in a paragraph of text and split it into separate words I can highlight as I read. Still need to play around a bit to handle the different fonts/sizes and kerning.

Each word is its own Text object embedded in a Rectangle which "highlights" the words as I read. I set the "highlight timing" by using the keyboard as I record the sound. Then make minor adjustments as needed. This will play fine in reading the whole sentence/paragraph.

But I want the user to be able to click on a word and hear that word spoken. Rather than re-record each word, I would like to be able to play a snippet of the recording.

So... How do a play a sound recorded in Etoys from time A to time B?

Cheers,
Stephen

_______________________________________________
etoys-dev mailing list
[hidden email]
http://lists.squeakland.org/mailman/listinfo/etoys-dev

_______________________________________________
Beginners mailing list
[hidden email]
http://lists.squeakfoundation.org/mailman/listinfo/beginners