Kinect and Etoys

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|

Kinect and Etoys

Ricardo Moran
Hi guys!
I want to tell you some exciting news. Thanks to the ESUG Innovation Technology Awards we've been able to buy ourselves a Microsoft Kinect. We don't have a Xbox 360 yet, but that doesn't mean we can't have a little fun with it. Who needs and Xbox if you can use Kinect with Etoys? :)

After seeing Stephen Howell's great work using Kinect with Scratch, we followed his steps and made it available for Etoys as well. 

You can find installation steps in our blog: http://tecnodacta.com.ar/gira

Cheers!
Richo


Reply | Threaded
Open this post in threaded view
|

Re: Kinect and Etoys

Ricardo Moran
I forgot to say it works in Squeak and Pharo (although in Pharo it's *painfully* slow, I don't know why yet...)

Cheers
Richo

On Wed, Jan 19, 2011 at 6:04 PM, Ricardo Moran <[hidden email]> wrote:
Hi guys!
I want to tell you some exciting news. Thanks to the ESUG Innovation Technology Awards we've been able to buy ourselves a Microsoft Kinect. We don't have a Xbox 360 yet, but that doesn't mean we can't have a little fun with it. Who needs and Xbox if you can use Kinect with Etoys? :)

After seeing Stephen Howell's great work using Kinect with Scratch, we followed his steps and made it available for Etoys as well. 

You can find installation steps in our blog: http://tecnodacta.com.ar/gira

Cheers!
Richo



Reply | Threaded
Open this post in threaded view
|

Re: Kinect and Etoys

Bert Freudenberg
In reply to this post by Ricardo Moran

On 19.01.2011, at 22:04, Ricardo Moran wrote:

> Hi guys!
> I want to tell you some exciting news. Thanks to the ESUG Innovation Technology Awards we've been able to buy ourselves a Microsoft Kinect. We don't have a Xbox 360 yet, but that doesn't mean we can't have a little fun with it. Who needs and Xbox if you can use Kinect with Etoys? :)
>
> After seeing Stephen Howell's great work using Kinect with Scratch, we followed his steps and made it available for Etoys as well.
> See it for yourselves: http://www.youtube.com/watch?v=YnqqaHvbeqg
>
> You can find installation steps in our blog: http://tecnodacta.com.ar/gira
>
> Cheers!
> Richo

Awesome! :)

- Bert -



Reply | Threaded
Open this post in threaded view
|

Re: Kinect and Etoys

cedreek
really cool :)

next step is OpenCobalt/Croquet/Teleplace ? :)

Cédrick

>
> On 19.01.2011, at 22:04, Ricardo Moran wrote:
>
>> Hi guys!
>> I want to tell you some exciting news. Thanks to the ESUG Innovation Technology Awards we've been able to buy ourselves a Microsoft Kinect. We don't have a Xbox 360 yet, but that doesn't mean we can't have a little fun with it. Who needs and Xbox if you can use Kinect with Etoys? :)
>>
>> After seeing Stephen Howell's great work using Kinect with Scratch, we followed his steps and made it available for Etoys as well.
>> See it for yourselves: http://www.youtube.com/watch?v=YnqqaHvbeqg
>>
>> You can find installation steps in our blog: http://tecnodacta.com.ar/gira
>>
>> Cheers!
>> Richo
>
> Awesome! :)
>
> - Bert -
>
>
>


Reply | Threaded
Open this post in threaded view
|

Re: Kinect and Etoys

Bert Freudenberg

On 20.01.2011, at 11:28, Cédrick Béler wrote:

> really cool :)
>
> next step is OpenCobalt/Croquet/Teleplace ? :)
>
> Cédrick

Already been done last year:

http://nsuslovi.blogspot.com/2010/11/microsoft-kinect-sensor-in-krestianstvo.html

- Bert -


>> On 19.01.2011, at 22:04, Ricardo Moran wrote:
>>
>>> Hi guys!
>>> I want to tell you some exciting news. Thanks to the ESUG Innovation Technology Awards we've been able to buy ourselves a Microsoft Kinect. We don't have a Xbox 360 yet, but that doesn't mean we can't have a little fun with it. Who needs and Xbox if you can use Kinect with Etoys? :)
>>>
>>> After seeing Stephen Howell's great work using Kinect with Scratch, we followed his steps and made it available for Etoys as well.
>>> See it for yourselves: http://www.youtube.com/watch?v=YnqqaHvbeqg
>>>
>>> You can find installation steps in our blog: http://tecnodacta.com.ar/gira
>>>
>>> Cheers!
>>> Richo
>>
>> Awesome! :)
>>
>> - Bert -
>>
>>
>>
>
>



Reply | Threaded
Open this post in threaded view
|

Re: Kinect and Etoys

Nikolay Suslov
On Thu, Jan 20, 2011 at 3:09 PM, Bert Freudenberg <[hidden email]> wrote:

On 20.01.2011, at 11:28, Cédrick Béler wrote:

> really cool :)
>
> next step is OpenCobalt/Croquet/Teleplace ? :)
>
> Cédrick

Already been done last year:

http://nsuslovi.blogspot.com/2010/11/microsoft-kinect-sensor-in-krestianstvo.html


Not, really the same.. )

I started exploring the possibility of making KinectPlugin for Squeak, based on OpenKinect project. This don't require to install any drivers (like OpenNI) and run any external applications (like OSCeleton) for using Kinect sensor. So, the idea is that KinectPlugin just transfer two RGB and Depth images into squeak and all video recognizing stuff (aka Kinect wrapper) is programmed just in Smalltalk.

Here, Ricardo using another scenario. He uses an OSC protocol  (trough network) in Squeak/EToys connecting to an external compiled programm OSCeleton, which communicates with the installed OpenNI drivers in hosting OS (Windows for now). OSCeleton takes Kinect skeleton data from the OpenNI framework and spits out the coordinates of the skeleton's joints via OSC messages.
That's is straightforward way of using OpenNI framework in Squeak and have it's benefits, great!

Best regards,
Nikolay


Reply | Threaded
Open this post in threaded view
|

Re: Kinect and Etoys

Alejandro F. Reimondo
In reply to this post by Ricardo Moran
Hi Ricardo,
 
We are also working with Kinect a lot of fun and usefull
 applications are now possible at low cost.
We do native interface & computer vision to do shape
 analysis, and hand tracking in smalltalk.
 
Yesterday I opened a campaign [*] to build software to use
 kinect device for 3D scanning of models; we are working
 on that based on our VS frameworks, produced models
 can be transfered using standard 3D file format.
The exchange of information between frameworks (low level
 information from our framework to squeak) in realtime
 can be realized same way as OpenNI interface is using
 for skeleton.
 
In our tests the use of OpenNI produced low response
 and loose of tracking, that motivated us to exploit
 low level interface and continue learning the internals
 and specific conditions of the device and capture
 process.
 
have fun!
Ale.
 
    We are still looking for our first donor!
 
 
----- Original Message -----
Sent: Wednesday, January 19, 2011 6:04 PM
Subject: [squeak-dev] Kinect and Etoys

Hi guys!
I want to tell you some exciting news. Thanks to the ESUG Innovation Technology Awards we've been able to buy ourselves a Microsoft Kinect. We don't have a Xbox 360 yet, but that doesn't mean we can't have a little fun with it. Who needs and Xbox if you can use Kinect with Etoys? :)

After seeing Stephen Howell's great work using Kinect with Scratch, we followed his steps and made it available for Etoys as well. 

You can find installation steps in our blog: http://tecnodacta.com.ar/gira

Cheers!
Richo





Reply | Threaded
Open this post in threaded view
|

Re: [etoys-dev] Kinect and Etoys

Ricardo Moran
In reply to this post by Bert Freudenberg

On Wed, Jan 19, 2011 at 8:01 PM, Bert Freudenberg <[hidden email]> wrote:

On 19.01.2011, at 22:04, Ricardo Moran wrote:

> Hi guys!
> I want to tell you some exciting news. Thanks to the ESUG Innovation Technology Awards we've been able to buy ourselves a Microsoft Kinect. We don't have a Xbox 360 yet, but that doesn't mean we can't have a little fun with it. Who needs and Xbox if you can use Kinect with Etoys? :)
>
> After seeing Stephen Howell's great work using Kinect with Scratch, we followed his steps and made it available for Etoys as well.
> See it for yourselves: http://www.youtube.com/watch?v=YnqqaHvbeqg
>
> You can find installation steps in our blog: http://tecnodacta.com.ar/gira
>
> Cheers!
> Richo

Awesome! :)

Thanks! :)
 

- Bert -


_______________________________________________
etoys-dev mailing list
[hidden email]
http://lists.squeakland.org/mailman/listinfo/etoys-dev



Reply | Threaded
Open this post in threaded view
|

Re: Kinect and Etoys

Ricardo Moran
In reply to this post by cedreek

On Thu, Jan 20, 2011 at 7:28 AM, Cédrick Béler <[hidden email]> wrote:
really cool :)

Thanks!
 

next step is OpenCobalt/Croquet/Teleplace ? :)

I don't know a lot about OpenCobalt but I think it shouldn't be particularly hard... now we only need a volunteer to do the job :)

Cheers
Richo
 

Cédrick

>
> On 19.01.2011, at 22:04, Ricardo Moran wrote:
>
>> Hi guys!
>> I want to tell you some exciting news. Thanks to the ESUG Innovation Technology Awards we've been able to buy ourselves a Microsoft Kinect. We don't have a Xbox 360 yet, but that doesn't mean we can't have a little fun with it. Who needs and Xbox if you can use Kinect with Etoys? :)
>>
>> After seeing Stephen Howell's great work using Kinect with Scratch, we followed his steps and made it available for Etoys as well.
>> See it for yourselves: http://www.youtube.com/watch?v=YnqqaHvbeqg
>>
>> You can find installation steps in our blog: http://tecnodacta.com.ar/gira
>>
>> Cheers!
>> Richo
>
> Awesome! :)
>
> - Bert -
>
>
>





Reply | Threaded
Open this post in threaded view
|

Re: Kinect and Etoys

Ricardo Moran
In reply to this post by Nikolay Suslov


On Thu, Jan 20, 2011 at 9:39 AM, Nikolay Suslov <[hidden email]> wrote:
On Thu, Jan 20, 2011 at 3:09 PM, Bert Freudenberg <[hidden email]> wrote:

On 20.01.2011, at 11:28, Cédrick Béler wrote:

> really cool :)
>
> next step is OpenCobalt/Croquet/Teleplace ? :)
>
> Cédrick

Already been done last year:

http://nsuslovi.blogspot.com/2010/11/microsoft-kinect-sensor-in-krestianstvo.html


Not, really the same.. )

I started exploring the possibility of making KinectPlugin for Squeak, based on OpenKinect project. This don't require to install any drivers (like OpenNI) and run any external applications (like OSCeleton) for using Kinect sensor. So, the idea is that KinectPlugin just transfer two RGB and Depth images into squeak and all video recognizing stuff (aka Kinect wrapper) is programmed just in Smalltalk.

Here, Ricardo using another scenario. He uses an OSC protocol  (trough network) in Squeak/EToys connecting to an external compiled programm OSCeleton, which communicates with the installed OpenNI drivers in hosting OS (Windows for now). OSCeleton takes Kinect skeleton data from the OpenNI framework and spits out the coordinates of the skeleton's joints via OSC messages.
That's is straightforward way of using OpenNI framework in Squeak and have it's benefits, great!

Exactly, I couldn't have explained it better :). We also started using OpenKinect and the video processing was *really* difficult. A friend of mine was working on that when we found OpenNI/NITE and stuff which does the actual hard work :). So, in the interest of having something working quickly, we just used that.

However, it's really uncomfortable having to install all those drivers and libraries (and copying/pastying xml files). I guess it's just not ready for final users yet...

Cheers
Richo
 

Best regards,
Nikolay






Reply | Threaded
Open this post in threaded view
|

Re: Kinect and Etoys

Ricardo Moran
In reply to this post by Alejandro F. Reimondo

On Thu, Jan 20, 2011 at 11:30 AM, Alejandro F. Reimondo <[hidden email]> wrote:
Hi Ricardo,
 
We are also working with Kinect a lot of fun and usefull
 applications are now possible at low cost.
We do native interface & computer vision to do shape
 analysis, and hand tracking in smalltalk.

Well, that's *very* interesting. Is your software open source? Is it available somewhere?
 
 
Yesterday I opened a campaign [*] to build software to use
 kinect device for 3D scanning of models; we are working
 on that based on our VS frameworks, produced models
 can be transfered using standard 3D file format.
The exchange of information between frameworks (low level
 information from our framework to squeak) in realtime
 can be realized same way as OpenNI interface is using
 for skeleton.
 
In our tests the use of OpenNI produced low response
 and loose of tracking, that motivated us to exploit
 low level interface and continue learning the internals
 and specific conditions of the device and capture
 process.

For what I've seen OpenNI response time and precision is quite acceptable (if you can live without finger precision, of course). It works well even using OSC. I thought it wouldn't work at all and I would need to use FFI to access the libraries, but I was wrong.
 
Cheers
Richo

PS. Good luck with the campaign! I look forward to see what you make :)

 
have fun!
Ale.
 
    We are still looking for our first donor!
 
 
----- Original Message -----
Sent: Wednesday, January 19, 2011 6:04 PM
Subject: [squeak-dev] Kinect and Etoys

Hi guys!
I want to tell you some exciting news. Thanks to the ESUG Innovation Technology Awards we've been able to buy ourselves a Microsoft Kinect. We don't have a Xbox 360 yet, but that doesn't mean we can't have a little fun with it. Who needs and Xbox if you can use Kinect with Etoys? :)

After seeing Stephen Howell's great work using Kinect with Scratch, we followed his steps and made it available for Etoys as well. 

You can find installation steps in our blog: http://tecnodacta.com.ar/gira

Cheers!
Richo