Need someone to test if NBOpenGL works for you on win32

> On Mon, 24 May 2010 09:03:24 -0500, Igor Stasenko <[hidden email]>
> wrote:
>
>> Hi,
>>
>> i just snapshotted my stuff with various fixes, to make it load
>> cleanly on pharo and squeak images.
>>
>> I'd like you to ask to test and load it and tell me if it works for you.
>
> Beautiful!  Works exactly as you describe; I'm on an older Windows XP
> system,
> 2.2ghz Athlon, 512M ram, NVidia 6200 graphics card w/ 256MB.  The animation
> loop's
> running fast and smooth, and doesn't seem to be giving much cpu load.
>

>
> In both images, i used:
>
> Display depth 32
> Display isLittleEndian  true
>
>
> --
> Best regards,
> Igor Stasenko AKA sig.
>
>

> On Mon, 24 May 2010, Igor Stasenko wrote:
>
>> Btw, i noticed that running it full-screen in pharo is still quite
>> fast and smooth,
>> which makes me wonder, what extra a squeak image does to perform
>> blitting on screen.
>> Something slows things down there.
>
> Did you try the profiler (Extras menu)? I found it pretty useful when I was
> hacking RFB recently.
>

>
> Levente
>
>>
>> In both images, i used:
>>
>> Display depth 32
>> Display isLittleEndian  true
>>
>>
>> --
>> Best regards,
>> Igor Stasenko AKA sig.
>>
>>
>
>

> On 24 May 2010 23:06, Levente Uzonyi<[hidden email]>  wrote:
>> On Mon, 24 May 2010, Igor Stasenko wrote:
>>
>>> Btw, i noticed that running it full-screen in pharo is still quite
>>> fast and smooth,
>>> which makes me wonder, what extra a squeak image does to perform
>>> blitting on screen.
>>> Something slows things down there.
>>
>> Did you try the profiler (Extras menu)? I found it pretty useful when I was
>> hacking RFB recently.
>>
>
> The tally looks weird :)

>   - 100146 tallies, 100419 msec.
>
> **Tree**
> --------------------------------
> Process: other processes
> --------------------------------
> 5.7% {5724ms} EventSensor>>eventTickler
>    5.7% {5724ms} Delay>>wait
>      5.7% {5724ms} primitives
> --------------------------------
> Process: (40) 43725: nil
> --------------------------------
> 94.3% {94695ms} WorldState>>doOneCycleFor:
>    94.3% {94695ms} WorldState>>doOneCycleNowFor:
>      93.9% {94293ms} WorldState>>displayWorldSafely:
>        93.9% {94293ms} PasteUpMorph>>displayWorld
>          93.9% {94293ms} PasteUpMorph>>privateOuterDisplayWorld
>            93.9% {94293ms} WorldState>>displayWorld:submorphs:
>              85.6% {85959ms} WorldState>>drawWorld:submorphs:invalidAreasOn:
>                |85.3% {85657ms} FormCanvas(Canvas)>>fullDrawMorph:
>                |  85.3% {85657ms} FormCanvas(Canvas)>>fullDraw:
>                |    85.3% {85657ms} SystemWindow(Morph)>>fullDrawOn:
>                |      39.6% {39766ms} SystemWindow(Morph)>>hasRolloverBorder
>                |        |39.6% {39766ms} primitives
>                |      34.2% {34343ms} SystemWindow(Morph)>>drawSubmorphsOn:
>                |        |34.1% {34243ms} FormCanvas(Canvas)>>fullDrawMorph:
>                |        |  34.1% {34243ms} FormCanvas(Canvas)>>fullDraw:
>                |        |    34.1% {34243ms} GLViewportMorph(Morph)>>fullDrawOn:
>                |        |      33.9% {34042ms} FormCanvas(Canvas)>>drawMorph:
>                |        |        33.9% {34042ms} FormCanvas(Canvas)>>draw:
>                |        |          33.9% {34042ms} GLViewportMorph>>drawOn:
>                |        |            32.8% {32937ms}
> NBMSAAOffscreenDisplay>>updateForm:bounds:
>                |        |              32.7% {32837ms}
> NBGLFrameBuffer>>bindAsDrawBuffer
>                |      11.0% {11046ms} FormCanvas(Canvas)>>drawMorph:
>                |        10.9% {10946ms} FormCanvas(Canvas)>>draw:
>                |          10.9% {10946ms} SystemWindow(Morph)>>drawOn:
>                |            10.9% {10946ms}
> FormCanvas(Canvas)>>fillRectangle:fillStyle:borderStyle:
>                |              10.8% {10845ms}
> FormCanvas>>fillRectangle:fillStyle:
>                |                10.8% {10845ms}
> FormCanvas>>balloonFillRectangle:fillStyle:
>                |                  10.8% {10845ms}
> BalloonCanvas>>fillRectangle:fillStyle:
>                |                    10.8% {10845ms}
> BalloonCanvas>>drawRectangle:color:borderWidth:borderColor:
>                |                      10.7% {10745ms}
> BalloonEngine>>drawRectangle:fill:bor...borderColor:transform:
>                |                        10.7% {10745ms}
> BalloonEngine>>postFlushIfNeeded
>                |                          10.7% {10745ms} BalloonEngine>>copyBits
>                |                            10.7% {10745ms}
> BalloonEngine>>copyLoopFaster
>                |                              10.7% {10745ms} primitives
>              8.3% {8335ms} WorldState>>forceDamageToScreen:
>                8.3% {8335ms} DisplayScreen>>forceDamageToScreen:
>                  8.3% {8335ms} OrderedCollection>>do:
> 
> **Leaves**
> 39.6% {39766ms} SystemWindow(Morph)>>hasRolloverBorder
> 32.7% {32837ms} NBGLFrameBuffer>>bindAsDrawBuffer
> 10.7% {10745ms} BalloonEngine>>copyLoopFaster
> 8.3% {8335ms} OrderedCollection>>do:
> 5.7% {5724ms} Delay>>wait
>
> **Memory**
> old +193,508 bytes
> young +173,384 bytes
> used +366,892 bytes
> free -366,892 bytes
>
> **GCs**
> full 0 totalling 0ms (0.0% uptime)
> incr 1331 totalling 356ms (0.0% uptime), avg 0.0ms
> tenures 2 (avg 665 GCs/tenure)
> root table 0 overflows
>
> --------
> This is weird it shows that it spends 40% of time in
> SystemWindow(Morph)>>hasRolloverBorder
>
> The actual workload should be concentrated here:
>                |        |            32.8% {32937ms}
> NBMSAAOffscreenDisplay>>updateForm:bounds:
>                |        |              32.7% {32837ms}
> NBGLFrameBuffer>>bindAsDrawBuffer
>
> but it takes only 1/3 of all time (this is including blitting bits
> back to system memory).
>
>
>
> What is interesting, that if there is no copy to system memory,
> rendering these simple things (about
> 60 glyphs with nice AA), takes less than 2% of time:
>
>                |                  1.6% {689ms} GLViewportMorph>>drawOn:
>
> while most of the time, again spent in #hasRolloverBorder
> **Leaves**
> 61.3% {26403ms} SystemWindow(Morph)>>hasRolloverBorder
> 15.9% {6848ms} BalloonEngine>>copyLoopFaster
> 12.0% {5169ms} OrderedCollection>>do:
> 4.7% {2024ms} Delay>>wait
>
> So, it could run 32%/2% ~~ 16 times faster
>
>
>>
>> Levente
>>
>>>
>>> In both images, i used:
>>>
>>> Display depth 32
>>> Display isLittleEndian  true
>>>
>>>
>>> --
>>> Best regards,
>>> Igor Stasenko AKA sig.
>>>
>>>
>>
>>
>
>
>

> On 5/24/2010 1:28 PM, Igor Stasenko wrote:
>>
>> On 24 May 2010 23:06, Levente Uzonyi<[hidden email]>  wrote:
>>>
>>> On Mon, 24 May 2010, Igor Stasenko wrote:
>>>
>>>> Btw, i noticed that running it full-screen in pharo is still quite
>>>> fast and smooth,
>>>> which makes me wonder, what extra a squeak image does to perform
>>>> blitting on screen.
>>>> Something slows things down there.
>>>
>>> Did you try the profiler (Extras menu)? I found it pretty useful when I
>>> was
>>> hacking RFB recently.
>>>
>>
>> The tally looks weird :)
>
> http://lists.squeakfoundation.org/pipermail/squeak-dev/2009-February/134405.html
>
> A real-world case of issue #3.
>

> Cheers,
>  - Andreas
>
>>  - 100146 tallies, 100419 msec.
>>
>> **Tree**
>> --------------------------------
>> Process: other processes
>> --------------------------------
>> 5.7% {5724ms} EventSensor>>eventTickler
>>   5.7% {5724ms} Delay>>wait
>>     5.7% {5724ms} primitives
>> --------------------------------
>> Process: (40) 43725: nil
>> --------------------------------
>> 94.3% {94695ms} WorldState>>doOneCycleFor:
>>   94.3% {94695ms} WorldState>>doOneCycleNowFor:
>>     93.9% {94293ms} WorldState>>displayWorldSafely:
>>       93.9% {94293ms} PasteUpMorph>>displayWorld
>>         93.9% {94293ms} PasteUpMorph>>privateOuterDisplayWorld
>>           93.9% {94293ms} WorldState>>displayWorld:submorphs:
>>             85.6% {85959ms}
>> WorldState>>drawWorld:submorphs:invalidAreasOn:
>>               |85.3% {85657ms} FormCanvas(Canvas)>>fullDrawMorph:
>>               |  85.3% {85657ms} FormCanvas(Canvas)>>fullDraw:
>>               |    85.3% {85657ms} SystemWindow(Morph)>>fullDrawOn:
>>               |      39.6% {39766ms}
>> SystemWindow(Morph)>>hasRolloverBorder
>>               |        |39.6% {39766ms} primitives
>>               |      34.2% {34343ms} SystemWindow(Morph)>>drawSubmorphsOn:
>>               |        |34.1% {34243ms} FormCanvas(Canvas)>>fullDrawMorph:
>>               |        |  34.1% {34243ms} FormCanvas(Canvas)>>fullDraw:
>>               |        |    34.1% {34243ms}
>> GLViewportMorph(Morph)>>fullDrawOn:
>>               |        |      33.9% {34042ms}
>> FormCanvas(Canvas)>>drawMorph:
>>               |        |        33.9% {34042ms} FormCanvas(Canvas)>>draw:
>>               |        |          33.9% {34042ms} GLViewportMorph>>drawOn:
>>               |        |            32.8% {32937ms}
>> NBMSAAOffscreenDisplay>>updateForm:bounds:
>>               |        |              32.7% {32837ms}
>> NBGLFrameBuffer>>bindAsDrawBuffer
>>               |      11.0% {11046ms} FormCanvas(Canvas)>>drawMorph:
>>               |        10.9% {10946ms} FormCanvas(Canvas)>>draw:
>>               |          10.9% {10946ms} SystemWindow(Morph)>>drawOn:
>>               |            10.9% {10946ms}
>> FormCanvas(Canvas)>>fillRectangle:fillStyle:borderStyle:
>>               |              10.8% {10845ms}
>> FormCanvas>>fillRectangle:fillStyle:
>>               |                10.8% {10845ms}
>> FormCanvas>>balloonFillRectangle:fillStyle:
>>               |                  10.8% {10845ms}
>> BalloonCanvas>>fillRectangle:fillStyle:
>>               |                    10.8% {10845ms}
>> BalloonCanvas>>drawRectangle:color:borderWidth:borderColor:
>>               |                      10.7% {10745ms}
>> BalloonEngine>>drawRectangle:fill:bor...borderColor:transform:
>>               |                        10.7% {10745ms}
>> BalloonEngine>>postFlushIfNeeded
>>               |                          10.7% {10745ms}
>> BalloonEngine>>copyBits
>>               |                            10.7% {10745ms}
>> BalloonEngine>>copyLoopFaster
>>               |                              10.7% {10745ms} primitives
>>             8.3% {8335ms} WorldState>>forceDamageToScreen:
>>               8.3% {8335ms} DisplayScreen>>forceDamageToScreen:
>>                 8.3% {8335ms} OrderedCollection>>do:
>>  **Leaves**
>> 39.6% {39766ms} SystemWindow(Morph)>>hasRolloverBorder
>> 32.7% {32837ms} NBGLFrameBuffer>>bindAsDrawBuffer
>> 10.7% {10745ms} BalloonEngine>>copyLoopFaster
>> 8.3% {8335ms} OrderedCollection>>do:
>> 5.7% {5724ms} Delay>>wait
>>
>> **Memory**
>>        old                     +193,508 bytes
>>        young           +173,384 bytes
>>        used            +366,892 bytes
>>        free            -366,892 bytes
>>
>> **GCs**
>>        full                    0 totalling 0ms (0.0% uptime)
>>        incr            1331 totalling 356ms (0.0% uptime), avg 0.0ms
>>        tenures         2 (avg 665 GCs/tenure)
>>        root table      0 overflows
>>
>> --------
>> This is weird it shows that it spends 40% of time in
>> SystemWindow(Morph)>>hasRolloverBorder
>>
>> The actual workload should be concentrated here:
>>               |        |            32.8% {32937ms}
>> NBMSAAOffscreenDisplay>>updateForm:bounds:
>>               |        |              32.7% {32837ms}
>> NBGLFrameBuffer>>bindAsDrawBuffer
>>
>> but it takes only 1/3 of all time (this is including blitting bits
>> back to system memory).
>>
>>
>>
>> What is interesting, that if there is no copy to system memory,
>> rendering these simple things (about
>> 60 glyphs with nice AA), takes less than 2% of time:
>>
>>               |                  1.6% {689ms} GLViewportMorph>>drawOn:
>>
>> while most of the time, again spent in #hasRolloverBorder
>> **Leaves**
>> 61.3% {26403ms} SystemWindow(Morph)>>hasRolloverBorder
>> 15.9% {6848ms} BalloonEngine>>copyLoopFaster
>> 12.0% {5169ms} OrderedCollection>>do:
>> 4.7% {2024ms} Delay>>wait
>>
>> So, it could run 32%/2% ~~ 16 times faster
>>
>>
>>>
>>> Levente
>>>
>>>>
>>>> In both images, i used:
>>>>
>>>> Display depth 32
>>>> Display isLittleEndian  true
>>>>
>>>>
>>>> --
>>>> Best regards,
>>>> Igor Stasenko AKA sig.
>>>>
>>>>
>>>
>>>
>>
>>
>>
>
>
>

> On Mon, 24 May 2010 13:07:20 -0500, Igor Stasenko <[hidden email]>
> wrote:
>>
>> On 24 May 2010 20:20, Kevin Kelley <[hidden email]> wrote:
>>>
>>>>  The animation loop's
>>>
>>> running fast and smooth, and doesn't seem to be giving much cpu load.
>>>
>>
>> Well, actually it does :)
>
> Okay, so the memcopy's are taking up a little bit of time; still, the big
> win
> so far is having the gpu render the font glyph based on just the outline
> data,
> you're getting scalable fonts on the fly effectively for free.  This is
> seriously
> cool.
>
> That GPU gems link (
> http://http.developer.nvidia.com/GPUGems3/gpugems3_ch25.html )
> referenced in your code is a good explanation.  Shaders kind of break my
> brain,
> I'm glad to see this one in and working.
>

> On 5/24/2010 7:03 AM, Igor Stasenko wrote:
>>
>> - first, you need to have VM with NativeBoost plugin + NativeBoost
>> loaded into an image
>> (see http://code.google.com/p/nativeboost/wiki/Installation for
>> instructions)
>
> The page doesn't have any information on how to download the binary plugin.
> Do I really need to rebuild it from sources?
>

>> - then load the OpenGL stuff from http://www.squeaksource.com/NBOpenGL
>> in following order:
>>
>> - NBOpenGL-Core
>> - NBOpenGL-Win
>
> This fails with the following error:
>
> --------------------------------------------------------------
>
> This package depends on the following classes:
>  NBWinTypes
>  NBWinConstants
> You must resolve these dependencies before you will be able to load these
> definitions:
>  GLPixelFormatDescriptor
>  ....
> --------------------------------------------------------------
>
>> i tried the above on Pharo-1.1-11367-Betadev10.05.1.image , which were
>> released recently, and it seems works ok.
>> on squeak/trunk it should also work without problems.
>
> I've used 4.1 but I don't think this should matter for the above, no?
>

> On 5/24/2010 6:17 PM, Igor Stasenko wrote:
>>
>> You can just take a prebuilt VM from
>> http://code.google.com/p/nativeboost/downloads/list
>
> Okay, good, that's what I did. FWIW, there's an installation bug for NB.
> When you run "NBInstaller install" *without* the plugin, it will fail to
> determine the platform id and will not install the Windows stuff. That's
> what caused my later problems. I would recommend installing *all* platform
> examples regardless of actual platform id to avoid issues like these. I find
> Unix examples just as instructive as Windows examples ;-)
>

> When I fix that it gets me to an
> GL_FRAMEBUFFER_INCOMPLETE_ATTACHMENT and that's where I'm at right now. In
> case it helps, the offending code is in
>
> NBMSAAOffscreenDisplay>>initDisplay
>        "perform a usual initializations"
>        renderFBO := NBGLFrameBuffer new initialize: self gl extent: extent.
>        renderFBO createMultisampleAttachments: 4.
>        renderFBO checkStatus.
>        "... more stuff ..."
>
> Any ideas what to look for? I have an ATI Mobility Radeon HD 4330 running
> Windows 7.
>

Yeah.. this is a black voodoo.

> On 25 May 2010 07:22, Andreas Raab <[hidden email]> wrote:
>> On 5/24/2010 8:32 PM, Igor Stasenko wrote:
>>>
>>> It either your card doesn't supports MSAA,
>>> or driver don't likes the FBO configuration which i provided.
>>
>> I think the error code indicates a problem with the FBO configuration. For
>> example, check out the restrictions on OpenGL ES for this stuff:
>>
>> http://www.khronos.org/opengles/sdk/doc/man/glCheckFramebufferStatus.xml
>>
>> It seems as if one needs to be very picky for getting the 'right'
>> configuration on all platforms. Is there an enumeration by any chance that
>> allows one to pick the proper (supported) configuration?
>>
> Yeah.. this is a black voodoo.
> For instance, my video card rejects FBO with color+stencil only
> (that's all what i need).
> You may try various things in
> NBGLFrameBuffer>>createMultisampleAttachments: numSamples
> or in NBGLFrameBuffer>>createAttachments
>
>>> Check that
>>>
>>> NBWinContextState new pixelFormatInfo extensions includes:
>>> #GL_EXT_packed_depth_stencil
>>
>> It's there.
>>
>>> Also, you could try running with MSAA turned off, go to
>>> NBGLDisplay class>>pickImplementation
>>>  and put comment around " ^ NBMSAAOffscreenDisplay  "
>>
>> That appears to work but the glyphs are drawn "improperly" (see screenshot).
>> I'm not sure if that's the way they're intended to be rendered or if that's
>> an artifact of running a different configuration.
>>
>
> Yes, its improper. It looks like that when you don't have a stencil
> buffer (or have it disabled).
> Your screenshot also shows that you got my little shader running
> properly which is used to render quad beziers.
> And this is more important than stencil (i think it could be solved by
> picking different FBO attachment formats).
>
>
>> Cheers,
>>  - Andreas
>>
>
>
> --
> Best regards,
> Igor Stasenko AKA sig.
> <GL viewport.png>

> Cheers,
> Josh
>
>
>
> On May 24, 2010, at 9:48 PM, Igor Stasenko wrote:
>
>> On 25 May 2010 07:22, Andreas Raab <[hidden email]> wrote:
>>> On 5/24/2010 8:32 PM, Igor Stasenko wrote:
>>>>
>>>> It either your card doesn't supports MSAA,
>>>> or driver don't likes the FBO configuration which i provided.
>>>
>>> I think the error code indicates a problem with the FBO configuration. For
>>> example, check out the restrictions on OpenGL ES for this stuff:
>>>
>>> http://www.khronos.org/opengles/sdk/doc/man/glCheckFramebufferStatus.xml
>>>
>>> It seems as if one needs to be very picky for getting the 'right'
>>> configuration on all platforms. Is there an enumeration by any chance that
>>> allows one to pick the proper (supported) configuration?
>>>
>> Yeah.. this is a black voodoo.
>> For instance, my video card rejects FBO with color+stencil only
>> (that's all what i need).
>> You may try various things in
>> NBGLFrameBuffer>>createMultisampleAttachments: numSamples
>> or in NBGLFrameBuffer>>createAttachments
>>
>>>> Check that
>>>>
>>>> NBWinContextState new pixelFormatInfo extensions includes:
>>>> #GL_EXT_packed_depth_stencil
>>>
>>> It's there.
>>>
>>>> Also, you could try running with MSAA turned off, go to
>>>> NBGLDisplay class>>pickImplementation
>>>>  and put comment around " ^ NBMSAAOffscreenDisplay  "
>>>
>>> That appears to work but the glyphs are drawn "improperly" (see screenshot).
>>> I'm not sure if that's the way they're intended to be rendered or if that's
>>> an artifact of running a different configuration.
>>>
>>
>> Yes, its improper. It looks like that when you don't have a stencil
>> buffer (or have it disabled).
>> Your screenshot also shows that you got my little shader running
>> properly which is used to render quad beziers.
>> And this is more important than stencil (i think it could be solved by
>> picking different FBO attachment formats).
>>
>>
>>> Cheers,
>>>  - Andreas
>>>
>>
>>
>> --
>> Best regards,
>> Igor Stasenko AKA sig.
>> <GL viewport.png>
>
>
>