[squeak-dev] Threaded ODBC

Hello,

I was just wondering if anyone knew what work would be required to provide a threaded ODBC connection in Squeak similar to what is available for VisualWorks or Smalltalk/X.  The ability to not freeze the VM while running a query would be very useful for me, but I don't even know where to start.

Or, is it a bigger issue than just ODBC, something buried deep within the VM and/or the FFI?

Thanks,

Rob

2008/5/10 Rob Rothwell <[hidden email]>:
Someone could make a plugin, which will call ODBC from separate native
thread, without blocking VM thread and blocking only  caller Process.
It can be even me :)

Also see an GSoC OpenDBX project, not taken by anyone, but i seen
someone recently started to code initial bindings to it.
http://wiki.squeak.org/squeak/6036
Who is it? Please raise the hand! :)

> Thanks,
>
> Rob
>


--
Best regards,
Igor Stasenko AKA sig.

On Sat, 10 May 2008 20:06:22 +0200, Igor Stasenko wrote:

Did you mean

- http://www.squeaksource.com/SqueakDBX.html

/Klaus

>> Thanks,
>>
>> Rob
>>
>
>

On 5/10/08, Igor Stasenko <[hidden email]> wrote:

Someone could make a plugin, which will call ODBC from separate native
thread, without blocking VM thread and blocking only  caller Process.
It can be even me :)

On 5/10/08, Klaus D. Witzel <[hidden email]> wrote:

Also see an GSoC OpenDBX project, not taken by anyone, but i seen
someone recently started to code initial bindings to it.
<a href="http://wiki.squeak.org/squeak/6036" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">http://wiki.squeak.org/squeak/6036
Who is it? Please raise the hand! :)

Did you mean

- <a href="http://www.squeaksource.com/SqueakDBX.html" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">http://www.squeaksource.com/SqueakDBX.html

Does anyone have any experience with this?  What makes it different from the standard ODBC?

Rob

2008/5/10 Rob Rothwell <[hidden email]>: You can read about it here
http://www.linuxnetworks.de/doc/index.php/OpenDBX


> Rob
>
>
>
>



--
Best regards,
Igor Stasenko AKA sig.

2008/5/10 Klaus D. Witzel <[hidden email]>:
Yes.
It is likely, that i will need to use DB connection with MS-Sql and
MySql servers from squeak, so i'm interested in progress of this as
well.



--
Best regards,
Igor Stasenko AKA sig.

On 5/10/08, Igor Stasenko <[hidden email]> wrote:

You can read about it here
http://www.linuxnetworks.de/doc/index.php/OpenDBX

On 5/10/08, Igor Stasenko <[hidden email]> wrote:

Yes.
It is likely, that i will need to use DB connection with MS-Sql and
MySql servers from squeak, so i'm interested in progress of this as
well.

Well...it would be fun to actually contribute something useful.  I'm not sure what the next step would be, short of moving off the list and beginning the conversation!

I guess I am most interested in making Squeak..."business useful" for "non-genious" users like myself!

Rob

2008/5/10 Rob Rothwell <[hidden email]>:
I can help with windoze port of openDbx. Lets hope its wouldn't be too hard.
Also i can help with making generic binding of openDBX to squeak by
implementing a plugin.
But i'm not yet ready to start with it :)

> Rob
>



--
Best regards,
Igor Stasenko AKA sig.

On 5/10/08, Igor Stasenko <[hidden email]> wrote:

2008/5/10 Rob Rothwell <[hidden email]>:

I can help with windoze port of openDbx. Lets hope its wouldn't be too hard.
Also i can help with making generic binding of openDBX to squeak by
implementing a plugin.
But i'm not yet ready to start with it :)

Sounds good.  Is there anything I can try to learn in the meantime that would make me more useful?

Rob

I wrote a script that removes traits from a 3.9 or 3.8 image:
http://installer.pbwiki.org/UnloadTraits

In an image with Installer (preferably LPF), do:
Installer install: 'UnloadTraits'

I tested this in 3.10, 3.9, and 3.9.1

What it does:
- Stop all trait activity
- Recompile all classes into the old format
- Remove all traits from the system
- Get rid of pointers to traits or traits-related classes
- Remove/modify lots of methods that understand traits
  functionality
- Unload the traits package
- Install 3 stub methods so that Monticello versions descended
  from 3.9 still work

This is not a modular solution, but it does make a 3.10 or 3.9
system with no traits around anywhere, and the resulting image
is quite stable. I don't intend to make Traits loadable right
now, but if you want to, I can answer questions.

Have fun

--
Matthew Fulmer -- http://mtfulmer.wordpress.com/

On Sat, 10 May 2008 19:45:57 +0200, Rob Rothwell wrote:

> Hello,
>
> I was just wondering if anyone knew what work would be required to  
> provide a
> threaded ODBC connection in Squeak similar to what is available for
> VisualWorks or Smalltalk/X.  The ability to not freeze the VM while  
> running
> a query would be very useful for me, but I don't even know where to  
> start.

Out of curiosity, what would it be that you intend to let the users do  
while longish queries are tickling the db?

I ask with this background in mind: over several years I headed a team of  
developers who produced 1.5 releases/year of a  
(fat+GUI)client<->(shared+fast)db server app with between 6 and 60 GB data  
etc, 50+ installation sites (institutions with their own db server) and  
100+ users, with 98% of the db data being updated over night  
(incrementally). We brought down the app's db response time from minutes  
to seconds but still never found any reason for using non-blocking  
queries, because nothing much was there that could have been done by the  
user in the meantime.

Do you just want to see non-freezing queries running or have some other  
reason for that need?

/Klaus

> Or, is it a bigger issue than just ODBC, something buried deep within  
> the VM
> and/or the FFI?
>
> Thanks,
>
> Rob

2008/5/11, Klaus D. Witzel <[hidden email]>:
If you use Seaside: reply to other requests.

Cheers
Philippe

On Sun, 11 May 2008 10:22:46 +0200, Philippe Marschall wrote:

Sure, goes without saying. *but*what*else* ?

Klaus D. Witzel wrote:
> Philippe Marschall wrote:

>>>  Out of curiosity, what would it be that you intend to let the users do
>>> while longish queries are tickling the db?
>>
>> If you use Seaside: reply to other requests.
>
> Sure, goes without saying. *but*what*else* ?

For web apps it is really important not to block a whole web app server
while processing a single SQL request. What else? It can be another SQL
request running in parallel, or just building some web pages from a
cached data, etc etc. To repeat, threaded ODBC or something similar is
really needed for Squeak to be used in web app world.

Janko

--
Janko Mivšek
AIDA/Web
Smalltalk Web Application Server
http://www.aidaweb.si

2008/5/11, Klaus D. Witzel <[hidden email]>:
Doing the usual GUI updates (hover, progress bar, whatsoever) so that
the application does not appear "frozen".

On Sat, 10 May 2008 21:08:53 +0200, Rob Rothwell wrote:

Yes, sure. Igor+my have decided to build a new DB plugin for the  
MS$ platform, so that we perhaps no longer hear complaints about missing  
MS$+DB support (for the major/open DB vendors) in Squeak. You are invited  
to join us, we could make use of some input and also help with non-toy DB  
testing (and whatever you'd like to share or help with).

This is also an invitation to join the project, for Squeakers who asked  
for Oracle support on their MS$ platform.

Send email please.

/Klaus

> Rob

On Sun, 11 May 2008 11:09:11 +0200, Janko Mivšek wrote:

Yes web, yes seaside, yes generic_term_for_web_framework *but*what*else* ?

> Janko
>

On Sun, 11 May 2008 12:11:53 +0200, Philippe Marschall wrote:

We asked the users (releases 1-2 where developed by our "predecessors", we  
did the 3.x release series, the users where *very* well experienced :=  
plagued by DB response time). Guess what they asked for.

BTW: progress bar update is #fork work. Furthermore, you'll earn credit if  
you can predict the 100% base and the respective increments, of arbitrary  
db queries which are performed on some dedicated server multi-user,  
predict with a small epsilon (not like MS$ does it when they copy/move  
around files).