Re: FFI crashes VM on Linux (was: Z3950 on OSX: module yaz3 not found)

> Which VM have you used ?
> I cross post to vm-dev list.
> Laurent.
> On Fri, Dec 24, 2010 at 3:54 AM, Hernán Morales Durand
> <[hidden email]> wrote:
>>
>> Laurent, not much progress here :(
>> I just reproduced the Unix VM crash. First I've linked the library so
>> we do not have to change every module name call
>>
>> user@ubuntu:/usr/lib$ ln -T -s /usr/lib/libyaz.so.3.0.0 yaz
>>
>> and I've tried to execute the library tracer in the shell script
>>
>> ltrace -f -l /usr/lib/libyaz.so.3.0.0 -o out.txt "$BASE/squeakvm" \
>>        -plugins "$BASE" \
>>        -encoding latin1 \
>>        -vm-display-X11 \
>>        "$ROOT/Contents/Resources/pharo.image"
>>
>> but it crash the VM too with an unhandled exception even before the
>> GUI is displayed.
>> What I've observed is that every FFI call which receives an
>> ExternalStructure as parameter kills the VM. This is weird because
>> this doesn't happen in the Windows VM. I ran this little script I use
>> to debug the library
>>
>> | conn lib rs rsSize records |
>> lib := Z3950FFILibrary default.
>> conn := lib
>>        createConnectionTo: #Alabama asZ3950Server hostName
>>        port: 7090.
>> lib createOptions.
>> lib
>>        setConnection: conn
>>        optionName: 'preferredRecordSyntax'
>>        optionValue: 'USMARC'.
>> rs := lib
>>        searchPqf: conn
>>        query:  '@attr 1=1003 collins'.
>> rsSize := lib resultSetSize: rs.
>> rsSize > 0
>>        ifFalse:  [ 'no results' ].
>> records := Array new: rsSize.
>> 0 to: rsSize - 1 do: [: pos |
>>        record := lib resultSetRecord: rs position: pos.
>>        record isNil not
>>                ifTrue:  [
>>                        records
>>                                at: pos + 1
>>                                put: ( lib
>>                                        getRecord: record
>>                                        function: 'render; charset=marc8,
>> iso8859-1'
>>                                        length: nil ). ] ].
>> records
>>
>> and the the doIt just hangs the VM, the console output going through
>> the Debugger is the following:
>>
>> Segmentation fault
>>
>> -1370902312 ContextPart>doPrimitive:method:receiver:args:
>> -1370902404 ContextPart>tryPrimitiveFor:receiver:args:
>> -1370902788 ContextPart>send:to:with:super:
>> -1370902896 ContextPart>send:super:numArgs:
>> -1370902988 InstructionStream>interpretExtension:in:for:
>> -1370903080 InstructionStream>interpretNextInstructionFor:
>> -1370903172 ContextPart>step
>> -1370903280 Process>step
>> -1370903372 Process>step:
>> -1370920392 Debugger>send
>> -1370937720 PluggableButtonMorph>performAction
>> -1370937812 PluggableButtonMorph>mouseUp:
>> -1370937996 SequenceableCollection>do:
>> -1370957140 PluggableButtonMorph>mouseUp:
>> -1370957232 Morph>handleMouseUp:
>> -1370957324 MouseButtonEvent>sentTo:
>> -1370957416 Morph>handleEvent:
>> -1370957584 Morph>handleFocusEvent:
>> -1370957676 HandMorph>sendFocusEvent:to:clear:
>> -1370957768 PasteUpMorph>becomeActiveDuring:
>> -1370957860 BlockClosure>on:do:
>> -1370957992 PasteUpMorph>becomeActiveDuring:
>> -1370958084 HandMorph>sendFocusEvent:to:clear:
>> -1370958260 HandMorph>sendEvent:focus:clear:
>> -1370958352 HandMorph>sendMouseEvent:
>> -1370958444 HandMorph>handleEvent:
>> -1370966728 HandMorph>processEvents
>> -1370966836 WorldState>doOneCycleNowFor:
>> -1370966952 SequenceableCollection>do:
>> -1370967044 WorldState>handsDo:
>> -1370967136 WorldState>doOneCycleNowFor:
>> -1370969680 WorldState>doOneCycleFor:
>> -1370969772 PasteUpMorph>doOneCycle
>> -1383611064 >spawnNewProcess
>> -1383611192 BlockClosure>newProcess
>> Aborted
>>
>> it would be nice if someone could tell something about debugging FFI
>> calls, or just any idea to try.
>> Cheers,
>>
>> Hernán
>>
>> 2010/12/23 laurent laffont <[hidden email]>:
>> > Hi,
>> > I have unmangled all function names. Image also crashes when evaluating
>> > the
>> > Kant test. (but this time I get ILLEGAL INSTRUCTION on strace). I've
>> > tried
>> > with Cog and the VM in the Seaside OneClick.
>> > I've uploaded the modified packages on squeaksource
>> > here: http://www.squeaksource.com/LaurentLSandbox.html   (you can use
>> > Z3950Slice to load all at once).
>> > Laurent
>> >
>> >
>> >
>> > On Thu, Dec 23, 2010 at 1:57 AM, Hernán Morales Durand
>> > <[hidden email]> wrote:
>> >>
>> >> Hi Laurent,
>> >>
>> >> Thanks for the feedback, I've uploaded the repository with the missing
>> >> method but I cannot reproduce the crash in Windows. Have you unmangled
>> >> every function name tested? Are you running just the
>> >> Z3950FFILibraryTest? Notice the Z3950FFIServerLibraryTest tests are
>> >> performed against a Z39.50 server running in local host, otherwise
>> >> will fail (however that shouldn't crash the VM), so you may want to
>> >> run only the Z3950FFILibraryTest suite. If you or anyone want a local
>> >> Zebra server for Win32 - although most configuration files should work
>> >> with other platforms - for testing purposes please let me know.
>> >>
>> >> Does the Kant test crash the VM too?
>> >>
>> >> Z3950Client new
>> >>  server: #Acadia;
>> >>  query: ( Z3950Query new author: 'Kant' ).
>> >>
>> >> (see http://67.222.12.200:8889/WebOpus/52 for sample successful
>> >> results)
>> >>
>> >> I will set up a Linux box tomorrow and try to reproduce there.
>> >> Cheers,
>> >>
>> >> 2010/12/22 laurent laffont <[hidden email]>:
>> >> > Hi Hernan,
>> >> > finally I switch back to Linux to make it work, OSX gives me
>> >> > headaches.
>> >> > So on linux the yaz module is found. I get the "Unable to find
>> >> > function
>> >> > address" but I found that writing:
>> >> > <cdecl: ZOOMOptions 'ZOOM_options_create' (void) module: 'yaz'>
>> >> > instead of
>> >> > <cdecl: ZOOMOptions '_ZOOM_options_create@0' (void) module: 'yaz3'>
>> >> > works. If I understand, function names are not mangled when compiling
>> >> > with
>> >> > gcc on Linux.
>> >> >
>> >> > Trying to run tests I've also had a "could not coerce arguments" in
>> >> > Z3950FFILibrary>>createConnectionTo:port because
>> >> > Z3950TestCase>>portNumber
>> >> > answers a String and
>> >> > <cdecl: ZOOMConnection 'ZOOM_connection_new' (char* short) module:
>> >> > 'yaz'>
>> >> > so it's waiting for a short. I've replaced portNumber to answer a
>> >> > SmallInteger.
>> >> > And now the image crashes on connectionIsIdle call:
>> >> > write(1, "\ncreateConnectionTo:port:", 25) = 25
>> >> > write(1, "\nconnectionIsIdle:", 18)     = 18
>> >> > rt_sigprocmask(SIG_UNBLOCK, [ABRT], NULL, 8) = 0
>> >> > write(1, "\n", 1)                       = 1
>> >> > tgkill(25830, 25830, SIGABRT)           = 0
>> >> > --- SIGABRT (Aborted) @ 0 (0) ---
>> >> >
>> >> > Any idea ?
>> >> >
>> >> > Laurent Laffont
>> >> >
>> >> > On Tue, Dec 21, 2010 at 7:58 AM, laurent laffont
>> >> > <[hidden email]>
>> >> > wrote:
>> >> >>
>> >> >> The module is found ! How:
>> >> >> - Using VM Squeak 5.8b12 2  (instead of Cog or the VM provided in
>> >> >> Seaside
>> >> >> One-Click image)
>> >> >> - go in Squeak\ 5.8b12\ 2.app/Contents/Resources/, then ln -s
>> >> >> /usr/local/lib/libyaz.3.dylib .
>> >> >> Now I have the "Unable to find function address" you have talked
>> >> >> earlier
>> >> >> :) I will look at the mangled function names.
>> >> >>
>> >> >> Laurent  --- on the road to the FFI mountain.
>> >> >>
>> >> >> On Tue, Dec 21, 2010 at 6:59 AM, Hernán Morales Durand
>> >> >> <[hidden email]> wrote:
>> >> >>>
>> >> >>> Laurent,
>> >> >>> I forward this e-mail to the squeak mailing list, may be someone
>> >> >>> there
>> >> >>> have a better idea how the OSX VM works. BTW there are more
>> >> >>> commentaries here
>> >> >>>
>> >> >>>
>> >> >>>
>> >> >>> http://forum.world.st/squeak-dev-Alien-amp-Squeak-FFI-issues-on-Snow-Leopard-td85608.html
>> >> >>> Cheers,
>> >> >>>
>> >> >>> Hernán
>> >> >>>
>> >> >>> 2010/12/20 laurent laffont <[hidden email]>:
>> >> >>> > Hi Hernan,
>> >> >>> > the strace equivalent on OSX seems to be dtruss (yes I'm learning
>> >> >>> > OSX
>> >> >>> > too :)
>> >> >>> > sudo dtruss -p [pid of process]
>> >> >>> > in the trace I have this:
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > stat("/Users/laurentlaffont/Downloads/Seaside.app/Contents/Resources/yaz3.bundle/Contents/MacOS/yaz3\0",
>> >> >>> > 0xBFF59440, 0xBFF5AB28) = -1 Err#2
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > stat64("/Users/laurentlaffont/Downloads/Seaside.app/Contents/Resources/yaz3.bundle/Contents/MacOS/yaz3\0",
>> >> >>> > 0xBFF5892C, 0xBFF5AB28) = -1 Err#2
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > stat("/Users/laurentlaffont/Downloads/Seaside.app/Contents/Resources/yaz3\0",
>> >> >>> > 0xBFF59440, 0xBFF5AB28) = 0 0
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > stat64("/Users/laurentlaffont/Downloads/Seaside.app/Contents/Resources/yaz3\0",
>> >> >>> > 0xBFF5892C, 0xBFF5AB28) = 0 0
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > open("/Users/laurentlaffont/Downloads/Seaside.app/Contents/Resources/yaz3\0",
>> >> >>> > 0x0, 0x0) = 12 0
>> >> >>> > pread(0xC, "\317\372\355\376\a\0", 0x1000, 0x0) = 4096 0
>> >> >>> > close(0xC) = 0 0
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > stat("/Users/laurentlaffont/Downloads/Plugins/yaz3.bundle/Contents/MacOS/yaz3\0",
>> >> >>> > 0xBFF59440, 0x1000) = -1 Err#2
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > stat64("/Users/laurentlaffont/Downloads/Plugins/yaz3.bundle/Contents/MacOS/yaz3\0",
>> >> >>> > 0xBFF5892C, 0x1000) = -1 Err#2
>> >> >>> > stat("/Users/laurentlaffont/Downloads/Plugins/yaz3\0",
>> >> >>> > 0xBFF59440,
>> >> >>> > 0x1000) =
>> >> >>> > -1 Err#2
>> >> >>> > stat64("/Users/laurentlaffont/Downloads/Plugins/yaz3\0",
>> >> >>> > 0xBFF5892C,
>> >> >>> > 0x1000)
>> >> >>> > = -1 Err#2
>> >> >>> >
>> >> >>> > so it looks like the VM is trying to find yaz3 at non standard
>> >> >>> > Unix
>> >> >>> > places
>> >> >>> > (I don't know if it's SqueakVM or OSX related).
>> >> >>> > I've created Contents/Resources/yaz3.bundle/Contents/MacOS/, put
>> >> >>> > yaz
>> >> >>> > lib
>> >> >>> > there, ln -s libyaz.3.dylib yaz3 but no success.
>> >> >>> >
>> >> >>> > I've read good
>> >> >>> > post http://forum.world.st/FFI-Documentation-td2225150.html :
>> >> >>> >
>> >> >>> > Module Location - where the external library file lives
>> >> >>> >       - depends on the platform
>> >> >>> >               - Mac
>> >> >>> >                       - pre Snow Leopard
>> >> >>> >                               - checks VM path and common library
>> >> >>> > paths
>> >> >>> >                       - Snow Leopard
>> >> >>> >                               - only looks in VM bundle's
>> >> >>> > Resources
>> >> >>> > file, you must either [5]:
>> >> >>> >                                       - store all external
>> >> >>> > libraries
>> >> >>> > there
>> >> >>> >                                       - ln -s path/to/library
>> >> >>> > path/to/VM/Resources/library_name
>> >> >>> >                                       - Change the VM's
>> >> >>> > Info.plist
>> >> >>> > "SqueakPluginsBuiltInOrLocalOnly" key from
>> >> >>> > "true" to "false."
>> >> >>> >
>> >> >>> > For this SqueakPluginsBuiltInOrLocalOnly I suppose I need to
>> >> >>> > compile
>> >> >>> > a
>> >> >>> > VM ?
>> >> >>> > Cheers,
>> >> >>> > Laurent Laffont
>> >> >>> >
>> >> >>> >
>> >> >>> > On Mon, Dec 20, 2010 at 4:12 PM, Hernán Morales Durand
>> >> >>> > <[hidden email]> wrote:
>> >> >>> >>
>> >> >>> >> Hi Laurent
>> >> >>> >>
>> >> >>> >> I've read there is a couple of system calll monitors in MacOS,
>> >> >>> >> ktrace
>> >> >>> >> and dtrace (http://en.wikipedia.org/wiki/Ktrace ,
>> >> >>> >> http://en.wikipedia.org/wiki/DTrace) so you may attach to the VM
>> >> >>> >> and
>> >> >>> >> see what's missing?
>> >> >>> >> Cheers,
>> >> >>> >>
>> >> >>> >> Hernán
>> >> >>> >>
>> >> >>> >> 2010/12/20 laurent laffont <[hidden email]>:
>> >> >>> >> > Thanks Hernan.
>> >> >>> >> > It still doesn't work. I've also tried to play with
>> >> >>> >> > LD_LOAD_PATH
>> >> >>> >> > /
>> >> >>> >> > LD_LIBRARY_PATH no success.... I want to make it work so I
>> >> >>> >> > need
>> >> >>> >> > to
>> >> >>> >> > learn
>> >> >>> >> > :)
>> >> >>> >> >
>> >> >>> >> > For the mangled function names, on Linux and OSX there's nm.
>> >> >>> >> > Here's what I get:
>> >> >>> >> > $ nm -g libyaz.3.dylib | grep ZOOM_connection_create
>> >> >>> >> > 0000000000046a30 T _ZOOM_connection_create
>> >> >>> >> > Cheers,
>> >> >>> >> > Laurent
>> >> >>> >> >
>> >> >>> >> > On Sun, Dec 19, 2010 at 6:23 PM, Hernán Morales Durand
>> >> >>> >> > <[hidden email]> wrote:
>> >> >>> >> >>
>> >> >>> >> >> Hi Laurent,
>> >> >>> >> >>
>> >> >>> >> >> Thanks for reporting. The correct #moduleName for MacOS was
>> >> >>> >> >> missing,
>> >> >>> >> >> I've uploaded a new version answering 'libyaz.3.dylib' which
>> >> >>> >> >> I
>> >> >>> >> >> guess
>> >> >>> >> >> is the corresponding for 'yaz3.dll' (according to
>> >> >>> >> >> http://en.wikipedia.org/wiki/Dynamic_library#Naming ).
>> >> >>> >> >>
>> >> >>> >> >> I haven't access to a MacOS, but in Windows I've had to find
>> >> >>> >> >> the
>> >> >>> >> >> mangled function names (i.e. _ZOOM_connection_create@4) so
>> >> >>> >> >> FFI
>> >> >>> >> >> can
>> >> >>> >> >> find the function addresses and you don't get the classic
>> >> >>> >> >> "Error:
>> >> >>> >> >> Unable to find function address". I don't know if it's
>> >> >>> >> >> related
>> >> >>> >> >> since
>> >> >>> >> >> talks about C++, but you may want to check
>> >> >>> >> >> http://wiki.squeak.org/squeak/3735
>> >> >>> >> >>
>> >> >>> >> >> The tool I've used to find the mangled function names in
>> >> >>> >> >> Windows
>> >> >>> >> >> is
>> >> >>> >> >> the Steve Miller's Dependency Walker
>> >> >>> >> >> http://www.dependencywalker.com/
>> >> >>> >> >>
>> >> >>> >> >> 2010/12/19 laurent laffont <[hidden email]>:
>> >> >>> >> >> > Hi,
>> >> >>> >> >> >
>> >> >>> >> >> > I want to use http://www.squeaksource.com/Z3950
>> >> >>> >> >> > Following install instructions, I've dowloaded yaz sources
>> >> >>> >> >> > (I've
>> >> >>> >> >> > tried
>> >> >>> >> >> > 4.1.2
>> >> >>> >> >> > and 3.0.52) as it seems there's no binary for OSX,
>> >> >>> >> >> > ./configure
>> >> >>> >> >> > && make
>> >> >>> >> >> > &&
>> >> >>> >> >> > make install.
>> >> >>> >> >> > Then using latest Seaside One Click image I've copied
>> >> >>> >> >> > /usr/local/lib/*yaz*
>> >> >>> >> >> >  in Seaside.app/Contents/MacOS
>> >> >>> >> >> > $ ls ~/Downloads/Seaside.app/Contents/MacOS/
>> >> >>> >> >> > Squeak VM Opt         libyaz.a              libyaz.la
>> >> >>> >> >> > libyaz_icu.a          libyaz_icu.la         libyaz_server.a
>> >> >>> >> >> > libyaz_server.la libyaz.3.dylib        libyaz.dylib
>> >> >>> >> >> >  libyaz_icu.3.dylib    libyaz_icu.dylib
>> >> >>> >> >> >  libyaz_server.3.dylib
>> >> >>> >> >> > libyaz_server.dylib
>> >> >>> >> >> >
>> >> >>> >> >> >
>> >> >>> >> >> > But then I have a External Module Not Found on
>> >> >>> >> >> > YAZPQFFFILibrary>>createParser
>> >> >>> >> >> > " YAZPQDFFILibrary default createParser "
>> >> >>> >> >> > <cdecl: YAZPQFParser 'yaz_pqf_create' (void) module:
>> >> >>> >> >> > 'yaz3'>
>> >> >>> >> >> > ^ self externalCallFailed
>> >> >>> >> >> >
>> >> >>> >> >> > Any hint ?
>> >> >>> >> >> > Cheers,
>> >> >>> >> >> > Laurent Laffont -- FFI newbie
>> >> >>> >> >> >
>> >> >>> >> >> > Pharo Smalltalk Screencasts: http://www.pharocasts.com/
>> >> >>> >> >> > Blog: http://magaloma.blogspot.com/
>> >> >>> >> >> >
>> >> >>> >> >>
>> >> >>> >> >> --
>> >> >>> >> >> Hernán Morales
>> >> >>> >> >> Information Technology Manager,
>> >> >>> >> >> Institute of Veterinary Genetics.
>> >> >>> >> >> National Scientific and Technical Research Council (CONICET).
>> >> >>> >> >> La Plata (1900), Buenos Aires, Argentina.
>> >> >>> >> >> Telephone: +54 (0221) 421-1799.
>> >> >>> >> >> Internal: 422
>> >> >>> >> >> Fax: 425-7980 or 421-1799.
>> >> >>> >> >
>
>