Smalltalk › Squeak › Squeak - Dev

Squeak on a PostmarketOS cellphone

_‹ Previous Topic Next Topic _›

Classic

List

Threaded

28 messages Options

Tony Garnock-Jones-5

Squeak on a PostmarketOS cellphone

Hi all,

I've recently been playing with Squeak running on a PostmarketOS phone
(Samsung Galaxy S7).

Many thanks to those who recently landed the ARMv8 build of Cog. (Per
the commit history I think the main person responsible was Ken Dickey?
Thanks Ken!)

I wrote about progress so far here:
https://eighty-twenty.org/2020/08/25/postmarketos-smalltalk

Today I posted an update with a saner DPI setting for the phone's
display: https://eighty-twenty.org/2020/08/27/squeak-postmarketos-update

Next on the list is to read touchscreen input from /dev/input/event1!

Cheers,
Tony

jrm

Re: Squeak on a PostmarketOS cellphone

Tony,

What a great project! Keep up the good work! I look forward to seeing your progress. Do you think you may be able to get to the "Watson, come here ..." phase?

-jrm

On Thu, Aug 27, 2020 at 11:42 AM Tony Garnock-Jones <[hidden email]> wrote:

Hi all,

I've recently been playing with Squeak running on a PostmarketOS phone
(Samsung Galaxy S7).

Many thanks to those who recently landed the ARMv8 build of Cog. (Per
the commit history I think the main person responsible was Ken Dickey?
Thanks Ken!)

I wrote about progress so far here:
https://eighty-twenty.org/2020/08/25/postmarketos-smalltalk

Today I posted an update with a saner DPI setting for the phone's
display: https://eighty-twenty.org/2020/08/27/squeak-postmarketos-update

Next on the list is to read touchscreen input from /dev/input/event1!

Cheers,
Tony

John-Reed Maffeo

Tony Garnock-Jones-5

Re: Squeak on a PostmarketOS cellphone

On 8/27/20 11:43 PM, John-Reed Maffeo wrote:
> Tony,
> What a great project! Keep up the good work! I look forward to seeing
> your progress. Do you think you may be able to get to the "Watson, come
> here ..." phase?

I think so! The old Erlang code had a modem control actor that was
fleshed-out enough to make and take calls, and to send and receive SMS.
It was a bit of a blast from the past making it send "ATD..." etc :-)

(See for example
https://github.com/tonyg/erlang-openmoko/blob/a314ac9d908b156ffd35cff8ab259787a06f3c46/src/openmoko_callmanager.erl#L102-L106)

Cheers,
Tony

Douglas Brebner-2

Re: Squeak on a PostmarketOS cellphone

In reply to this post by Tony Garnock-Jones-5

On 27/08/2020 19:42, Tony Garnock-Jones wrote:
> Hi all,
>
> I've recently been playing with Squeak running on a PostmarketOS phone
> (Samsung Galaxy S7).

Oh wow, I've been looking at PostmarketOS phones with Plasma Mobile
recently, but a Smalltalk based phone would be amazing.

Tony Garnock-Jones-5

Re: Squeak on a PostmarketOS cellphone

On 8/30/20 2:07 AM, Douglas Brebner wrote:
> Oh wow, I've been looking at PostmarketOS phones with Plasma Mobile
> recently, but a Smalltalk based phone would be amazing.

If you'd like to follow along, see
https://eighty-twenty.org/2020/08/25/postmarketos-smalltalk and followup
posts. And feel free to email me directly if you'd like to *actually*
try out the software or help with development. It's not on squeaksource
yet but it will be soonish. (I'll not spam the list with natter about
the work unless there's enough interest from others!)

Cheers,
Tony

Tony Garnock-Jones-5

Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

In reply to this post by Tony Garnock-Jones-5

Hi all,

I've been hacking on Squeak-on-a-cellphone a bit more. Now the image can
scan /proc/bus/input/devices and /dev/input/event* (using FFI, AioPlugin
and OSProcess), and is able to open touchscreen-like devices and set up
additional World HandMorphs for them.

There's a short (2 minute) demo video linked here:
https://eighty-twenty.org/2020/09/09/squeak-postmarketos-touchscreen

I think next I might get Squeak to boot and configure the cellular
modem, and get it making calls.

Alternatively, perhaps an on-screen keyboard? Does anyone know if
anything like that already exists for Squeak?

Technical details: it uses my Actors library for Squeak, plus some (not
yet released, but only because of laziness) code for the Linux-specific
stuff on the image side.

It uses a stock Cog VM.

Cheers,
Tony

On 8/27/20 8:42 PM, Tony Garnock-Jones wrote:

> Hi all,
>
> I've recently been playing with Squeak running on a PostmarketOS phone
> (Samsung Galaxy S7).
>
> Many thanks to those who recently landed the ARMv8 build of Cog. (Per
> the commit history I think the main person responsible was Ken Dickey?
> Thanks Ken!)
>
> I wrote about progress so far here:
> https://eighty-twenty.org/2020/08/25/postmarketos-smalltalk
>
> Today I posted an update with a saner DPI setting for the phone's
> display: https://eighty-twenty.org/2020/08/27/squeak-postmarketos-update
>
> Next on the list is to read touchscreen input from /dev/input/event1!
>
> Cheers,
> Tony
>

marcel.taeumel

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

Hi Tony,

there are still traces of a rather ancient #ImmPlugin that was meant to tell the OS where to put that virtual keyboard:

Best,

Marcel

Am 09.09.2020 16:15:10 schrieb Tony Garnock-Jones <[hidden email]>:
Hi all,

I've been hacking on Squeak-on-a-cellphone a bit more. Now the image can
scan /proc/bus/input/devices and /dev/input/event* (using FFI, AioPlugin
and OSProcess), and is able to open touchscreen-like devices and set up
additional World HandMorphs for them.

There's a short (2 minute) demo video linked here:
https://eighty-twenty.org/2020/09/09/squeak-postmarketos-touchscreen

I think next I might get Squeak to boot and configure the cellular
modem, and get it making calls.

Alternatively, perhaps an on-screen keyboard? Does anyone know if
anything like that already exists for Squeak?

Technical details: it uses my Actors library for Squeak, plus some (not
yet released, but only because of laziness) code for the Linux-specific
stuff on the image side.

It uses a stock Cog VM.

Cheers,
Tony

On 8/27/20 8:42 PM, Tony Garnock-Jones wrote:

> Hi all,
>
> I've recently been playing with Squeak running on a PostmarketOS phone
> (Samsung Galaxy S7).
>
> Many thanks to those who recently landed the ARMv8 build of Cog. (Per
> the commit history I think the main person responsible was Ken Dickey?
> Thanks Ken!)
>
> I wrote about progress so far here:
> https://eighty-twenty.org/2020/08/25/postmarketos-smalltalk
>
> Today I posted an update with a saner DPI setting for the phone's
> display: https://eighty-twenty.org/2020/08/27/squeak-postmarketos-update
>
> Next on the list is to read touchscreen input from /dev/input/event1!
>
> Cheers,
> Tony
>

Tobias Pape

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

> On 09.09.2020, at 16:28, Marcel Taeumel <[hidden email]> wrote:
>
> Hi Tony,
>
> there are still traces of a rather ancient #ImmPlugin that was meant to tell the OS where to put that virtual keyboard:

I dont know wether anciet cuts it. It's regularly shipped with the Linux VM and IIRC necessary for Japanese input…

Best regards
-Tobias

>
>
>
> Best,
> Marcel
>> Am 09.09.2020 16:15:10 schrieb Tony Garnock-Jones <[hidden email]>:
>>
>> Hi all,
>>
>> I've been hacking on Squeak-on-a-cellphone a bit more. Now the image can
>> scan /proc/bus/input/devices and /dev/input/event* (using FFI, AioPlugin
>> and OSProcess), and is able to open touchscreen-like devices and set up
>> additional World HandMorphs for them.
>>
>> There's a short (2 minute) demo video linked here:
>> https://eighty-twenty.org/2020/09/09/squeak-postmarketos-touchscreen
>>
>> I think next I might get Squeak to boot and configure the cellular
>> modem, and get it making calls.
>>
>> Alternatively, perhaps an on-screen keyboard? Does anyone know if
>> anything like that already exists for Squeak?
>>
>> Technical details: it uses my Actors library for Squeak, plus some (not
>> yet released, but only because of laziness) code for the Linux-specific
>> stuff on the image side.
>>
>> It uses a stock Cog VM.
>>
>> Cheers,
>> Tony
>>
>>
>>
>>
>> On 8/27/20 8:42 PM, Tony Garnock-Jones wrote:
>> > Hi all,
>> >
>> > I've recently been playing with Squeak running on a PostmarketOS phone
>> > (Samsung Galaxy S7).
>> >
>> > Many thanks to those who recently landed the ARMv8 build of Cog. (Per
>> > the commit history I think the main person responsible was Ken Dickey?
>> > Thanks Ken!)
>> >
>> > I wrote about progress so far here:
>> > https://eighty-twenty.org/2020/08/25/postmarketos-smalltalk
>> >
>> > Today I posted an update with a saner DPI setting for the phone's
>> > display: https://eighty-twenty.org/2020/08/27/squeak-postmarketos-update
>> >
>> > Next on the list is to read touchscreen input from /dev/input/event1!
>> >
>> > Cheers,
>> > Tony
>> >
>>
>

David T. Lewis

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

In reply to this post by Tony Garnock-Jones-5

That looks very promising indeed. Thanks for the video.

Dave

On Wed, Sep 09, 2020 at 04:14:59PM +0200, Tony Garnock-Jones wrote:

> Hi all,
>
> I've been hacking on Squeak-on-a-cellphone a bit more. Now the image can
> scan /proc/bus/input/devices and /dev/input/event* (using FFI, AioPlugin
> and OSProcess), and is able to open touchscreen-like devices and set up
> additional World HandMorphs for them.
>
> There's a short (2 minute) demo video linked here:
> https://eighty-twenty.org/2020/09/09/squeak-postmarketos-touchscreen
>
> I think next I might get Squeak to boot and configure the cellular
> modem, and get it making calls.
>
> Alternatively, perhaps an on-screen keyboard? Does anyone know if
> anything like that already exists for Squeak?
>
> Technical details: it uses my Actors library for Squeak, plus some (not
> yet released, but only because of laziness) code for the Linux-specific
> stuff on the image side.
>
> It uses a stock Cog VM.
>
> Cheers,
> Tony
>
>
>
>
> On 8/27/20 8:42 PM, Tony Garnock-Jones wrote:
> > Hi all,
> >
> > I've recently been playing with Squeak running on a PostmarketOS phone
> > (Samsung Galaxy S7).
> >
> > Many thanks to those who recently landed the ARMv8 build of Cog. (Per
> > the commit history I think the main person responsible was Ken Dickey?
> > Thanks Ken!)
> >
> > I wrote about progress so far here:
> > https://eighty-twenty.org/2020/08/25/postmarketos-smalltalk
> >
> > Today I posted an update with a saner DPI setting for the phone's
> > display: https://eighty-twenty.org/2020/08/27/squeak-postmarketos-update
> >
> > Next on the list is to read touchscreen input from /dev/input/event1!
> >
> > Cheers,
> > Tony
> >
>

marcel.taeumel

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

In reply to this post by Tobias Pape

> ... and IIRC necessary for Japanese input…

Because you need a virtual keyboard for that case? Hmm....

Best.

Marcel

Am 09.09.2020 16:32:58 schrieb Tobias Pape <[hidden email]>:
> On 09.09.2020, at 16:28, Marcel Taeumel wrote:
>
> Hi Tony,
>
> there are still traces of a rather ancient #ImmPlugin that was meant to tell the OS where to put that virtual keyboard:

I dont know wether anciet cuts it. It's regularly shipped with the Linux VM and IIRC necessary for Japanese input…

Best regards
-Tobias

>
>
>
> Best,
> Marcel
>> Am 09.09.2020 16:15:10 schrieb Tony Garnock-Jones :
>>
>> Hi all,
>>
>> I've been hacking on Squeak-on-a-cellphone a bit more. Now the image can
>> scan /proc/bus/input/devices and /dev/input/event* (using FFI, AioPlugin
>> and OSProcess), and is able to open touchscreen-like devices and set up
>> additional World HandMorphs for them.
>>
>> There's a short (2 minute) demo video linked here:
>> https://eighty-twenty.org/2020/09/09/squeak-postmarketos-touchscreen
>>
>> I think next I might get Squeak to boot and configure the cellular
>> modem, and get it making calls.
>>
>> Alternatively, perhaps an on-screen keyboard? Does anyone know if
>> anything like that already exists for Squeak?
>>
>> Technical details: it uses my Actors library for Squeak, plus some (not
>> yet released, but only because of laziness) code for the Linux-specific
>> stuff on the image side.
>>
>> It uses a stock Cog VM.
>>
>> Cheers,
>> Tony
>>
>>
>>
>>
>> On 8/27/20 8:42 PM, Tony Garnock-Jones wrote:
>> > Hi all,
>> >
>> > I've recently been playing with Squeak running on a PostmarketOS phone
>> > (Samsung Galaxy S7).
>> >
>> > Many thanks to those who recently landed the ARMv8 build of Cog. (Per
>> > the commit history I think the main person responsible was Ken Dickey?
>> > Thanks Ken!)
>> >
>> > I wrote about progress so far here:
>> > https://eighty-twenty.org/2020/08/25/postmarketos-smalltalk
>> >
>> > Today I posted an update with a saner DPI setting for the phone's
>> > display: https://eighty-twenty.org/2020/08/27/squeak-postmarketos-update
>> >
>> > Next on the list is to read touchscreen input from /dev/input/event1!
>> >
>> > Cheers,
>> > Tony
>> >
>>
>

timrowledge

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

> On 2020-09-09, at 10:10 AM, Marcel Taeumel <[hidden email]> wrote:
>
> > ... and IIRC necessary for Japanese input…
>
> Because you need a virtual keyboard for that case? Hmm....

Kinda; I did some faffing with it for the Scratch/Pi stuff several years ago. I faintly recall there being some really irritating clash between the settings/installs required and... something or other. Sometihng to do with the `-compositionInput` and clashing with unix key handling and 'anthy' and iBus?

I don't recall managing to fully solve it.

tim
--
tim Rowledge; [hidden email]; http://www.rowledge.org/tim
To iterate is human; to recurse, divine.

Christoph Thiede

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

In reply to this post by David T. Lewis

Very interesting project!

By the way, I am suffering from similar DPI problems on my Windows laptop (the font just does not get large enough). If you can port some of your changes made for PostmarketOS back to the Trunk, this would be great.

Best,

Christoph

Von: Squeak-dev <[hidden email]> im Auftrag von David T. Lewis <[hidden email]>
Gesendet: Mittwoch, 9. September 2020 17:25:17
An: The general-purpose Squeak developers list
Betreff: Re: [squeak-dev] Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

That looks very promising indeed. Thanks for the video.

Dave

On Wed, Sep 09, 2020 at 04:14:59PM +0200, Tony Garnock-Jones wrote:
> Hi all,
>
> I've been hacking on Squeak-on-a-cellphone a bit more. Now the image can
> scan /proc/bus/input/devices and /dev/input/event* (using FFI, AioPlugin
> and OSProcess), and is able to open touchscreen-like devices and set up
> additional World HandMorphs for them.
>
> There's a short (2 minute) demo video linked here:
> https://eighty-twenty.org/2020/09/09/squeak-postmarketos-touchscreen
>
> I think next I might get Squeak to boot and configure the cellular
> modem, and get it making calls.
>
> Alternatively, perhaps an on-screen keyboard? Does anyone know if
> anything like that already exists for Squeak?
>
> Technical details: it uses my Actors library for Squeak, plus some (not
> yet released, but only because of laziness) code for the Linux-specific
> stuff on the image side.
>
> It uses a stock Cog VM.
>
> Cheers,
> Tony
>
>
>
>
> On 8/27/20 8:42 PM, Tony Garnock-Jones wrote:
> > Hi all,
> >
> > I've recently been playing with Squeak running on a PostmarketOS phone
> > (Samsung Galaxy S7).
> >
> > Many thanks to those who recently landed the ARMv8 build of Cog. (Per
> > the commit history I think the main person responsible was Ken Dickey?
> > Thanks Ken!)
> >
> > I wrote about progress so far here:
> > https://eighty-twenty.org/2020/08/25/postmarketos-smalltalk
> >
> > Today I posted an update with a saner DPI setting for the phone's
> > display: https://eighty-twenty.org/2020/08/27/squeak-postmarketos-update
> >
> > Next on the list is to read touchscreen input from /dev/input/event1!
> >
> > Cheers,
> > Tony
> >
>

Carpe Squeak!

Christoph Thiede

ImmPlugin (was: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone))

In reply to this post by timrowledge

> > there are still traces of a rather ancient #ImmPlugin that was meant to tell the OS where to put that virtual keyboard:

> I dont know wether anciet cuts it. It's regularly shipped with the Linux VM and IIRC necessary for Japanese input…

The ImmPlugin does not work on Windows 10. This would be helpful for different scenarios: Ultrabooks with a touch keyboard, but also pop-up dialogs for clipboard history or character table, which usually pop up at the caret, just not in Squeak.

Oh yes, another cleanup project! :-) Does the current ImmPluginWin32 work for anyone?

Best,

Christoph

Von: Squeak-dev <[hidden email]> im Auftrag von tim Rowledge <[hidden email]>
Gesendet: Mittwoch, 9. September 2020 20:39 Uhr
An: The general-purpose Squeak developers list
Betreff: Re: [squeak-dev] Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

Carpe Squeak!

Tony Garnock-Jones-5

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

In reply to this post by marcel.taeumel

On 9/9/20 4:28 PM, Marcel Taeumel wrote:
> there are still traces of a rather ancient #ImmPlugin that was meant to
> tell the OS where to put that virtual keyboard:

Thanks! I'll look into that. Of course, here it'd be Squeak providing a
keyboard for (itself and) external programs (if any), not the other way
around :)

Tony

Tony Garnock-Jones-5

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

In reply to this post by Christoph Thiede

On 9/9/20 11:24 PM, Thiede, Christoph wrote:
> By the way, I am suffering from similar DPI problems on my Windows
> laptop (the font just does not get large enough). If you can port some
> of your changes made for PostmarketOS back to the Trunk, this would be
> great.

Most of it is already done: the main thing to change image-side is from
bitmapped to truetype fonts.

I have noticed font rendering with truetype is *much* slower than
bitmapped fonts. So perhaps that's why this hasn't already been done?

(Regarding DPI detection: my hacks are linux-specific, and involve
parsing EDID and reading special files in /sys etc. But once I *have* an
estimate of DPI, applying it within the image is straightforward, and
I've already committed the small changes I needed back to the trunk.)

Tony

Tobias Pape

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

> On 10.09.2020, at 13:44, Tony Garnock-Jones <[hidden email]> wrote:
>
>
> (Regarding DPI detection: my hacks are linux-specific, and involve
> parsing EDID and reading special files in /sys etc. But once I *have* an
> estimate of DPI, applying it within the image is straightforward, and
> I've already committed the small changes I needed back to the trunk.)

Can you share them? I am preparing an update of my highdpi-VM branch and would really like to include the Linux stuff (which are, atm, a considerable mess…)

Best regards
-Tobias

Eliot Miranda-2

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

Hi Tobias,

> On Sep 10, 2020, at 10:14 AM, Tobias Pape <[hidden email]> wrote:
>
>
>> On 10.09.2020, at 13:44, Tony Garnock-Jones <[hidden email]> wrote:
>>
>>
>> (Regarding DPI detection: my hacks are linux-specific, and involve
>> parsing EDID and reading special files in /sys etc. But once I *have* an
>> estimate of DPI, applying it within the image is straightforward, and
>> I've already committed the small changes I needed back to the trunk.)
>
> Can you share them? I am preparing an update of my highdpi-VM branch and would really like to include the Linux stuff (which are, atm, a considerable mess…)

As part of this will you be looking at the configure script? If so, please reach out to Ken Dickey and interact with him over getting fbdev support detected by the script.

>
> Best regards
> -Tobias
>
>
>

Tobias Pape

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

> On 10.09.2020, at 19:28, Eliot Miranda <[hidden email]> wrote:
>
> Hi Tobias,
>
>> On Sep 10, 2020, at 10:14 AM, Tobias Pape <[hidden email]> wrote:
>>
>>
>>> On 10.09.2020, at 13:44, Tony Garnock-Jones <[hidden email]> wrote:
>>>
>>>
>>> (Regarding DPI detection: my hacks are linux-specific, and involve
>>> parsing EDID and reading special files in /sys etc. But once I *have* an
>>> estimate of DPI, applying it within the image is straightforward, and
>>> I've already committed the small changes I needed back to the trunk.)
>>
>> Can you share them? I am preparing an update of my highdpi-VM branch and would really like to include the Linux stuff (which are, atm, a considerable mess…)
>
> As part of this will you be looking at the configure script? If so, please reach out to Ken Dickey and interact with him over getting fbdev support detected by the script.

maaaaaaybe :D
I also thought about that. Can't promise a thing but we'll see
-T

>
>>
>> Best regards
>> -Tobias
>>
>>
>>
>

Tony Garnock-Jones-5

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

In reply to this post by Tobias Pape

Hi Tobias,

On 9/10/20 7:14 PM, Tobias Pape wrote:
>> (Regarding DPI detection: my hacks are linux-specific, and involve
>> parsing EDID and reading special files in /sys etc. But once I *have* an
>> estimate of DPI, applying it within the image is straightforward, and
>> I've already committed the small changes I needed back to the trunk.)
>
> Can you share them? I am preparing an update of my highdpi-VM branch and would really like to include the Linux stuff (which are, atm, a considerable mess…)

Sure. Here's the current work-in-progress.

https://steam.eighty-twenty.org/~tonyg/Monticello/LinuxIO-tonyg.5.mcz

For the DPI stuff, look at (the class side of) class LinuxDisplayInfo.

Cheers,
Tony

codefrau

Re: Squeak on a cellphone responds to touchscreen input now (was Re: Squeak on a PostmarketOS cellphone)

In reply to this post by Tony Garnock-Jones-5

On Wed, Sep 9, 2020 at 7:15 AM Tony Garnock-Jones <[hidden email]> wrote:

Hi all,

I've been hacking on Squeak-on-a-cellphone a bit more. Now the image can
scan /proc/bus/input/devices and /dev/input/event* (using FFI, AioPlugin
and OSProcess), and is able to open touchscreen-like devices and set up
additional World HandMorphs for them.

Oh, exciting! Please record a multi-hand Etoys demo. Maybe like this:

https://youtu.be/gYrp31fH-Jk?t=56

- Vanessa -