Re: Squeak 4.6: MultilingualTests-fbs.18.mcz

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Re: Squeak 4.6: MultilingualTests-fbs.18.mcz

Hannes Hirzel
Reactivating an old thread ...

Taking the test above just gives a question mark for the fallback font case

  | text font bb destPoint |
        text := (Character value: 257) asString asText.
        font := TextStyle default fontOfSize: 21.
        text addAttribute: (TextFontReference toFont: font).
        bb := (Form extent: 100 @ 30) getCanvas privatePort.
        bb combinationRule: Form paint.

        font installOn: bb foregroundColor: Color black
backgroundColor: Color white.
        destPoint := font displayString: text asString on: bb from: 1
to: 1 at: 0@0 kern: 1.

        bb destForm asMorph openInHand.


Is there another fallback font readily available which gives for small
hex numbers for the missing characters?

--Hannes

On Fri, 5 Jun 2015 20:20:36.139 0000, [hidden email]
<[hidden email]> wrote:

> Chris Muller uploaded a new version of MultilingualTests to project Squeak
> 4.6:
> http://source.squeak.org/squeak46/MultilingualTests-fbs.18.mcz
>
> ==================== Summary ====================
>
> Name: MultilingualTests-fbs.18
> Author: fbs
> Time: 6 November 2013, 6:35:02.811 pm
> UUID: 07e26018-8455-3349-9b44-9ecb4aaeefb2
> Ancestors: MultilingualTests-nice.17
>
> More #shouldnt:raise: Error fixes.
>
> ==================== Snapshot ====================
>
> SystemOrganization addCategory: #'MultilingualTests-TextConversion'!
> SystemOrganization addCategory: #'MultilingualTests-Display'!
>
> TestCase subclass: #FontTest
> instanceVariableNames: ''
> classVariableNames: ''
> poolDictionaries: ''
> category: 'MultilingualTests-Display'!
>
> !FontTest commentStamp: 'tak 3/11/2005 14:31' prior: 0!
> I am mainly a test for fallback font.
> FontTest buildSuite run!
>
> ----- Method: FontTest>>testDisplay (in category 'testing') -----
> testDisplay
> "self debug: #testDisplay"
> | text font bb destPoint width |
> text := 'test' asText.
> font := TextStyle default fontOfSize: 21.
> text addAttribute: (TextFontReference toFont: font).
> bb := (Form extent: 100 @ 30) getCanvas privatePort.
> bb combinationRule: Form paint.
>
> font installOn: bb foregroundColor: Color black backgroundColor: Color
> white.
> destPoint := font displayString: text asString on: bb from: 1 to: 4 at: 0@0
> kern: 1.
>
> width := text inject: 0 into: [:max :char | max + (font widthOf: char)].
> self assert: destPoint x = (width + 4).
> "bb destForm asMorph openInHand."
> !
>
> ----- Method: FontTest>>testFallback (in category 'testing') -----
> testFallback
> "self debug: #testFallback"
> | text font bb destPoint |
> text := (Character value: 257) asString asText.
> font := TextStyle default fontOfSize: 21.
> text addAttribute: (TextFontReference toFont: font).
> bb := (Form extent: 100 @ 30) getCanvas privatePort.
> bb combinationRule: Form paint.
>
> font installOn: bb foregroundColor: Color black backgroundColor: Color
> white.
> destPoint := font displayString: text asString on: bb from: 1 to: 1 at: 0@0
> kern: 1.
>
> "bb destForm asMorph openInHand."
> self assert: destPoint x = ((font widthOf: $?) + 1).
> !
>
> ----- Method: FontTest>>testMultistringFallbackFont (in category 'testing')
> -----
> testMultistringFallbackFont
> "self debug: #testMultistringFallbackFont"
> | text p style height width |
> [(TextStyle default fontArray at: JapaneseEnvironment leadingChar)
> ifNil: [^ self]]
> ifError: [:err :rcvr | ^ self].
> text := ((#(20983874 20983876 20983878 )
> collect: [:e | e asCharacter])
> as: String) asText.
> p := NewParagraph new.
> style := TextStyle new leading: 0; newFontArray: {Preferences
> standardFlapFont}.
> p
> compose: text
> style: style
> from: 1
> in: (0 @ 0 corner: 100 @ 100).
> "See CompositionScanner>>setActualFont: &
> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
> height := style defaultFont height + style leading.
> width := text
> inject: 0
> into: [:tally :next | tally
> + (style defaultFont widthOf: next)].
> p adjustRightX.
> self assert: p extent = (width @ height).
> "Display getCanvas
> paragraph: p
> bounds: (10 @ 10 extent: 100 @ 100)
> color: Color black"!
>
> ----- Method: FontTest>>testMultistringFont (in category 'testing') -----
> testMultistringFont
> "self debug: #testMultistringFont"
> | text p style height width |
> [(TextStyle default fontArray at: JapaneseEnvironment leadingChar)
> ifNil: [^ self]]
> ifError: [:err :rcvr | ^ self].
> text := ((#(20983874 20983876 20983878 )
> collect: [:e | e asCharacter])
> as: String) asText.
> p := NewParagraph new.
> style := TextStyle default.
> p
> compose: text
> style: style
> from: 1
> in: (0 @ 0 corner: 100 @ 100).
> "See CompositionScanner>>setActualFont: &
> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
> height := style defaultFont height + style leading.
> width := text
> inject: 0
> into: [:tally :next | tally
> + (style defaultFont widthOf: next)].
> p adjustRightX.
> self assert: p extent = (width @ height).
> "Display getCanvas
> paragraph: p
> bounds: (10 @ 10 extent: 100 @ 100)
> color: Color black"!
>
> ----- Method: FontTest>>testParagraph (in category 'testing') -----
> testParagraph
> "self debug: #testParagraph"
> | text p style height width |
> text := 'test' asText.
> p := NewParagraph new.
> style := TextStyle default.
> p
> compose: text
> style: style
> from: 1
> in: (0 @ 0 corner: 100 @ 100).
> "See CompositionScanner>>setActualFont: &
> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
> height := style defaultFont height + style leading.
> width := text
> inject: 0
> into: [:tally :next | tally
> + (style defaultFont widthOf: next)].
> p adjustRightX.
> self assert: p extent = (width @ height)!
>
> ----- Method: FontTest>>testParagraphFallback (in category 'testing') -----
> testParagraphFallback
> "self debug: #testParagraphFallback"
> | text p style height width e expect |
> e := (Character value: 257) asString.
> text := ('test' , e , e , e , e , 'test') asText.
> expect := 'test????test'.
> p := NewParagraph new.
> style := TextStyle default.
> p
> compose: text
> style: style
> from: 1
> in: (0 @ 0 corner: 100 @ 100).
> "See CompositionScanner>>setActualFont: &
> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
> height := style defaultFont height + style leading.
> width := expect
> inject: 0
> into: [:tally :next | tally
> + (style defaultFont widthOf: next)].
> p adjustRightX.
> self assert: p extent = (width @ height).
> "Display getCanvas
> paragraph: p
> bounds: (10 @ 10 extent: 100 @ 100)
> color: Color black"!
>
> ----- Method: FontTest>>testResetAfterEmphasized (in category 'testing')
> -----
> testResetAfterEmphasized
> "self debug: #testResetAfterEmphasized"
> | normal derivative |
> normal := TextStyle defaultFont.
> derivative := normal emphasized: 3.
> self assert: (normal derivativeFonts at: 3) == derivative.
> normal reset.
> self assert: (normal derivativeFonts select:[:any| any isSynthetic])
> isEmpty
> !
>
> TestCase subclass: #MultiByteFileStreamTest
> instanceVariableNames: 'fileName'
> classVariableNames: ''
> poolDictionaries: ''
> category: 'MultilingualTests-TextConversion'!
>
> ----- Method: MultiByteFileStreamTest>>tearDown (in category 'running')
> -----
> tearDown
>
> fileName ifNotNil: [
> FileDirectory default deleteFileNamed: fileName ]!
>
> ----- Method: MultiByteFileStreamTest>>testAsciiBackChunk (in category
> 'testing') -----
> testAsciiBackChunk
>
> fileName := 'foobackchunk.txt'.
> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
> file
> lineEndConvention: #cr;
> converter: UTF8TextConverter new;
> cr; nextChunkPut: 'test1' printString;
> cr; nextChunkPut: 'test2' printString.
> self
> assert: file backChunk = (String cr , 'test2' printString);
> assert: file backChunk = (String cr , 'test1' printString) ]!
>
> ----- Method: MultiByteFileStreamTest>>testBinaryUpTo (in category
> 'testing') -----
> testBinaryUpTo
> "This is a non regression test for bug
> http://bugs.squeak.org/view.php?id=6933"
>
> fileName := 'foobug6933'.
> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
> file
> binary;
> nextPutAll: #[ 1 2 3 4 ] ].
> MultiByteFileStream oldFileNamed: fileName do: [ :file |
> file binary.
> self assert: (file upTo: 3) = #[ 1 2 ] ]!
>
> ----- Method: MultiByteFileStreamTest>>testByteTextConverter (in category
> 'testing') -----
> testByteTextConverter
> | strings converterClasses |
> strings := {
> String newFrom: ((0 to: 255) collect: [:e | e asCharacter]).
> }.
>
> converterClasses := ByteTextConverter allSubclasses.
> converterClasses do: [:converterClass |
> strings do: [:string | | converter stream encoded decoded encoded2 |
> converter := converterClass new.
> stream := string readStream.
> encoded := string select: [:e | (converter nextFromStream: stream)
> notNil].
> stream := encoded readStream.
> decoded := encoded collect: [:e | converter nextFromStream: stream].
> self assert: stream atEnd.
> stream := String new writeStream.
> converter nextPutAll: decoded toStream: stream.
> encoded2 := stream contents.
> self assert: (encoded2 collect: [:e | e charCode] as: Array) = (encoded
> collect: [:e | e charCode] as: Array).
> stream := String new writeStream.
> decoded do: [:e | converter nextPut: e toStream: stream].
> encoded2 := stream contents.
> self assert: (encoded2 collect: [:e | e charCode] as: Array) = (encoded
> collect: [:e | e charCode] as: Array)]]!
>
> ----- Method:
> MultiByteFileStreamTest>>testLineEndConvention:withConverter:ifFail: (in
> category 'helpers') -----
> testLineEndConvention: lineEndConvention withConverter: textConverterClass
> ifFail: failBlock
>
> | expectedResult result |
> [
> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
> file
> converter: textConverterClass new;
> lineEndConvention: lineEndConvention;
> cr;
> nextPut: Character cr;
> nextPutAll: String cr;
> nextPutAll: String cr asWideString ].
> result := StandardFileStream oldFileNamed: fileName do: [ :file |
> file contents ].
> expectedResult := String streamContents: [ :stream |
> 4 timesRepeat: [ stream perform: lineEndConvention ] ].
> result = expectedResult ifFalse: [
> failBlock value: expectedResult asByteArray value: result asByteArray ]
> ]
> on: Error
> do: [ :err | failBlock value: err messageText value: err messageText ]!
>
> ----- Method: MultiByteFileStreamTest>>testLineEndConversion (in category
> 'testing') -----
> testLineEndConversion
>
> | failures |
> fileName := 'foolinendconversion.txt'.
> failures := OrderedCollection new.
> TextConverter allSubclassesDo: [ :textConverterClass |
> textConverterClass encodingNames ifNotEmpty: [
> #(cr lf crlf) do: [ :lineEndConvention |
> self
> testLineEndConvention: lineEndConvention
> withConverter: textConverterClass
> ifFail: [ :expectedResult :result |
> failures add: {
> textConverterClass.
> lineEndConvention.
> expectedResult.
> result } ] ] ] ].
> self assert: failures isEmpty!
>
> ----- Method: MultiByteFileStreamTest>>testLineEnding (in category
> 'testing') -----
> testLineEnding
>
> fileName := 'foolinend.txt'.
> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
> file
> wantsLineEndConversion: false;
> nextPutAll: 'line 1'; cr;
> nextPutAll: 'line 2'; crlf;
> nextPutAll: 'line 3'; lf;
> nextPutAll: 'line 4' ].
> {
> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
> , 'line 4'}.
> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
> , 'line 4'}.
> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
> cr , 'line 4'}.
> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' , String
> lf , 'line 4'}
> } do: [:lineEndingResult |
> MultiByteFileStream oldFileNamed: fileName do: [ :file |
> file lineEndConvention: lineEndingResult first.
> self assert: file upToEnd = lineEndingResult last ] ]!
>
> ----- Method: MultiByteFileStreamTest>>testLineEndingChunk (in category
> 'testing') -----
> testLineEndingChunk
>
> fileName := 'foolinend.txt'.
> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
> file
> wantsLineEndConversion: false;
> nextPutAll: 'line 1'; cr;
> nextPutAll: 'line 2'; crlf;
> nextPutAll: 'line 3'; lf;
> nextPutAll: 'line 4'; nextPut: $!! ].
> {
> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
> , 'line 4'}.
> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
> , 'line 4'}.
> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
> cr , 'line 4'}.
> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' , String
> lf , 'line 4'}
> } do: [:lineEndingResult |
> MultiByteFileStream oldFileNamed: fileName do: [ :file |
> file lineEndConvention: lineEndingResult first.
> self assert: lineEndingResult last equals: file nextChunk ] ]!
>
> ----- Method: MultiByteFileStreamTest>>testLineEndingWithWideStrings (in
> category 'testing') -----
> testLineEndingWithWideStrings
>
> | cr lf crlf |
> fileName := 'foolinend.txt'.
> cr := String cr asWideString.
> lf := String lf asWideString.
> crlf := String crlf asWideString.
> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
> file
> wantsLineEndConversion: false;
> nextPutAll: 'line 1'; nextPutAll: cr;
> nextPutAll: 'line 2'; nextPutAll: crlf;
> nextPutAll: 'line 3'; nextPutAll: lf;
> nextPutAll: 'line 4' ].
> {
> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
> , 'line 4'}.
> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
> , 'line 4'}.
> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
> cr , 'line 4'}.
> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' , String
> lf , 'line 4'}
> } do: [ :lineEndingResult |
> MultiByteFileStream oldFileNamed: fileName do: [ :file |
> file lineEndConvention: lineEndingResult first.
> self assert: file upToEnd = lineEndingResult last ] ]!
>
> ----- Method: MultiByteFileStreamTest>>testMultiByteTextConverter (in
> category 'testing') -----
> testMultiByteTextConverter
> | strings converterClasses |
> strings := {
> String newFrom: ((0 to: 255) collect: [:e | Unicode value: e]).
> String newFrom: ((0 to: 1023) collect: [:e | Unicode value: e]).
> }.
>
> converterClasses := {
> UTF8TextConverter . UTF16TextConverter .
> "CompoundTextConverter ."
> "EUCJPTextConverter . CNGBTextConverter . ShiftJISTextConverter .
> EUCKRTextConverter"}.
> converterClasses do: [:converterClass |
> strings do: [:string |
> | converter stream |
> converter := converterClass new.
> stream := String new writeStream.
> converter nextPutAll: string toStream: stream.
> stream := stream contents readStream.
> string do: [:e | | decoded |
> decoded := converter nextFromStream: stream.
> self assert: e charCode = decoded charCode].
> self assert: stream atEnd.
>
> stream := String new writeStream.
> string do: [:e | converter nextPut: e toStream: stream].
> stream := stream contents readStream.
> string do: [:e | | decoded |
> decoded := converter nextFromStream: stream.
> self assert: e charCode = decoded charCode].
> self assert: stream atEnd]]!
>
> ----- Method: MultiByteFileStreamTest>>testNextLine (in category 'testing')
> -----
> testNextLine
>
> fileName := 'foonextline.txt'.
> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
> file
> wantsLineEndConversion: false;
> nextPutAll: 'line 1'; cr;
> nextPutAll: 'line 2'; crlf;
> nextPutAll: 'line 3'; lf;
> nextPutAll: 'line 4' ].
> #(cr lf crlf nil) do: [:lineEnding |
> MultiByteFileStream oldFileNamed: fileName do: [ :file |
> file lineEndConvention: lineEnding.
> self
> assert: file nextLine = 'line 1';
> assert: file nextLine = 'line 2';
> assert: file nextLine = 'line 3';
> assert: file nextLine = 'line 4';
> assert: file nextLine = nil ] ]!
>
> ----- Method: MultiByteFileStreamTest>>testNextPutAllStartingAt (in category
> 'testing') -----
> testNextPutAllStartingAt
>
> | result |
> fileName := 'foonextputallstartingat.txt'.
> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
> { 'abcde' asWideString. 'abcde' } do: [ :string |
> file
> next: 1 putAll: string startingAt: 5;
> next: 3 putAll: string startingAt: 2;
> next: 1 putAll: string startingAt: 1 ] ].
> result := StandardFileStream readOnlyFileNamed: fileName do: [ :file |
> file binary; contents ].
> self assert: #[101 98 99 100 97 101 98 99 100 97] equals: result
> !
>
> ----- Method: MultiByteFileStreamTest>>testNonAsciiBackChunk (in category
> 'testing') -----
> testNonAsciiBackChunk
> "Note: this is an expected failure: MultiByteFileStream is not equipped to
> read back non ASCII String... (no comment)
> As a consequence, never use non ASCII in method category nor in your
> initials. That would make a few tools blind..."
>
> fileName :=  'foobackchunk.txt'.
> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
> file
> lineEndConvention: #cr;
> converter: UTF8TextConverter new;
> cr; nextChunkPut: 'testé' printString;
> cr; nextChunkPut: 'test' printString.
> self assert: file backChunk = (String cr , 'test' printString).
> self assert: file backChunk = (String cr , 'testé' printString) ]!
>
> TestCase subclass: #UTF16TextConverterTest
> instanceVariableNames: ''
> classVariableNames: ''
> poolDictionaries: ''
> category: 'MultilingualTests-TextConversion'!
>
> ----- Method: UTF16TextConverterTest>>testByteOrders (in category 'testing')
> -----
> testByteOrders
> |converter originalText bytes decodedText |
> originalText := 'test'.
> converter := UTF16TextConverter new.
>
> "Default (ie useLittleEndian instvar nil)"
> bytes := (originalText convertToWithConverter: converter).
> decodedText := bytes convertFromWithConverter: converter.
>
> self assert: originalText equals: decodedText.
>
> "Little-endian"
> converter useLittleEndian: true.
>
> bytes := (originalText convertToWithConverter: converter).
> decodedText := bytes convertFromWithConverter: converter.
>
> self assert: originalText equals: decodedText.
>
> "Big-endian"
> converter useLittleEndian: false.
>
> bytes := (originalText convertToWithConverter: converter).
> decodedText := bytes convertFromWithConverter: converter.
>
> self assert: originalText equals: decodedText.
>
> !
>
> ClassTestCase subclass: #UTF8TextConverterTest
> instanceVariableNames: ''
> classVariableNames: ''
> poolDictionaries: ''
> category: 'MultilingualTests-TextConversion'!
>
> ----- Method: UTF8TextConverterTest>>testLazyConversion (in category
> 'tests') -----
> testLazyConversion
> "Ensure the lazy conversions do what they should"
>
> | strict result |
> strict := UTF8TextConverter strictUtf8Conversions.
> [UTF8TextConverter strictUtf8Conversions: false.
> result := 'Grüß Gott' utf8ToSqueak.
> ] ensure:[UTF8TextConverter strictUtf8Conversions: strict].
>
> self assert: result = 'Grüß Gott'.
> !
>
> ----- Method: UTF8TextConverterTest>>testSqueakToUtf8 (in category 'tests')
> -----
> testSqueakToUtf8
> "Ensure proper encoding"
>
> self assert: '' squeakToUtf8 equals: ''.
> self assert: 'Hello World' squeakToUtf8 equals: 'Hello World'.
> self assert: 'Grüß Gott' squeakToUtf8 asByteArray
> equals: #[71 114 195 188 195 159 32 71 111 116 116]!
>
> ----- Method: UTF8TextConverterTest>>testStrictConversion (in category
> 'tests') -----
> testStrictConversion
> "Ensure the strict conversions do what they should"
>
> | strict |
> strict := UTF8TextConverter strictUtf8Conversions.
> [UTF8TextConverter strictUtf8Conversions: true.
> self should:[ 'Grüß Gott' utf8ToSqueak ] raise: Error.
> ] ensure:[UTF8TextConverter strictUtf8Conversions: strict].!
>
> ----- Method: UTF8TextConverterTest>>testUtf8ToSqueak (in category 'tests')
> -----
> testUtf8ToSqueak
> "Ensure proper encoding"
>
> self assert: '' utf8ToSqueak equals: ''.
> self assert: 'Hello World' utf8ToSqueak equals: 'Hello World'.
> self assert: #[71 114 195 188 195 159 32 71 111 116 116] asString
> utf8ToSqueak
> equals: 'Grüß Gott'
>
> !
>
>
>

Reply | Threaded
Open this post in threaded view
|

Re: Squeak 4.6: MultilingualTests-fbs.18.mcz

Tobias Pape

On 19.01.2017, at 07:57, H. Hirzel <[hidden email]> wrote:

> Reactivating an old thread ...
>
> Taking the test above just gives a question mark for the fallback font case
>
>  | text font bb destPoint |
>        text := (Character value: 257) asString asText.
>        font := TextStyle default fontOfSize: 21.
>        text addAttribute: (TextFontReference toFont: font).
>        bb := (Form extent: 100 @ 30) getCanvas privatePort.
>        bb combinationRule: Form paint.
>
>        font installOn: bb foregroundColor: Color black
> backgroundColor: Color white.
>        destPoint := font displayString: text asString on: bb from: 1
> to: 1 at: 0@0 kern: 1.
>
>        bb destForm asMorph openInHand.
>
>
> Is there another fallback font readily available which gives for small
> hex numbers for the missing characters?

No, not yet…
Also, fallback fonts do not really work like that, they only have exactly one glyph that is used when the
falbackee (i mean the font in need of the fallback) says it does not have the glyph requested.

----------
fallbackFont
        "Answers the fallbackFont for the receiver. The fallback font must be some derivative of the receiver since it will not be asked to install itself properly on the target BitBlt so rendering a completely different font here is simply not possible. The default implementation uses a synthetic font that maps all characters to question marks."
        ^ fallbackFont
                ifNil: [fallbackFont := FixedFaceFont new errorFont baseFont: self]
----------

But maybe we should change that.

The better alternative is to have actual good glyph coverage ;)

Best regards
        -Tobias

>
> --Hannes
>
> On Fri, 5 Jun 2015 20:20:36.139 0000, [hidden email]
> <[hidden email]> wrote:
>> Chris Muller uploaded a new version of MultilingualTests to project Squeak
>> 4.6:
>> http://source.squeak.org/squeak46/MultilingualTests-fbs.18.mcz
>>
>> ==================== Summary ====================
>>
>> Name: MultilingualTests-fbs.18
>> Author: fbs
>> Time: 6 November 2013, 6:35:02.811 pm
>> UUID: 07e26018-8455-3349-9b44-9ecb4aaeefb2
>> Ancestors: MultilingualTests-nice.17
>>
>> More #shouldnt:raise: Error fixes.
>>
>> ==================== Snapshot ====================
>>
>> SystemOrganization addCategory: #'MultilingualTests-TextConversion'!
>> SystemOrganization addCategory: #'MultilingualTests-Display'!
>>
>> TestCase subclass: #FontTest
>> instanceVariableNames: ''
>> classVariableNames: ''
>> poolDictionaries: ''
>> category: 'MultilingualTests-Display'!
>>
>> !FontTest commentStamp: 'tak 3/11/2005 14:31' prior: 0!
>> I am mainly a test for fallback font.
>> FontTest buildSuite run!
>>
>> ----- Method: FontTest>>testDisplay (in category 'testing') -----
>> testDisplay
>> "self debug: #testDisplay"
>> | text font bb destPoint width |
>> text := 'test' asText.
>> font := TextStyle default fontOfSize: 21.
>> text addAttribute: (TextFontReference toFont: font).
>> bb := (Form extent: 100 @ 30) getCanvas privatePort.
>> bb combinationRule: Form paint.
>>
>> font installOn: bb foregroundColor: Color black backgroundColor: Color
>> white.
>> destPoint := font displayString: text asString on: bb from: 1 to: 4 at: 0@0
>> kern: 1.
>>
>> width := text inject: 0 into: [:max :char | max + (font widthOf: char)].
>> self assert: destPoint x = (width + 4).
>> "bb destForm asMorph openInHand."
>> !
>>
>> ----- Method: FontTest>>testFallback (in category 'testing') -----
>> testFallback
>> "self debug: #testFallback"
>> | text font bb destPoint |
>> text := (Character value: 257) asString asText.
>> font := TextStyle default fontOfSize: 21.
>> text addAttribute: (TextFontReference toFont: font).
>> bb := (Form extent: 100 @ 30) getCanvas privatePort.
>> bb combinationRule: Form paint.
>>
>> font installOn: bb foregroundColor: Color black backgroundColor: Color
>> white.
>> destPoint := font displayString: text asString on: bb from: 1 to: 1 at: 0@0
>> kern: 1.
>>
>> "bb destForm asMorph openInHand."
>> self assert: destPoint x = ((font widthOf: $?) + 1).
>> !
>>
>> ----- Method: FontTest>>testMultistringFallbackFont (in category 'testing')
>> -----
>> testMultistringFallbackFont
>> "self debug: #testMultistringFallbackFont"
>> | text p style height width |
>> [(TextStyle default fontArray at: JapaneseEnvironment leadingChar)
>> ifNil: [^ self]]
>> ifError: [:err :rcvr | ^ self].
>> text := ((#(20983874 20983876 20983878 )
>> collect: [:e | e asCharacter])
>> as: String) asText.
>> p := NewParagraph new.
>> style := TextStyle new leading: 0; newFontArray: {Preferences
>> standardFlapFont}.
>> p
>> compose: text
>> style: style
>> from: 1
>> in: (0 @ 0 corner: 100 @ 100).
>> "See CompositionScanner>>setActualFont: &
>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>> height := style defaultFont height + style leading.
>> width := text
>> inject: 0
>> into: [:tally :next | tally
>> + (style defaultFont widthOf: next)].
>> p adjustRightX.
>> self assert: p extent = (width @ height).
>> "Display getCanvas
>> paragraph: p
>> bounds: (10 @ 10 extent: 100 @ 100)
>> color: Color black"!
>>
>> ----- Method: FontTest>>testMultistringFont (in category 'testing') -----
>> testMultistringFont
>> "self debug: #testMultistringFont"
>> | text p style height width |
>> [(TextStyle default fontArray at: JapaneseEnvironment leadingChar)
>> ifNil: [^ self]]
>> ifError: [:err :rcvr | ^ self].
>> text := ((#(20983874 20983876 20983878 )
>> collect: [:e | e asCharacter])
>> as: String) asText.
>> p := NewParagraph new.
>> style := TextStyle default.
>> p
>> compose: text
>> style: style
>> from: 1
>> in: (0 @ 0 corner: 100 @ 100).
>> "See CompositionScanner>>setActualFont: &
>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>> height := style defaultFont height + style leading.
>> width := text
>> inject: 0
>> into: [:tally :next | tally
>> + (style defaultFont widthOf: next)].
>> p adjustRightX.
>> self assert: p extent = (width @ height).
>> "Display getCanvas
>> paragraph: p
>> bounds: (10 @ 10 extent: 100 @ 100)
>> color: Color black"!
>>
>> ----- Method: FontTest>>testParagraph (in category 'testing') -----
>> testParagraph
>> "self debug: #testParagraph"
>> | text p style height width |
>> text := 'test' asText.
>> p := NewParagraph new.
>> style := TextStyle default.
>> p
>> compose: text
>> style: style
>> from: 1
>> in: (0 @ 0 corner: 100 @ 100).
>> "See CompositionScanner>>setActualFont: &
>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>> height := style defaultFont height + style leading.
>> width := text
>> inject: 0
>> into: [:tally :next | tally
>> + (style defaultFont widthOf: next)].
>> p adjustRightX.
>> self assert: p extent = (width @ height)!
>>
>> ----- Method: FontTest>>testParagraphFallback (in category 'testing') -----
>> testParagraphFallback
>> "self debug: #testParagraphFallback"
>> | text p style height width e expect |
>> e := (Character value: 257) asString.
>> text := ('test' , e , e , e , e , 'test') asText.
>> expect := 'test????test'.
>> p := NewParagraph new.
>> style := TextStyle default.
>> p
>> compose: text
>> style: style
>> from: 1
>> in: (0 @ 0 corner: 100 @ 100).
>> "See CompositionScanner>>setActualFont: &
>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>> height := style defaultFont height + style leading.
>> width := expect
>> inject: 0
>> into: [:tally :next | tally
>> + (style defaultFont widthOf: next)].
>> p adjustRightX.
>> self assert: p extent = (width @ height).
>> "Display getCanvas
>> paragraph: p
>> bounds: (10 @ 10 extent: 100 @ 100)
>> color: Color black"!
>>
>> ----- Method: FontTest>>testResetAfterEmphasized (in category 'testing')
>> -----
>> testResetAfterEmphasized
>> "self debug: #testResetAfterEmphasized"
>> | normal derivative |
>> normal := TextStyle defaultFont.
>> derivative := normal emphasized: 3.
>> self assert: (normal derivativeFonts at: 3) == derivative.
>> normal reset.
>> self assert: (normal derivativeFonts select:[:any| any isSynthetic])
>> isEmpty
>> !
>>
>> TestCase subclass: #MultiByteFileStreamTest
>> instanceVariableNames: 'fileName'
>> classVariableNames: ''
>> poolDictionaries: ''
>> category: 'MultilingualTests-TextConversion'!
>>
>> ----- Method: MultiByteFileStreamTest>>tearDown (in category 'running')
>> -----
>> tearDown
>>
>> fileName ifNotNil: [
>> FileDirectory default deleteFileNamed: fileName ]!
>>
>> ----- Method: MultiByteFileStreamTest>>testAsciiBackChunk (in category
>> 'testing') -----
>> testAsciiBackChunk
>>
>> fileName := 'foobackchunk.txt'.
>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>> file
>> lineEndConvention: #cr;
>> converter: UTF8TextConverter new;
>> cr; nextChunkPut: 'test1' printString;
>> cr; nextChunkPut: 'test2' printString.
>> self
>> assert: file backChunk = (String cr , 'test2' printString);
>> assert: file backChunk = (String cr , 'test1' printString) ]!
>>
>> ----- Method: MultiByteFileStreamTest>>testBinaryUpTo (in category
>> 'testing') -----
>> testBinaryUpTo
>> "This is a non regression test for bug
>> http://bugs.squeak.org/view.php?id=6933"
>>
>> fileName := 'foobug6933'.
>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>> file
>> binary;
>> nextPutAll: #[ 1 2 3 4 ] ].
>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>> file binary.
>> self assert: (file upTo: 3) = #[ 1 2 ] ]!
>>
>> ----- Method: MultiByteFileStreamTest>>testByteTextConverter (in category
>> 'testing') -----
>> testByteTextConverter
>> | strings converterClasses |
>> strings := {
>> String newFrom: ((0 to: 255) collect: [:e | e asCharacter]).
>> }.
>>
>> converterClasses := ByteTextConverter allSubclasses.
>> converterClasses do: [:converterClass |
>> strings do: [:string | | converter stream encoded decoded encoded2 |
>> converter := converterClass new.
>> stream := string readStream.
>> encoded := string select: [:e | (converter nextFromStream: stream)
>> notNil].
>> stream := encoded readStream.
>> decoded := encoded collect: [:e | converter nextFromStream: stream].
>> self assert: stream atEnd.
>> stream := String new writeStream.
>> converter nextPutAll: decoded toStream: stream.
>> encoded2 := stream contents.
>> self assert: (encoded2 collect: [:e | e charCode] as: Array) = (encoded
>> collect: [:e | e charCode] as: Array).
>> stream := String new writeStream.
>> decoded do: [:e | converter nextPut: e toStream: stream].
>> encoded2 := stream contents.
>> self assert: (encoded2 collect: [:e | e charCode] as: Array) = (encoded
>> collect: [:e | e charCode] as: Array)]]!
>>
>> ----- Method:
>> MultiByteFileStreamTest>>testLineEndConvention:withConverter:ifFail: (in
>> category 'helpers') -----
>> testLineEndConvention: lineEndConvention withConverter: textConverterClass
>> ifFail: failBlock
>>
>> | expectedResult result |
>> [
>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>> file
>> converter: textConverterClass new;
>> lineEndConvention: lineEndConvention;
>> cr;
>> nextPut: Character cr;
>> nextPutAll: String cr;
>> nextPutAll: String cr asWideString ].
>> result := StandardFileStream oldFileNamed: fileName do: [ :file |
>> file contents ].
>> expectedResult := String streamContents: [ :stream |
>> 4 timesRepeat: [ stream perform: lineEndConvention ] ].
>> result = expectedResult ifFalse: [
>> failBlock value: expectedResult asByteArray value: result asByteArray ]
>> ]
>> on: Error
>> do: [ :err | failBlock value: err messageText value: err messageText ]!
>>
>> ----- Method: MultiByteFileStreamTest>>testLineEndConversion (in category
>> 'testing') -----
>> testLineEndConversion
>>
>> | failures |
>> fileName := 'foolinendconversion.txt'.
>> failures := OrderedCollection new.
>> TextConverter allSubclassesDo: [ :textConverterClass |
>> textConverterClass encodingNames ifNotEmpty: [
>> #(cr lf crlf) do: [ :lineEndConvention |
>> self
>> testLineEndConvention: lineEndConvention
>> withConverter: textConverterClass
>> ifFail: [ :expectedResult :result |
>> failures add: {
>> textConverterClass.
>> lineEndConvention.
>> expectedResult.
>> result } ] ] ] ].
>> self assert: failures isEmpty!
>>
>> ----- Method: MultiByteFileStreamTest>>testLineEnding (in category
>> 'testing') -----
>> testLineEnding
>>
>> fileName := 'foolinend.txt'.
>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>> file
>> wantsLineEndConversion: false;
>> nextPutAll: 'line 1'; cr;
>> nextPutAll: 'line 2'; crlf;
>> nextPutAll: 'line 3'; lf;
>> nextPutAll: 'line 4' ].
>> {
>> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
>> , 'line 4'}.
>> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
>> , 'line 4'}.
>> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
>> cr , 'line 4'}.
>> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' , String
>> lf , 'line 4'}
>> } do: [:lineEndingResult |
>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>> file lineEndConvention: lineEndingResult first.
>> self assert: file upToEnd = lineEndingResult last ] ]!
>>
>> ----- Method: MultiByteFileStreamTest>>testLineEndingChunk (in category
>> 'testing') -----
>> testLineEndingChunk
>>
>> fileName := 'foolinend.txt'.
>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>> file
>> wantsLineEndConversion: false;
>> nextPutAll: 'line 1'; cr;
>> nextPutAll: 'line 2'; crlf;
>> nextPutAll: 'line 3'; lf;
>> nextPutAll: 'line 4'; nextPut: $!! ].
>> {
>> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
>> , 'line 4'}.
>> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
>> , 'line 4'}.
>> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
>> cr , 'line 4'}.
>> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' , String
>> lf , 'line 4'}
>> } do: [:lineEndingResult |
>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>> file lineEndConvention: lineEndingResult first.
>> self assert: lineEndingResult last equals: file nextChunk ] ]!
>>
>> ----- Method: MultiByteFileStreamTest>>testLineEndingWithWideStrings (in
>> category 'testing') -----
>> testLineEndingWithWideStrings
>>
>> | cr lf crlf |
>> fileName := 'foolinend.txt'.
>> cr := String cr asWideString.
>> lf := String lf asWideString.
>> crlf := String crlf asWideString.
>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>> file
>> wantsLineEndConversion: false;
>> nextPutAll: 'line 1'; nextPutAll: cr;
>> nextPutAll: 'line 2'; nextPutAll: crlf;
>> nextPutAll: 'line 3'; nextPutAll: lf;
>> nextPutAll: 'line 4' ].
>> {
>> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
>> , 'line 4'}.
>> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String cr
>> , 'line 4'}.
>> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
>> cr , 'line 4'}.
>> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' , String
>> lf , 'line 4'}
>> } do: [ :lineEndingResult |
>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>> file lineEndConvention: lineEndingResult first.
>> self assert: file upToEnd = lineEndingResult last ] ]!
>>
>> ----- Method: MultiByteFileStreamTest>>testMultiByteTextConverter (in
>> category 'testing') -----
>> testMultiByteTextConverter
>> | strings converterClasses |
>> strings := {
>> String newFrom: ((0 to: 255) collect: [:e | Unicode value: e]).
>> String newFrom: ((0 to: 1023) collect: [:e | Unicode value: e]).
>> }.
>>
>> converterClasses := {
>> UTF8TextConverter . UTF16TextConverter .
>> "CompoundTextConverter ."
>> "EUCJPTextConverter . CNGBTextConverter . ShiftJISTextConverter .
>> EUCKRTextConverter"}.
>> converterClasses do: [:converterClass |
>> strings do: [:string |
>> | converter stream |
>> converter := converterClass new.
>> stream := String new writeStream.
>> converter nextPutAll: string toStream: stream.
>> stream := stream contents readStream.
>> string do: [:e | | decoded |
>> decoded := converter nextFromStream: stream.
>> self assert: e charCode = decoded charCode].
>> self assert: stream atEnd.
>>
>> stream := String new writeStream.
>> string do: [:e | converter nextPut: e toStream: stream].
>> stream := stream contents readStream.
>> string do: [:e | | decoded |
>> decoded := converter nextFromStream: stream.
>> self assert: e charCode = decoded charCode].
>> self assert: stream atEnd]]!
>>
>> ----- Method: MultiByteFileStreamTest>>testNextLine (in category 'testing')
>> -----
>> testNextLine
>>
>> fileName := 'foonextline.txt'.
>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>> file
>> wantsLineEndConversion: false;
>> nextPutAll: 'line 1'; cr;
>> nextPutAll: 'line 2'; crlf;
>> nextPutAll: 'line 3'; lf;
>> nextPutAll: 'line 4' ].
>> #(cr lf crlf nil) do: [:lineEnding |
>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>> file lineEndConvention: lineEnding.
>> self
>> assert: file nextLine = 'line 1';
>> assert: file nextLine = 'line 2';
>> assert: file nextLine = 'line 3';
>> assert: file nextLine = 'line 4';
>> assert: file nextLine = nil ] ]!
>>
>> ----- Method: MultiByteFileStreamTest>>testNextPutAllStartingAt (in category
>> 'testing') -----
>> testNextPutAllStartingAt
>>
>> | result |
>> fileName := 'foonextputallstartingat.txt'.
>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>> { 'abcde' asWideString. 'abcde' } do: [ :string |
>> file
>> next: 1 putAll: string startingAt: 5;
>> next: 3 putAll: string startingAt: 2;
>> next: 1 putAll: string startingAt: 1 ] ].
>> result := StandardFileStream readOnlyFileNamed: fileName do: [ :file |
>> file binary; contents ].
>> self assert: #[101 98 99 100 97 101 98 99 100 97] equals: result
>> !
>>
>> ----- Method: MultiByteFileStreamTest>>testNonAsciiBackChunk (in category
>> 'testing') -----
>> testNonAsciiBackChunk
>> "Note: this is an expected failure: MultiByteFileStream is not equipped to
>> read back non ASCII String... (no comment)
>> As a consequence, never use non ASCII in method category nor in your
>> initials. That would make a few tools blind..."
>>
>> fileName :=  'foobackchunk.txt'.
>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>> file
>> lineEndConvention: #cr;
>> converter: UTF8TextConverter new;
>> cr; nextChunkPut: 'testé' printString;
>> cr; nextChunkPut: 'test' printString.
>> self assert: file backChunk = (String cr , 'test' printString).
>> self assert: file backChunk = (String cr , 'testé' printString) ]!
>>
>> TestCase subclass: #UTF16TextConverterTest
>> instanceVariableNames: ''
>> classVariableNames: ''
>> poolDictionaries: ''
>> category: 'MultilingualTests-TextConversion'!
>>
>> ----- Method: UTF16TextConverterTest>>testByteOrders (in category 'testing')
>> -----
>> testByteOrders
>> |converter originalText bytes decodedText |
>> originalText := 'test'.
>> converter := UTF16TextConverter new.
>>
>> "Default (ie useLittleEndian instvar nil)"
>> bytes := (originalText convertToWithConverter: converter).
>> decodedText := bytes convertFromWithConverter: converter.
>>
>> self assert: originalText equals: decodedText.
>>
>> "Little-endian"
>> converter useLittleEndian: true.
>>
>> bytes := (originalText convertToWithConverter: converter).
>> decodedText := bytes convertFromWithConverter: converter.
>>
>> self assert: originalText equals: decodedText.
>>
>> "Big-endian"
>> converter useLittleEndian: false.
>>
>> bytes := (originalText convertToWithConverter: converter).
>> decodedText := bytes convertFromWithConverter: converter.
>>
>> self assert: originalText equals: decodedText.
>>
>> !
>>
>> ClassTestCase subclass: #UTF8TextConverterTest
>> instanceVariableNames: ''
>> classVariableNames: ''
>> poolDictionaries: ''
>> category: 'MultilingualTests-TextConversion'!
>>
>> ----- Method: UTF8TextConverterTest>>testLazyConversion (in category
>> 'tests') -----
>> testLazyConversion
>> "Ensure the lazy conversions do what they should"
>>
>> | strict result |
>> strict := UTF8TextConverter strictUtf8Conversions.
>> [UTF8TextConverter strictUtf8Conversions: false.
>> result := 'Grüß Gott' utf8ToSqueak.
>> ] ensure:[UTF8TextConverter strictUtf8Conversions: strict].
>>
>> self assert: result = 'Grüß Gott'.
>> !
>>
>> ----- Method: UTF8TextConverterTest>>testSqueakToUtf8 (in category 'tests')
>> -----
>> testSqueakToUtf8
>> "Ensure proper encoding"
>>
>> self assert: '' squeakToUtf8 equals: ''.
>> self assert: 'Hello World' squeakToUtf8 equals: 'Hello World'.
>> self assert: 'Grüß Gott' squeakToUtf8 asByteArray
>> equals: #[71 114 195 188 195 159 32 71 111 116 116]!
>>
>> ----- Method: UTF8TextConverterTest>>testStrictConversion (in category
>> 'tests') -----
>> testStrictConversion
>> "Ensure the strict conversions do what they should"
>>
>> | strict |
>> strict := UTF8TextConverter strictUtf8Conversions.
>> [UTF8TextConverter strictUtf8Conversions: true.
>> self should:[ 'Grüß Gott' utf8ToSqueak ] raise: Error.
>> ] ensure:[UTF8TextConverter strictUtf8Conversions: strict].!
>>
>> ----- Method: UTF8TextConverterTest>>testUtf8ToSqueak (in category 'tests')
>> -----
>> testUtf8ToSqueak
>> "Ensure proper encoding"
>>
>> self assert: '' utf8ToSqueak equals: ''.
>> self assert: 'Hello World' utf8ToSqueak equals: 'Hello World'.
>> self assert: #[71 114 195 188 195 159 32 71 111 116 116] asString
>> utf8ToSqueak
>> equals: 'Grüß Gott'
>>
>> !
>>
>>
>>
>


Reply | Threaded
Open this post in threaded view
|

Re: Squeak 4.6: MultilingualTests-fbs.18.mcz

Hannes Hirzel
On 1/19/17, Tobias Pape <[hidden email]> wrote:

>
> On 19.01.2017, at 07:57, H. Hirzel <[hidden email]> wrote:
>
>> Reactivating an old thread ...
>>
>> Taking the test above just gives a question mark for the fallback font
>> case
>>
>>  | text font bb destPoint |
>>        text := (Character value: 257) asString asText.
>>        font := TextStyle default fontOfSize: 21.
>>        text addAttribute: (TextFontReference toFont: font).
>>        bb := (Form extent: 100 @ 30) getCanvas privatePort.
>>        bb combinationRule: Form paint.
>>
>>        font installOn: bb foregroundColor: Color black
>> backgroundColor: Color white.
>>        destPoint := font displayString: text asString on: bb from: 1
>> to: 1 at: 0@0 kern: 1.
>>
>>        bb destForm asMorph openInHand.
>>
>>
>> Is there another fallback font readily available which gives for small
>> hex numbers for the missing characters?
>
> No, not yet…
> Also, fallback fonts do not really work like that, they only have exactly
> one glyph that is used when the
> falbackee (i mean the font in need of the fallback) says it does not have
> the glyph requested.
>
> ----------
> fallbackFont
> "Answers the fallbackFont for the receiver. The fallback font must be some
> derivative of the receiver since it will not be asked to install itself
> properly on the target BitBlt so rendering a completely different font here
> is simply not possible. The default implementation uses a synthetic font
> that maps all characters to question marks."
> ^ fallbackFont
> ifNil: [fallbackFont := FixedFaceFont new errorFont baseFont: self]
> ----------
>
> But maybe we should change that.

Yes, I was not aware of this limited concept of 'fallback' font.

Why not create a glyph with 4 tiny hex digits on the fly, when requested?

A report on http://www.bgaertner.gmxhome.de/Sqm17n.htm gives details
about such a font

http://www.bgaertner.gmxhome.de/Squeak38ExperienceRep.zip

"Toy font"


> The better alternative is to have actual good glyph coverage ;)

Yes. A bitmap font with better glyph coverage is needed in  the image.
Or on SqueakMap.


> Best regards
> -Tobias
>
>>
>> --Hannes
>>
>> On Fri, 5 Jun 2015 20:20:36.139 0000, [hidden email]
>> <[hidden email]> wrote:
>>> Chris Muller uploaded a new version of MultilingualTests to project
>>> Squeak
>>> 4.6:
>>> http://source.squeak.org/squeak46/MultilingualTests-fbs.18.mcz
>>>
>>> ==================== Summary ====================
>>>
>>> Name: MultilingualTests-fbs.18
>>> Author: fbs
>>> Time: 6 November 2013, 6:35:02.811 pm
>>> UUID: 07e26018-8455-3349-9b44-9ecb4aaeefb2
>>> Ancestors: MultilingualTests-nice.17
>>>
>>> More #shouldnt:raise: Error fixes.
>>>
>>> ==================== Snapshot ====================
>>>
>>> SystemOrganization addCategory: #'MultilingualTests-TextConversion'!
>>> SystemOrganization addCategory: #'MultilingualTests-Display'!
>>>
>>> TestCase subclass: #FontTest
>>> instanceVariableNames: ''
>>> classVariableNames: ''
>>> poolDictionaries: ''
>>> category: 'MultilingualTests-Display'!
>>>
>>> !FontTest commentStamp: 'tak 3/11/2005 14:31' prior: 0!
>>> I am mainly a test for fallback font.
>>> FontTest buildSuite run!
>>>
>>> ----- Method: FontTest>>testDisplay (in category 'testing') -----
>>> testDisplay
>>> "self debug: #testDisplay"
>>> | text font bb destPoint width |
>>> text := 'test' asText.
>>> font := TextStyle default fontOfSize: 21.
>>> text addAttribute: (TextFontReference toFont: font).
>>> bb := (Form extent: 100 @ 30) getCanvas privatePort.
>>> bb combinationRule: Form paint.
>>>
>>> font installOn: bb foregroundColor: Color black backgroundColor: Color
>>> white.
>>> destPoint := font displayString: text asString on: bb from: 1 to: 4 at:
>>> 0@0
>>> kern: 1.
>>>
>>> width := text inject: 0 into: [:max :char | max + (font widthOf: char)].
>>> self assert: destPoint x = (width + 4).
>>> "bb destForm asMorph openInHand."
>>> !
>>>
>>> ----- Method: FontTest>>testFallback (in category 'testing') -----
>>> testFallback
>>> "self debug: #testFallback"
>>> | text font bb destPoint |
>>> text := (Character value: 257) asString asText.
>>> font := TextStyle default fontOfSize: 21.
>>> text addAttribute: (TextFontReference toFont: font).
>>> bb := (Form extent: 100 @ 30) getCanvas privatePort.
>>> bb combinationRule: Form paint.
>>>
>>> font installOn: bb foregroundColor: Color black backgroundColor: Color
>>> white.
>>> destPoint := font displayString: text asString on: bb from: 1 to: 1 at:
>>> 0@0
>>> kern: 1.
>>>
>>> "bb destForm asMorph openInHand."
>>> self assert: destPoint x = ((font widthOf: $?) + 1).
>>> !
>>>
>>> ----- Method: FontTest>>testMultistringFallbackFont (in category
>>> 'testing')
>>> -----
>>> testMultistringFallbackFont
>>> "self debug: #testMultistringFallbackFont"
>>> | text p style height width |
>>> [(TextStyle default fontArray at: JapaneseEnvironment leadingChar)
>>> ifNil: [^ self]]
>>> ifError: [:err :rcvr | ^ self].
>>> text := ((#(20983874 20983876 20983878 )
>>> collect: [:e | e asCharacter])
>>> as: String) asText.
>>> p := NewParagraph new.
>>> style := TextStyle new leading: 0; newFontArray: {Preferences
>>> standardFlapFont}.
>>> p
>>> compose: text
>>> style: style
>>> from: 1
>>> in: (0 @ 0 corner: 100 @ 100).
>>> "See CompositionScanner>>setActualFont: &
>>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>>> height := style defaultFont height + style leading.
>>> width := text
>>> inject: 0
>>> into: [:tally :next | tally
>>> + (style defaultFont widthOf: next)].
>>> p adjustRightX.
>>> self assert: p extent = (width @ height).
>>> "Display getCanvas
>>> paragraph: p
>>> bounds: (10 @ 10 extent: 100 @ 100)
>>> color: Color black"!
>>>
>>> ----- Method: FontTest>>testMultistringFont (in category 'testing') -----
>>> testMultistringFont
>>> "self debug: #testMultistringFont"
>>> | text p style height width |
>>> [(TextStyle default fontArray at: JapaneseEnvironment leadingChar)
>>> ifNil: [^ self]]
>>> ifError: [:err :rcvr | ^ self].
>>> text := ((#(20983874 20983876 20983878 )
>>> collect: [:e | e asCharacter])
>>> as: String) asText.
>>> p := NewParagraph new.
>>> style := TextStyle default.
>>> p
>>> compose: text
>>> style: style
>>> from: 1
>>> in: (0 @ 0 corner: 100 @ 100).
>>> "See CompositionScanner>>setActualFont: &
>>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>>> height := style defaultFont height + style leading.
>>> width := text
>>> inject: 0
>>> into: [:tally :next | tally
>>> + (style defaultFont widthOf: next)].
>>> p adjustRightX.
>>> self assert: p extent = (width @ height).
>>> "Display getCanvas
>>> paragraph: p
>>> bounds: (10 @ 10 extent: 100 @ 100)
>>> color: Color black"!
>>>
>>> ----- Method: FontTest>>testParagraph (in category 'testing') -----
>>> testParagraph
>>> "self debug: #testParagraph"
>>> | text p style height width |
>>> text := 'test' asText.
>>> p := NewParagraph new.
>>> style := TextStyle default.
>>> p
>>> compose: text
>>> style: style
>>> from: 1
>>> in: (0 @ 0 corner: 100 @ 100).
>>> "See CompositionScanner>>setActualFont: &
>>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>>> height := style defaultFont height + style leading.
>>> width := text
>>> inject: 0
>>> into: [:tally :next | tally
>>> + (style defaultFont widthOf: next)].
>>> p adjustRightX.
>>> self assert: p extent = (width @ height)!
>>>
>>> ----- Method: FontTest>>testParagraphFallback (in category 'testing')
>>> -----
>>> testParagraphFallback
>>> "self debug: #testParagraphFallback"
>>> | text p style height width e expect |
>>> e := (Character value: 257) asString.
>>> text := ('test' , e , e , e , e , 'test') asText.
>>> expect := 'test????test'.
>>> p := NewParagraph new.
>>> style := TextStyle default.
>>> p
>>> compose: text
>>> style: style
>>> from: 1
>>> in: (0 @ 0 corner: 100 @ 100).
>>> "See CompositionScanner>>setActualFont: &
>>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>>> height := style defaultFont height + style leading.
>>> width := expect
>>> inject: 0
>>> into: [:tally :next | tally
>>> + (style defaultFont widthOf: next)].
>>> p adjustRightX.
>>> self assert: p extent = (width @ height).
>>> "Display getCanvas
>>> paragraph: p
>>> bounds: (10 @ 10 extent: 100 @ 100)
>>> color: Color black"!
>>>
>>> ----- Method: FontTest>>testResetAfterEmphasized (in category 'testing')
>>> -----
>>> testResetAfterEmphasized
>>> "self debug: #testResetAfterEmphasized"
>>> | normal derivative |
>>> normal := TextStyle defaultFont.
>>> derivative := normal emphasized: 3.
>>> self assert: (normal derivativeFonts at: 3) == derivative.
>>> normal reset.
>>> self assert: (normal derivativeFonts select:[:any| any isSynthetic])
>>> isEmpty
>>> !
>>>
>>> TestCase subclass: #MultiByteFileStreamTest
>>> instanceVariableNames: 'fileName'
>>> classVariableNames: ''
>>> poolDictionaries: ''
>>> category: 'MultilingualTests-TextConversion'!
>>>
>>> ----- Method: MultiByteFileStreamTest>>tearDown (in category 'running')
>>> -----
>>> tearDown
>>>
>>> fileName ifNotNil: [
>>> FileDirectory default deleteFileNamed: fileName ]!
>>>
>>> ----- Method: MultiByteFileStreamTest>>testAsciiBackChunk (in category
>>> 'testing') -----
>>> testAsciiBackChunk
>>>
>>> fileName := 'foobackchunk.txt'.
>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>> file
>>> lineEndConvention: #cr;
>>> converter: UTF8TextConverter new;
>>> cr; nextChunkPut: 'test1' printString;
>>> cr; nextChunkPut: 'test2' printString.
>>> self
>>> assert: file backChunk = (String cr , 'test2' printString);
>>> assert: file backChunk = (String cr , 'test1' printString) ]!
>>>
>>> ----- Method: MultiByteFileStreamTest>>testBinaryUpTo (in category
>>> 'testing') -----
>>> testBinaryUpTo
>>> "This is a non regression test for bug
>>> http://bugs.squeak.org/view.php?id=6933"
>>>
>>> fileName := 'foobug6933'.
>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>> file
>>> binary;
>>> nextPutAll: #[ 1 2 3 4 ] ].
>>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>>> file binary.
>>> self assert: (file upTo: 3) = #[ 1 2 ] ]!
>>>
>>> ----- Method: MultiByteFileStreamTest>>testByteTextConverter (in category
>>> 'testing') -----
>>> testByteTextConverter
>>> | strings converterClasses |
>>> strings := {
>>> String newFrom: ((0 to: 255) collect: [:e | e asCharacter]).
>>> }.
>>>
>>> converterClasses := ByteTextConverter allSubclasses.
>>> converterClasses do: [:converterClass |
>>> strings do: [:string | | converter stream encoded decoded encoded2 |
>>> converter := converterClass new.
>>> stream := string readStream.
>>> encoded := string select: [:e | (converter nextFromStream: stream)
>>> notNil].
>>> stream := encoded readStream.
>>> decoded := encoded collect: [:e | converter nextFromStream: stream].
>>> self assert: stream atEnd.
>>> stream := String new writeStream.
>>> converter nextPutAll: decoded toStream: stream.
>>> encoded2 := stream contents.
>>> self assert: (encoded2 collect: [:e | e charCode] as: Array) =
>>> (encoded
>>> collect: [:e | e charCode] as: Array).
>>> stream := String new writeStream.
>>> decoded do: [:e | converter nextPut: e toStream: stream].
>>> encoded2 := stream contents.
>>> self assert: (encoded2 collect: [:e | e charCode] as: Array) =
>>> (encoded
>>> collect: [:e | e charCode] as: Array)]]!
>>>
>>> ----- Method:
>>> MultiByteFileStreamTest>>testLineEndConvention:withConverter:ifFail: (in
>>> category 'helpers') -----
>>> testLineEndConvention: lineEndConvention withConverter:
>>> textConverterClass
>>> ifFail: failBlock
>>>
>>> | expectedResult result |
>>> [
>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>> file
>>> converter: textConverterClass new;
>>> lineEndConvention: lineEndConvention;
>>> cr;
>>> nextPut: Character cr;
>>> nextPutAll: String cr;
>>> nextPutAll: String cr asWideString ].
>>> result := StandardFileStream oldFileNamed: fileName do: [ :file |
>>> file contents ].
>>> expectedResult := String streamContents: [ :stream |
>>> 4 timesRepeat: [ stream perform: lineEndConvention ] ].
>>> result = expectedResult ifFalse: [
>>> failBlock value: expectedResult asByteArray value: result asByteArray
>>> ]
>>> ]
>>> on: Error
>>> do: [ :err | failBlock value: err messageText value: err messageText ]!
>>>
>>> ----- Method: MultiByteFileStreamTest>>testLineEndConversion (in category
>>> 'testing') -----
>>> testLineEndConversion
>>>
>>> | failures |
>>> fileName := 'foolinendconversion.txt'.
>>> failures := OrderedCollection new.
>>> TextConverter allSubclassesDo: [ :textConverterClass |
>>> textConverterClass encodingNames ifNotEmpty: [
>>> #(cr lf crlf) do: [ :lineEndConvention |
>>> self
>>> testLineEndConvention: lineEndConvention
>>> withConverter: textConverterClass
>>> ifFail: [ :expectedResult :result |
>>> failures add: {
>>> textConverterClass.
>>> lineEndConvention.
>>> expectedResult.
>>> result } ] ] ] ].
>>> self assert: failures isEmpty!
>>>
>>> ----- Method: MultiByteFileStreamTest>>testLineEnding (in category
>>> 'testing') -----
>>> testLineEnding
>>>
>>> fileName := 'foolinend.txt'.
>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>> file
>>> wantsLineEndConversion: false;
>>> nextPutAll: 'line 1'; cr;
>>> nextPutAll: 'line 2'; crlf;
>>> nextPutAll: 'line 3'; lf;
>>> nextPutAll: 'line 4' ].
>>> {
>>> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
>>> cr
>>> , 'line 4'}.
>>> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
>>> cr
>>> , 'line 4'}.
>>> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>> String
>>> cr , 'line 4'}.
>>> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' ,
>>> String
>>> lf , 'line 4'}
>>> } do: [:lineEndingResult |
>>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>>> file lineEndConvention: lineEndingResult first.
>>> self assert: file upToEnd = lineEndingResult last ] ]!
>>>
>>> ----- Method: MultiByteFileStreamTest>>testLineEndingChunk (in category
>>> 'testing') -----
>>> testLineEndingChunk
>>>
>>> fileName := 'foolinend.txt'.
>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>> file
>>> wantsLineEndConversion: false;
>>> nextPutAll: 'line 1'; cr;
>>> nextPutAll: 'line 2'; crlf;
>>> nextPutAll: 'line 3'; lf;
>>> nextPutAll: 'line 4'; nextPut: $!! ].
>>> {
>>> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
>>> cr
>>> , 'line 4'}.
>>> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
>>> cr
>>> , 'line 4'}.
>>> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>> String
>>> cr , 'line 4'}.
>>> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' ,
>>> String
>>> lf , 'line 4'}
>>> } do: [:lineEndingResult |
>>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>>> file lineEndConvention: lineEndingResult first.
>>> self assert: lineEndingResult last equals: file nextChunk ] ]!
>>>
>>> ----- Method: MultiByteFileStreamTest>>testLineEndingWithWideStrings (in
>>> category 'testing') -----
>>> testLineEndingWithWideStrings
>>>
>>> | cr lf crlf |
>>> fileName := 'foolinend.txt'.
>>> cr := String cr asWideString.
>>> lf := String lf asWideString.
>>> crlf := String crlf asWideString.
>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>> file
>>> wantsLineEndConversion: false;
>>> nextPutAll: 'line 1'; nextPutAll: cr;
>>> nextPutAll: 'line 2'; nextPutAll: crlf;
>>> nextPutAll: 'line 3'; nextPutAll: lf;
>>> nextPutAll: 'line 4' ].
>>> {
>>> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
>>> cr
>>> , 'line 4'}.
>>> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' , String
>>> cr
>>> , 'line 4'}.
>>> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>> String
>>> cr , 'line 4'}.
>>> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' ,
>>> String
>>> lf , 'line 4'}
>>> } do: [ :lineEndingResult |
>>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>>> file lineEndConvention: lineEndingResult first.
>>> self assert: file upToEnd = lineEndingResult last ] ]!
>>>
>>> ----- Method: MultiByteFileStreamTest>>testMultiByteTextConverter (in
>>> category 'testing') -----
>>> testMultiByteTextConverter
>>> | strings converterClasses |
>>> strings := {
>>> String newFrom: ((0 to: 255) collect: [:e | Unicode value: e]).
>>> String newFrom: ((0 to: 1023) collect: [:e | Unicode value: e]).
>>> }.
>>>
>>> converterClasses := {
>>> UTF8TextConverter . UTF16TextConverter .
>>> "CompoundTextConverter ."
>>> "EUCJPTextConverter . CNGBTextConverter . ShiftJISTextConverter .
>>> EUCKRTextConverter"}.
>>> converterClasses do: [:converterClass |
>>> strings do: [:string |
>>> | converter stream |
>>> converter := converterClass new.
>>> stream := String new writeStream.
>>> converter nextPutAll: string toStream: stream.
>>> stream := stream contents readStream.
>>> string do: [:e | | decoded |
>>> decoded := converter nextFromStream: stream.
>>> self assert: e charCode = decoded charCode].
>>> self assert: stream atEnd.
>>>
>>> stream := String new writeStream.
>>> string do: [:e | converter nextPut: e toStream: stream].
>>> stream := stream contents readStream.
>>> string do: [:e | | decoded |
>>> decoded := converter nextFromStream: stream.
>>> self assert: e charCode = decoded charCode].
>>> self assert: stream atEnd]]!
>>>
>>> ----- Method: MultiByteFileStreamTest>>testNextLine (in category
>>> 'testing')
>>> -----
>>> testNextLine
>>>
>>> fileName := 'foonextline.txt'.
>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>> file
>>> wantsLineEndConversion: false;
>>> nextPutAll: 'line 1'; cr;
>>> nextPutAll: 'line 2'; crlf;
>>> nextPutAll: 'line 3'; lf;
>>> nextPutAll: 'line 4' ].
>>> #(cr lf crlf nil) do: [:lineEnding |
>>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>>> file lineEndConvention: lineEnding.
>>> self
>>> assert: file nextLine = 'line 1';
>>> assert: file nextLine = 'line 2';
>>> assert: file nextLine = 'line 3';
>>> assert: file nextLine = 'line 4';
>>> assert: file nextLine = nil ] ]!
>>>
>>> ----- Method: MultiByteFileStreamTest>>testNextPutAllStartingAt (in
>>> category
>>> 'testing') -----
>>> testNextPutAllStartingAt
>>>
>>> | result |
>>> fileName := 'foonextputallstartingat.txt'.
>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>> { 'abcde' asWideString. 'abcde' } do: [ :string |
>>> file
>>> next: 1 putAll: string startingAt: 5;
>>> next: 3 putAll: string startingAt: 2;
>>> next: 1 putAll: string startingAt: 1 ] ].
>>> result := StandardFileStream readOnlyFileNamed: fileName do: [ :file |
>>> file binary; contents ].
>>> self assert: #[101 98 99 100 97 101 98 99 100 97] equals: result
>>> !
>>>
>>> ----- Method: MultiByteFileStreamTest>>testNonAsciiBackChunk (in category
>>> 'testing') -----
>>> testNonAsciiBackChunk
>>> "Note: this is an expected failure: MultiByteFileStream is not equipped
>>> to
>>> read back non ASCII String... (no comment)
>>> As a consequence, never use non ASCII in method category nor in your
>>> initials. That would make a few tools blind..."
>>>
>>> fileName :=  'foobackchunk.txt'.
>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>> file
>>> lineEndConvention: #cr;
>>> converter: UTF8TextConverter new;
>>> cr; nextChunkPut: 'testé' printString;
>>> cr; nextChunkPut: 'test' printString.
>>> self assert: file backChunk = (String cr , 'test' printString).
>>> self assert: file backChunk = (String cr , 'testé' printString) ]!
>>>
>>> TestCase subclass: #UTF16TextConverterTest
>>> instanceVariableNames: ''
>>> classVariableNames: ''
>>> poolDictionaries: ''
>>> category: 'MultilingualTests-TextConversion'!
>>>
>>> ----- Method: UTF16TextConverterTest>>testByteOrders (in category
>>> 'testing')
>>> -----
>>> testByteOrders
>>> |converter originalText bytes decodedText |
>>> originalText := 'test'.
>>> converter := UTF16TextConverter new.
>>>
>>> "Default (ie useLittleEndian instvar nil)"
>>> bytes := (originalText convertToWithConverter: converter).
>>> decodedText := bytes convertFromWithConverter: converter.
>>>
>>> self assert: originalText equals: decodedText.
>>>
>>> "Little-endian"
>>> converter useLittleEndian: true.
>>>
>>> bytes := (originalText convertToWithConverter: converter).
>>> decodedText := bytes convertFromWithConverter: converter.
>>>
>>> self assert: originalText equals: decodedText.
>>>
>>> "Big-endian"
>>> converter useLittleEndian: false.
>>>
>>> bytes := (originalText convertToWithConverter: converter).
>>> decodedText := bytes convertFromWithConverter: converter.
>>>
>>> self assert: originalText equals: decodedText.
>>>
>>> !
>>>
>>> ClassTestCase subclass: #UTF8TextConverterTest
>>> instanceVariableNames: ''
>>> classVariableNames: ''
>>> poolDictionaries: ''
>>> category: 'MultilingualTests-TextConversion'!
>>>
>>> ----- Method: UTF8TextConverterTest>>testLazyConversion (in category
>>> 'tests') -----
>>> testLazyConversion
>>> "Ensure the lazy conversions do what they should"
>>>
>>> | strict result |
>>> strict := UTF8TextConverter strictUtf8Conversions.
>>> [UTF8TextConverter strictUtf8Conversions: false.
>>> result := 'Grüß Gott' utf8ToSqueak.
>>> ] ensure:[UTF8TextConverter strictUtf8Conversions: strict].
>>>
>>> self assert: result = 'Grüß Gott'.
>>> !
>>>
>>> ----- Method: UTF8TextConverterTest>>testSqueakToUtf8 (in category
>>> 'tests')
>>> -----
>>> testSqueakToUtf8
>>> "Ensure proper encoding"
>>>
>>> self assert: '' squeakToUtf8 equals: ''.
>>> self assert: 'Hello World' squeakToUtf8 equals: 'Hello World'.
>>> self assert: 'Grüß Gott' squeakToUtf8 asByteArray
>>> equals: #[71 114 195 188 195 159 32 71 111 116 116]!
>>>
>>> ----- Method: UTF8TextConverterTest>>testStrictConversion (in category
>>> 'tests') -----
>>> testStrictConversion
>>> "Ensure the strict conversions do what they should"
>>>
>>> | strict |
>>> strict := UTF8TextConverter strictUtf8Conversions.
>>> [UTF8TextConverter strictUtf8Conversions: true.
>>> self should:[ 'Grüß Gott' utf8ToSqueak ] raise: Error.
>>> ] ensure:[UTF8TextConverter strictUtf8Conversions: strict].!
>>>
>>> ----- Method: UTF8TextConverterTest>>testUtf8ToSqueak (in category
>>> 'tests')
>>> -----
>>> testUtf8ToSqueak
>>> "Ensure proper encoding"
>>>
>>> self assert: '' utf8ToSqueak equals: ''.
>>> self assert: 'Hello World' utf8ToSqueak equals: 'Hello World'.
>>> self assert: #[71 114 195 188 195 159 32 71 111 116 116] asString
>>> utf8ToSqueak
>>> equals: 'Grüß Gott'
>>>
>>> !
>>>
>>>
>>>
>>
>
>
>

Reply | Threaded
Open this post in threaded view
|

Re: Squeak 4.6: MultilingualTests-fbs.18.mcz

Hannes Hirzel
The changeset given in the report
http://www.bgaertner.gmxhome.de/Squeak38ExperienceRep.zip

files in fine if

      MultiCharacter

is replaced by

      Character

There is as well a bitmap font  "SofijaUC29.zip" which I have not
tried out yet to file in.

----------------------------------------------------------------------------------------------------------------------------

'From Squeak3.8gamma of ''24 November 2004'' [latest update: #6485] on
3 December 2004 at 10:36:04 am'!
"Change Set: ToyFonts
Date: 3 December 2004
Author: Boris Gaertner

This change set contains code that is needed to create a font with
glyphs that show the Unicode codepoints. This is of very limited use,
essentially such a font is needed to test Unicode-related algorithms.
"!

Object subclass: #GlyphCreator
        instanceVariableNames: ''
        classVariableNames: 'Digits Gl0 Gl1 Gl2 Gl3 Gl4 Gl5 Gl6 Gl7 Gl8 Gl9
GlA GlB GlC GlD GlE GlF'
        poolDictionaries: ''
        category: 'Font-Tutorial'!

!GlyphCreator class methodsFor: 'class initialization' stamp: 'BG
11/25/2004 11:47'!
initialize
 "GlyphCreator initialize"
  Gl0 := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 1610612736 2415919104 2415919104 2415919104
2415919104 1610612736)
        offset: 0@0).
 Gl1 := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 536870912 1610612736 536870912 536870912 536870912 1879048192)
        offset: 0@0).
 Gl2 := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 1610612736 2415919104 268435456 536870912 1073741824
4026531840)
        offset: 0@0).
 Gl3 := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 1610612736 268435456 1610612736 268435456 2415919104
1610612736)
        offset: 0@0).
 Gl4 := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 536870912 1610612736 2684354560 4026531840 536870912 536870912)
        offset: 0@0).
 Gl5 := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 3758096384 2147483648 3758096384 268435456 268435456
3758096384)
        offset: 0@0).
 Gl6 := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 1610612736 2147483648 3758096384 2415919104
2415919104 1610612736)
        offset: 0@0).
Gl7 := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 4026531840 268435456 536870912 1073741824 1073741824
1073741824)
        offset: 0@0).
Gl8 := (Form
        extent: 5@7
        depth: 1
fromArray: #( 0 1610612736 2415919104 1610612736 2415919104 2415919104
1610612736)
        offset: 0@0).
Gl9 := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 1610612736 2415919104 2415919104 1879048192 268435456
3758096384)
        offset: 0@0).
GlA := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 1610612736 2415919104 2415919104 4026531840
2415919104 2415919104)
        offset: 0@0) .
GlB := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 3758096384 2415919104 3758096384 2415919104
2415919104 3758096384)
        offset: 0@0).
GlC := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 1610612736 2415919104 2147483648 2147483648
2415919104 1610612736)
        offset: 0@0).
GlD := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 3758096384 1342177280 1342177280 1342177280
1342177280 3758096384)
        offset: 0@0).
GlE := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 3758096384 2147483648 3758096384 2147483648
2147483648 3758096384)
        offset: 0@0).
GlF := (Form
        extent: 5@7
        depth: 1
        fromArray: #( 0 3758096384 2147483648 3758096384 2147483648
2147483648 2147483648)
        offset: 0@0).
 Digits := Array new: 16.
  Digits at: 1 put: Gl0;
         at: 2 put: Gl1;
          at: 3 put: Gl2;
          at: 4 put: Gl3;
          at: 5 put: Gl4;
          at: 6 put: Gl5;
          at: 7 put: Gl6;
          at: 8 put: Gl7;
          at: 9 put: Gl8;
          at: 10 put: Gl9;
          at: 11 put: GlA;
          at: 12 put: GlB;
          at: 13 put: GlC;
          at: 14 put: GlD;
          at: 15 put: GlE;
          at: 16 put: GlF.











! !

!GlyphCreator class methodsFor: 'class initialization' stamp: 'BG
11/25/2004 12:03'!
makeGlyphForCp: codepoint into: aForm

  | d1 d2 d3 d4 |


  d1 := (codepoint bitAnd: 16rF000) >> 12.
  d2 := (codepoint bitAnd: 16rF00) >> 8.
  d3 := (codepoint bitAnd: 16rF0) >> 4.
  d4 := (codepoint bitAnd: 16rF).
  aForm copy: (3 @ 3 extent: 5@7) from: 0@0 in: (Digits at: d1 + 1)
rule: Form over.
  aForm copy: (8 @ 3 extent: 5@7) from: 0@0 in: (Digits at: d2 + 1)
rule: Form over.
  aForm copy: (3 @ 10 extent: 5@7) from: 0@0 in: (Digits at: d3 + 1)
rule: Form over.
  aForm copy: (8 @ 10 extent: 5@7) from: 0@0 in: (Digits at: d4 + 1)
rule: Form over.

  aForm border: (aForm boundingBox insetBy: 2) width: 1 fillColor:
Color black.! !


!Character methodsFor: 'converting' stamp: 'BG 11/25/2004 15:47'!
asUnicode

        | table charset v |
        charset _ EncodedCharSet charsetAt: self leadingChar.
        (charset isKindOf: EncodedCharSet) ifFalse: [^ self charCode].
        table _ charset ucsTable.
        table isNil ifTrue: [^ 16rFFFD].

        v _ table at: self charCode + 1.
        v = -1 ifTrue: [^ 16rFFFD].

        ^ v.
! !

!Character methodsFor: 'converting' stamp: 'BG 11/26/2004 15:20'!
asUnicodeChar

        | table charset v |
        charset _ EncodedCharSet charsetAt: self leadingChar.
        (charset isKindOf: Unicode) ifTrue: [^ self].
        table _ charset ucsTable.
        table isNil ifTrue: [^ Character value: 16rFFFD].

        v _ table at: self charCode + 1.
        v = -1 ifTrue: [^ Character value: 16rFFFD].

        ^ Character leadingChar: charset unicodeLeadingChar code: v.
! !


!StrikeFont methodsFor: 'Mac reader' stamp: 'BG 11/26/2004 08:12'!
initializeLargeToyFontNamed: nm startingAtAscii: startAscii to: endAscii
        ascent: a descent: d maxWidth: m
        "This builds a StrikeFont instance with default settings."

        | lastAscii form width ascii charForm missingForm tempGlyphs |
        name _ nm.
        ascent _ a.
        descent _ d.
        maxWidth _ m.
        pointSize _ a + d.
     form := Form extent: m @(ascent + descent).
     form border: (form boundingBox insetBy: 2) width: 1 fillColor: Color black.
        name _ (name copyWithout: Character space) ,
                                (pointSize < 10
                                        ifTrue: ['0' , pointSize printString]
                                        ifFalse: [pointSize printString]).
        minAscii _ startAscii.
        maxAscii _ endAscii.
        superscript _ ascent - descent // 3.
        subscript _ descent - ascent // 3.
        emphasis _ 0.
        type _ 0.  "ignored for now"

        tempGlyphs _ Form extent: (maxWidth*(maxAscii - minAscii + 1)) @ self height.
        xTable _ (Array new: endAscii + 3) atAllPut: 0.
        xTable at: 1 put: 0.

        "Read character forms and blt into tempGlyphs"
        lastAscii _ -1.
        1 to: endAscii - startAscii + 1 do:
                [:i | GlyphCreator makeGlyphForCp: startAscii + i - 1 into: form.
          charForm := form.
          width _ charForm width.
                ascii _ startAscii-1+i.

                "ascii = 256" false
                        ifTrue: [missingForm _ charForm deepCopy]
                        ifFalse:
                        [minAscii _ minAscii min: ascii.
                        maxAscii _ maxAscii max: ascii.
                        lastAscii+1 to: ascii-1 do: [:as | xTable at: as+2 put: (xTable at: as+1)].
                        tempGlyphs copy: ((xTable at: ascii+1)@0
                                                                        extent: charForm extent)
                                                from: 0@0 in: charForm rule: Form over.
                        xTable at: ascii+2 put: (xTable at: ascii+1) + width.
                        lastAscii _ ascii]].
        lastAscii+1 to: maxAscii+1 do: [:as | xTable at: as+2 put: (xTable at: as+1)].
        missingForm == nil ifFalse:
                [tempGlyphs copy: missingForm boundingBox from: missingForm
                                to: (xTable at: maxAscii+2)@0 rule: Form over.
                xTable at: maxAscii+3 put: (xTable at: maxAscii+2) + missingForm width].
        glyphs _ Form extent: (xTable at: maxAscii+3) @ self height.
        glyphs copy: glyphs boundingBox from: 0@0 in: tempGlyphs rule: Form over.
        xTable _ xTable copyFrom: 1 to: maxAscii+3.
! !

!StrikeFont methodsFor: 'Mac reader' stamp: 'BG 11/26/2004 08:12'!
initializeToyFontNamed: nm startingAtAscii: startAscii to: endAscii
        ascent: a descent: d maxWidth: m
        "This builds a StrikeFont instance with default settings."

        | lastAscii form width ascii charForm missingForm tempGlyphs |
        name _ nm.
        ascent _ a.
        descent _ d.
        maxWidth _ m.
        pointSize _ a + d.
     form := Form extent: m @(ascent + descent).
     form border: (form boundingBox insetBy: 2) width: 1 fillColor: Color black.
        name _ (name copyWithout: Character space) ,
                                (pointSize < 10
                                        ifTrue: ['0' , pointSize printString]
                                        ifFalse: [pointSize printString]).
        minAscii _ 258.
        maxAscii _ 0.
        superscript _ ascent - descent // 3.
        subscript _ descent - ascent // 3.
        emphasis _ 0.
        type _ 0.  "ignored for now"

        tempGlyphs _ Form extent: (maxWidth*257) @ self height.
        xTable _ (Array new: 258) atAllPut: 0.
        xTable at: 1 put: 0.

        "Read character forms and blt into tempGlyphs"
        lastAscii _ -1.
        1 to: endAscii - startAscii + 1 do:
                [:i | GlyphCreator makeGlyphForCp: startAscii + i - 1 into: form.
          charForm _ form.

          width _ charForm width.
                ascii _ startAscii-1+i.

                ascii = 256
                        ifTrue: [missingForm _ charForm deepCopy]
                        ifFalse:
                        [minAscii _ minAscii min: ascii.
                        maxAscii _ maxAscii max: ascii.
                        lastAscii+1 to: ascii-1 do: [:as | xTable at: as+2 put: (xTable at: as+1)].
                        tempGlyphs copy: ((xTable at: ascii+1)@0
                                                                        extent: charForm extent)
                                                from: 0@0 in: charForm rule: Form over.
                        xTable at: ascii+2 put: (xTable at: ascii+1) + width.
                        lastAscii _ ascii]].
        lastAscii+1 to: maxAscii+1 do: [:as | xTable at: as+2 put: (xTable at: as+1)].
        missingForm == nil ifFalse:
                [tempGlyphs copy: missingForm boundingBox from: missingForm
                                to: (xTable at: maxAscii+2)@0 rule: Form over.
                xTable at: maxAscii+3 put: (xTable at: maxAscii+2) + missingForm width].
        glyphs _ Form extent: (xTable at: maxAscii+3) @ self height.
        glyphs copy: glyphs boundingBox from: 0@0 in: tempGlyphs rule: Form over.
        xTable _ xTable copyFrom: 1 to: maxAscii+3.
! !

!StrikeFont methodsFor: 'private' stamp: 'BG 11/26/2004 16:18'!
createCharacterToGlyphMap
        "Private. Create the character to glyph mapping for a font that
didn't have any before. This is basically equivalent to what the
former setStopCondition did, only based on indexes."
        | map |
        map _ Array new: maxAscii + 1.
        0 to: minAscii - 1 do:[:i| map at: i + 1 put: maxAscii + 1].
        minAscii to: maxAscii do:[:i| map at: i + 1 put: i].
        maxAscii + 1 to: 255 do:[:i| map at: i + 1 put: maxAscii + 1].
        ^map! !

GlyphCreator initialize!

!GlyphCreator class reorganize!
('class initialization' initialize makeGlyphForCp:into:)
!


On 1/19/17, H. Hirzel <[hidden email]> wrote:

> On 1/19/17, Tobias Pape <[hidden email]> wrote:
>>
>> On 19.01.2017, at 07:57, H. Hirzel <[hidden email]> wrote:
>>
>>> Reactivating an old thread ...
>>>
>>> Taking the test above just gives a question mark for the fallback font
>>> case
>>>
>>>  | text font bb destPoint |
>>>        text := (Character value: 257) asString asText.
>>>        font := TextStyle default fontOfSize: 21.
>>>        text addAttribute: (TextFontReference toFont: font).
>>>        bb := (Form extent: 100 @ 30) getCanvas privatePort.
>>>        bb combinationRule: Form paint.
>>>
>>>        font installOn: bb foregroundColor: Color black
>>> backgroundColor: Color white.
>>>        destPoint := font displayString: text asString on: bb from: 1
>>> to: 1 at: 0@0 kern: 1.
>>>
>>>        bb destForm asMorph openInHand.
>>>
>>>
>>> Is there another fallback font readily available which gives for small
>>> hex numbers for the missing characters?
>>
>> No, not yet…
>> Also, fallback fonts do not really work like that, they only have exactly
>> one glyph that is used when the
>> falbackee (i mean the font in need of the fallback) says it does not have
>> the glyph requested.
>>
>> ----------
>> fallbackFont
>> "Answers the fallbackFont for the receiver. The fallback font must be
>> some
>> derivative of the receiver since it will not be asked to install itself
>> properly on the target BitBlt so rendering a completely different font
>> here
>> is simply not possible. The default implementation uses a synthetic font
>> that maps all characters to question marks."
>> ^ fallbackFont
>> ifNil: [fallbackFont := FixedFaceFont new errorFont baseFont: self]
>> ----------
>>
>> But maybe we should change that.
>
> Yes, I was not aware of this limited concept of 'fallback' font.
>
> Why not create a glyph with 4 tiny hex digits on the fly, when requested?
>
> A report on http://www.bgaertner.gmxhome.de/Sqm17n.htm gives details
> about such a font
>
> http://www.bgaertner.gmxhome.de/Squeak38ExperienceRep.zip
>
> "Toy font"
>
>
>> The better alternative is to have actual good glyph coverage ;)
>
> Yes. A bitmap font with better glyph coverage is needed in  the image.
> Or on SqueakMap.
>
>
>> Best regards
>> -Tobias
>>
>>>
>>> --Hannes
>>>
>>> On Fri, 5 Jun 2015 20:20:36.139 0000, [hidden email]
>>> <[hidden email]> wrote:
>>>> Chris Muller uploaded a new version of MultilingualTests to project
>>>> Squeak
>>>> 4.6:
>>>> http://source.squeak.org/squeak46/MultilingualTests-fbs.18.mcz
>>>>
>>>> ==================== Summary ====================
>>>>
>>>> Name: MultilingualTests-fbs.18
>>>> Author: fbs
>>>> Time: 6 November 2013, 6:35:02.811 pm
>>>> UUID: 07e26018-8455-3349-9b44-9ecb4aaeefb2
>>>> Ancestors: MultilingualTests-nice.17
>>>>
>>>> More #shouldnt:raise: Error fixes.
>>>>
>>>> ==================== Snapshot ====================
>>>>
>>>> SystemOrganization addCategory: #'MultilingualTests-TextConversion'!
>>>> SystemOrganization addCategory: #'MultilingualTests-Display'!
>>>>
>>>> TestCase subclass: #FontTest
>>>> instanceVariableNames: ''
>>>> classVariableNames: ''
>>>> poolDictionaries: ''
>>>> category: 'MultilingualTests-Display'!
>>>>
>>>> !FontTest commentStamp: 'tak 3/11/2005 14:31' prior: 0!
>>>> I am mainly a test for fallback font.
>>>> FontTest buildSuite run!
>>>>
>>>> ----- Method: FontTest>>testDisplay (in category 'testing') -----
>>>> testDisplay
>>>> "self debug: #testDisplay"
>>>> | text font bb destPoint width |
>>>> text := 'test' asText.
>>>> font := TextStyle default fontOfSize: 21.
>>>> text addAttribute: (TextFontReference toFont: font).
>>>> bb := (Form extent: 100 @ 30) getCanvas privatePort.
>>>> bb combinationRule: Form paint.
>>>>
>>>> font installOn: bb foregroundColor: Color black backgroundColor: Color
>>>> white.
>>>> destPoint := font displayString: text asString on: bb from: 1 to: 4
>>>> at:
>>>> 0@0
>>>> kern: 1.
>>>>
>>>> width := text inject: 0 into: [:max :char | max + (font widthOf:
>>>> char)].
>>>> self assert: destPoint x = (width + 4).
>>>> "bb destForm asMorph openInHand."
>>>> !
>>>>
>>>> ----- Method: FontTest>>testFallback (in category 'testing') -----
>>>> testFallback
>>>> "self debug: #testFallback"
>>>> | text font bb destPoint |
>>>> text := (Character value: 257) asString asText.
>>>> font := TextStyle default fontOfSize: 21.
>>>> text addAttribute: (TextFontReference toFont: font).
>>>> bb := (Form extent: 100 @ 30) getCanvas privatePort.
>>>> bb combinationRule: Form paint.
>>>>
>>>> font installOn: bb foregroundColor: Color black backgroundColor: Color
>>>> white.
>>>> destPoint := font displayString: text asString on: bb from: 1 to: 1
>>>> at:
>>>> 0@0
>>>> kern: 1.
>>>>
>>>> "bb destForm asMorph openInHand."
>>>> self assert: destPoint x = ((font widthOf: $?) + 1).
>>>> !
>>>>
>>>> ----- Method: FontTest>>testMultistringFallbackFont (in category
>>>> 'testing')
>>>> -----
>>>> testMultistringFallbackFont
>>>> "self debug: #testMultistringFallbackFont"
>>>> | text p style height width |
>>>> [(TextStyle default fontArray at: JapaneseEnvironment leadingChar)
>>>> ifNil: [^ self]]
>>>> ifError: [:err :rcvr | ^ self].
>>>> text := ((#(20983874 20983876 20983878 )
>>>> collect: [:e | e asCharacter])
>>>> as: String) asText.
>>>> p := NewParagraph new.
>>>> style := TextStyle new leading: 0; newFontArray: {Preferences
>>>> standardFlapFont}.
>>>> p
>>>> compose: text
>>>> style: style
>>>> from: 1
>>>> in: (0 @ 0 corner: 100 @ 100).
>>>> "See CompositionScanner>>setActualFont: &
>>>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>>>> height := style defaultFont height + style leading.
>>>> width := text
>>>> inject: 0
>>>> into: [:tally :next | tally
>>>> + (style defaultFont widthOf: next)].
>>>> p adjustRightX.
>>>> self assert: p extent = (width @ height).
>>>> "Display getCanvas
>>>> paragraph: p
>>>> bounds: (10 @ 10 extent: 100 @ 100)
>>>> color: Color black"!
>>>>
>>>> ----- Method: FontTest>>testMultistringFont (in category 'testing')
>>>> -----
>>>> testMultistringFont
>>>> "self debug: #testMultistringFont"
>>>> | text p style height width |
>>>> [(TextStyle default fontArray at: JapaneseEnvironment leadingChar)
>>>> ifNil: [^ self]]
>>>> ifError: [:err :rcvr | ^ self].
>>>> text := ((#(20983874 20983876 20983878 )
>>>> collect: [:e | e asCharacter])
>>>> as: String) asText.
>>>> p := NewParagraph new.
>>>> style := TextStyle default.
>>>> p
>>>> compose: text
>>>> style: style
>>>> from: 1
>>>> in: (0 @ 0 corner: 100 @ 100).
>>>> "See CompositionScanner>>setActualFont: &
>>>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>>>> height := style defaultFont height + style leading.
>>>> width := text
>>>> inject: 0
>>>> into: [:tally :next | tally
>>>> + (style defaultFont widthOf: next)].
>>>> p adjustRightX.
>>>> self assert: p extent = (width @ height).
>>>> "Display getCanvas
>>>> paragraph: p
>>>> bounds: (10 @ 10 extent: 100 @ 100)
>>>> color: Color black"!
>>>>
>>>> ----- Method: FontTest>>testParagraph (in category 'testing') -----
>>>> testParagraph
>>>> "self debug: #testParagraph"
>>>> | text p style height width |
>>>> text := 'test' asText.
>>>> p := NewParagraph new.
>>>> style := TextStyle default.
>>>> p
>>>> compose: text
>>>> style: style
>>>> from: 1
>>>> in: (0 @ 0 corner: 100 @ 100).
>>>> "See CompositionScanner>>setActualFont: &
>>>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>>>> height := style defaultFont height + style leading.
>>>> width := text
>>>> inject: 0
>>>> into: [:tally :next | tally
>>>> + (style defaultFont widthOf: next)].
>>>> p adjustRightX.
>>>> self assert: p extent = (width @ height)!
>>>>
>>>> ----- Method: FontTest>>testParagraphFallback (in category 'testing')
>>>> -----
>>>> testParagraphFallback
>>>> "self debug: #testParagraphFallback"
>>>> | text p style height width e expect |
>>>> e := (Character value: 257) asString.
>>>> text := ('test' , e , e , e , e , 'test') asText.
>>>> expect := 'test????test'.
>>>> p := NewParagraph new.
>>>> style := TextStyle default.
>>>> p
>>>> compose: text
>>>> style: style
>>>> from: 1
>>>> in: (0 @ 0 corner: 100 @ 100).
>>>> "See CompositionScanner>>setActualFont: &
>>>> CompositionScanner>>composeFrom:inRectangle:firstLine:leftSide:rightSide:"
>>>> height := style defaultFont height + style leading.
>>>> width := expect
>>>> inject: 0
>>>> into: [:tally :next | tally
>>>> + (style defaultFont widthOf: next)].
>>>> p adjustRightX.
>>>> self assert: p extent = (width @ height).
>>>> "Display getCanvas
>>>> paragraph: p
>>>> bounds: (10 @ 10 extent: 100 @ 100)
>>>> color: Color black"!
>>>>
>>>> ----- Method: FontTest>>testResetAfterEmphasized (in category
>>>> 'testing')
>>>> -----
>>>> testResetAfterEmphasized
>>>> "self debug: #testResetAfterEmphasized"
>>>> | normal derivative |
>>>> normal := TextStyle defaultFont.
>>>> derivative := normal emphasized: 3.
>>>> self assert: (normal derivativeFonts at: 3) == derivative.
>>>> normal reset.
>>>> self assert: (normal derivativeFonts select:[:any| any isSynthetic])
>>>> isEmpty
>>>> !
>>>>
>>>> TestCase subclass: #MultiByteFileStreamTest
>>>> instanceVariableNames: 'fileName'
>>>> classVariableNames: ''
>>>> poolDictionaries: ''
>>>> category: 'MultilingualTests-TextConversion'!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>tearDown (in category 'running')
>>>> -----
>>>> tearDown
>>>>
>>>> fileName ifNotNil: [
>>>> FileDirectory default deleteFileNamed: fileName ]!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testAsciiBackChunk (in category
>>>> 'testing') -----
>>>> testAsciiBackChunk
>>>>
>>>> fileName := 'foobackchunk.txt'.
>>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>>> file
>>>> lineEndConvention: #cr;
>>>> converter: UTF8TextConverter new;
>>>> cr; nextChunkPut: 'test1' printString;
>>>> cr; nextChunkPut: 'test2' printString.
>>>> self
>>>> assert: file backChunk = (String cr , 'test2' printString);
>>>> assert: file backChunk = (String cr , 'test1' printString) ]!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testBinaryUpTo (in category
>>>> 'testing') -----
>>>> testBinaryUpTo
>>>> "This is a non regression test for bug
>>>> http://bugs.squeak.org/view.php?id=6933"
>>>>
>>>> fileName := 'foobug6933'.
>>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>>> file
>>>> binary;
>>>> nextPutAll: #[ 1 2 3 4 ] ].
>>>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>>>> file binary.
>>>> self assert: (file upTo: 3) = #[ 1 2 ] ]!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testByteTextConverter (in
>>>> category
>>>> 'testing') -----
>>>> testByteTextConverter
>>>> | strings converterClasses |
>>>> strings := {
>>>> String newFrom: ((0 to: 255) collect: [:e | e asCharacter]).
>>>> }.
>>>>
>>>> converterClasses := ByteTextConverter allSubclasses.
>>>> converterClasses do: [:converterClass |
>>>> strings do: [:string | | converter stream encoded decoded encoded2 |
>>>> converter := converterClass new.
>>>> stream := string readStream.
>>>> encoded := string select: [:e | (converter nextFromStream: stream)
>>>> notNil].
>>>> stream := encoded readStream.
>>>> decoded := encoded collect: [:e | converter nextFromStream: stream].
>>>> self assert: stream atEnd.
>>>> stream := String new writeStream.
>>>> converter nextPutAll: decoded toStream: stream.
>>>> encoded2 := stream contents.
>>>> self assert: (encoded2 collect: [:e | e charCode] as: Array) =
>>>> (encoded
>>>> collect: [:e | e charCode] as: Array).
>>>> stream := String new writeStream.
>>>> decoded do: [:e | converter nextPut: e toStream: stream].
>>>> encoded2 := stream contents.
>>>> self assert: (encoded2 collect: [:e | e charCode] as: Array) =
>>>> (encoded
>>>> collect: [:e | e charCode] as: Array)]]!
>>>>
>>>> ----- Method:
>>>> MultiByteFileStreamTest>>testLineEndConvention:withConverter:ifFail:
>>>> (in
>>>> category 'helpers') -----
>>>> testLineEndConvention: lineEndConvention withConverter:
>>>> textConverterClass
>>>> ifFail: failBlock
>>>>
>>>> | expectedResult result |
>>>> [
>>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>>> file
>>>> converter: textConverterClass new;
>>>> lineEndConvention: lineEndConvention;
>>>> cr;
>>>> nextPut: Character cr;
>>>> nextPutAll: String cr;
>>>> nextPutAll: String cr asWideString ].
>>>> result := StandardFileStream oldFileNamed: fileName do: [ :file |
>>>> file contents ].
>>>> expectedResult := String streamContents: [ :stream |
>>>> 4 timesRepeat: [ stream perform: lineEndConvention ] ].
>>>> result = expectedResult ifFalse: [
>>>> failBlock value: expectedResult asByteArray value: result
>>>> asByteArray
>>>> ]
>>>> ]
>>>> on: Error
>>>> do: [ :err | failBlock value: err messageText value: err messageText
>>>> ]!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testLineEndConversion (in
>>>> category
>>>> 'testing') -----
>>>> testLineEndConversion
>>>>
>>>> | failures |
>>>> fileName := 'foolinendconversion.txt'.
>>>> failures := OrderedCollection new.
>>>> TextConverter allSubclassesDo: [ :textConverterClass |
>>>> textConverterClass encodingNames ifNotEmpty: [
>>>> #(cr lf crlf) do: [ :lineEndConvention |
>>>> self
>>>> testLineEndConvention: lineEndConvention
>>>> withConverter: textConverterClass
>>>> ifFail: [ :expectedResult :result |
>>>> failures add: {
>>>> textConverterClass.
>>>> lineEndConvention.
>>>> expectedResult.
>>>> result } ] ] ] ].
>>>> self assert: failures isEmpty!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testLineEnding (in category
>>>> 'testing') -----
>>>> testLineEnding
>>>>
>>>> fileName := 'foolinend.txt'.
>>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>>> file
>>>> wantsLineEndConversion: false;
>>>> nextPutAll: 'line 1'; cr;
>>>> nextPutAll: 'line 2'; crlf;
>>>> nextPutAll: 'line 3'; lf;
>>>> nextPutAll: 'line 4' ].
>>>> {
>>>> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>>> String
>>>> cr
>>>> , 'line 4'}.
>>>> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>>> String
>>>> cr
>>>> , 'line 4'}.
>>>> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>>> String
>>>> cr , 'line 4'}.
>>>> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' ,
>>>> String
>>>> lf , 'line 4'}
>>>> } do: [:lineEndingResult |
>>>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>>>> file lineEndConvention: lineEndingResult first.
>>>> self assert: file upToEnd = lineEndingResult last ] ]!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testLineEndingChunk (in category
>>>> 'testing') -----
>>>> testLineEndingChunk
>>>>
>>>> fileName := 'foolinend.txt'.
>>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>>> file
>>>> wantsLineEndConversion: false;
>>>> nextPutAll: 'line 1'; cr;
>>>> nextPutAll: 'line 2'; crlf;
>>>> nextPutAll: 'line 3'; lf;
>>>> nextPutAll: 'line 4'; nextPut: $!! ].
>>>> {
>>>> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>>> String
>>>> cr
>>>> , 'line 4'}.
>>>> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>>> String
>>>> cr
>>>> , 'line 4'}.
>>>> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>>> String
>>>> cr , 'line 4'}.
>>>> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' ,
>>>> String
>>>> lf , 'line 4'}
>>>> } do: [:lineEndingResult |
>>>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>>>> file lineEndConvention: lineEndingResult first.
>>>> self assert: lineEndingResult last equals: file nextChunk ] ]!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testLineEndingWithWideStrings
>>>> (in
>>>> category 'testing') -----
>>>> testLineEndingWithWideStrings
>>>>
>>>> | cr lf crlf |
>>>> fileName := 'foolinend.txt'.
>>>> cr := String cr asWideString.
>>>> lf := String lf asWideString.
>>>> crlf := String crlf asWideString.
>>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>>> file
>>>> wantsLineEndConversion: false;
>>>> nextPutAll: 'line 1'; nextPutAll: cr;
>>>> nextPutAll: 'line 2'; nextPutAll: crlf;
>>>> nextPutAll: 'line 3'; nextPutAll: lf;
>>>> nextPutAll: 'line 4' ].
>>>> {
>>>> {#cr.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>>> String
>>>> cr
>>>> , 'line 4'}.
>>>> {#lf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>>> String
>>>> cr
>>>> , 'line 4'}.
>>>> {#crlf.  'line 1' , String cr , 'line 2' , String cr , 'line 3' ,
>>>> String
>>>> cr , 'line 4'}.
>>>> {nil.  'line 1' , String cr , 'line 2' , String crlf , 'line 3' ,
>>>> String
>>>> lf , 'line 4'}
>>>> } do: [ :lineEndingResult |
>>>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>>>> file lineEndConvention: lineEndingResult first.
>>>> self assert: file upToEnd = lineEndingResult last ] ]!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testMultiByteTextConverter (in
>>>> category 'testing') -----
>>>> testMultiByteTextConverter
>>>> | strings converterClasses |
>>>> strings := {
>>>> String newFrom: ((0 to: 255) collect: [:e | Unicode value: e]).
>>>> String newFrom: ((0 to: 1023) collect: [:e | Unicode value: e]).
>>>> }.
>>>>
>>>> converterClasses := {
>>>> UTF8TextConverter . UTF16TextConverter .
>>>> "CompoundTextConverter ."
>>>> "EUCJPTextConverter . CNGBTextConverter . ShiftJISTextConverter .
>>>> EUCKRTextConverter"}.
>>>> converterClasses do: [:converterClass |
>>>> strings do: [:string |
>>>> | converter stream |
>>>> converter := converterClass new.
>>>> stream := String new writeStream.
>>>> converter nextPutAll: string toStream: stream.
>>>> stream := stream contents readStream.
>>>> string do: [:e | | decoded |
>>>> decoded := converter nextFromStream: stream.
>>>> self assert: e charCode = decoded charCode].
>>>> self assert: stream atEnd.
>>>>
>>>> stream := String new writeStream.
>>>> string do: [:e | converter nextPut: e toStream: stream].
>>>> stream := stream contents readStream.
>>>> string do: [:e | | decoded |
>>>> decoded := converter nextFromStream: stream.
>>>> self assert: e charCode = decoded charCode].
>>>> self assert: stream atEnd]]!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testNextLine (in category
>>>> 'testing')
>>>> -----
>>>> testNextLine
>>>>
>>>> fileName := 'foonextline.txt'.
>>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>>> file
>>>> wantsLineEndConversion: false;
>>>> nextPutAll: 'line 1'; cr;
>>>> nextPutAll: 'line 2'; crlf;
>>>> nextPutAll: 'line 3'; lf;
>>>> nextPutAll: 'line 4' ].
>>>> #(cr lf crlf nil) do: [:lineEnding |
>>>> MultiByteFileStream oldFileNamed: fileName do: [ :file |
>>>> file lineEndConvention: lineEnding.
>>>> self
>>>> assert: file nextLine = 'line 1';
>>>> assert: file nextLine = 'line 2';
>>>> assert: file nextLine = 'line 3';
>>>> assert: file nextLine = 'line 4';
>>>> assert: file nextLine = nil ] ]!
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testNextPutAllStartingAt (in
>>>> category
>>>> 'testing') -----
>>>> testNextPutAllStartingAt
>>>>
>>>> | result |
>>>> fileName := 'foonextputallstartingat.txt'.
>>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>>> { 'abcde' asWideString. 'abcde' } do: [ :string |
>>>> file
>>>> next: 1 putAll: string startingAt: 5;
>>>> next: 3 putAll: string startingAt: 2;
>>>> next: 1 putAll: string startingAt: 1 ] ].
>>>> result := StandardFileStream readOnlyFileNamed: fileName do: [ :file |
>>>> file binary; contents ].
>>>> self assert: #[101 98 99 100 97 101 98 99 100 97] equals: result
>>>> !
>>>>
>>>> ----- Method: MultiByteFileStreamTest>>testNonAsciiBackChunk (in
>>>> category
>>>> 'testing') -----
>>>> testNonAsciiBackChunk
>>>> "Note: this is an expected failure: MultiByteFileStream is not
>>>> equipped
>>>> to
>>>> read back non ASCII String... (no comment)
>>>> As a consequence, never use non ASCII in method category nor in your
>>>> initials. That would make a few tools blind..."
>>>>
>>>> fileName :=  'foobackchunk.txt'.
>>>> MultiByteFileStream forceNewFileNamed: fileName do: [ :file |
>>>> file
>>>> lineEndConvention: #cr;
>>>> converter: UTF8TextConverter new;
>>>> cr; nextChunkPut: 'testé' printString;
>>>> cr; nextChunkPut: 'test' printString.
>>>> self assert: file backChunk = (String cr , 'test' printString).
>>>> self assert: file backChunk = (String cr , 'testé' printString) ]!
>>>>
>>>> TestCase subclass: #UTF16TextConverterTest
>>>> instanceVariableNames: ''
>>>> classVariableNames: ''
>>>> poolDictionaries: ''
>>>> category: 'MultilingualTests-TextConversion'!
>>>>
>>>> ----- Method: UTF16TextConverterTest>>testByteOrders (in category
>>>> 'testing')
>>>> -----
>>>> testByteOrders
>>>> |converter originalText bytes decodedText |
>>>> originalText := 'test'.
>>>> converter := UTF16TextConverter new.
>>>>
>>>> "Default (ie useLittleEndian instvar nil)"
>>>> bytes := (originalText convertToWithConverter: converter).
>>>> decodedText := bytes convertFromWithConverter: converter.
>>>>
>>>> self assert: originalText equals: decodedText.
>>>>
>>>> "Little-endian"
>>>> converter useLittleEndian: true.
>>>>
>>>> bytes := (originalText convertToWithConverter: converter).
>>>> decodedText := bytes convertFromWithConverter: converter.
>>>>
>>>> self assert: originalText equals: decodedText.
>>>>
>>>> "Big-endian"
>>>> converter useLittleEndian: false.
>>>>
>>>> bytes := (originalText convertToWithConverter: converter).
>>>> decodedText := bytes convertFromWithConverter: converter.
>>>>
>>>> self assert: originalText equals: decodedText.
>>>>
>>>> !
>>>>
>>>> ClassTestCase subclass: #UTF8TextConverterTest
>>>> instanceVariableNames: ''
>>>> classVariableNames: ''
>>>> poolDictionaries: ''
>>>> category: 'MultilingualTests-TextConversion'!
>>>>
>>>> ----- Method: UTF8TextConverterTest>>testLazyConversion (in category
>>>> 'tests') -----
>>>> testLazyConversion
>>>> "Ensure the lazy conversions do what they should"
>>>>
>>>> | strict result |
>>>> strict := UTF8TextConverter strictUtf8Conversions.
>>>> [UTF8TextConverter strictUtf8Conversions: false.
>>>> result := 'Grüß Gott' utf8ToSqueak.
>>>> ] ensure:[UTF8TextConverter strictUtf8Conversions: strict].
>>>>
>>>> self assert: result = 'Grüß Gott'.
>>>> !
>>>>
>>>> ----- Method: UTF8TextConverterTest>>testSqueakToUtf8 (in category
>>>> 'tests')
>>>> -----
>>>> testSqueakToUtf8
>>>> "Ensure proper encoding"
>>>>
>>>> self assert: '' squeakToUtf8 equals: ''.
>>>> self assert: 'Hello World' squeakToUtf8 equals: 'Hello World'.
>>>> self assert: 'Grüß Gott' squeakToUtf8 asByteArray
>>>> equals: #[71 114 195 188 195 159 32 71 111 116 116]!
>>>>
>>>> ----- Method: UTF8TextConverterTest>>testStrictConversion (in category
>>>> 'tests') -----
>>>> testStrictConversion
>>>> "Ensure the strict conversions do what they should"
>>>>
>>>> | strict |
>>>> strict := UTF8TextConverter strictUtf8Conversions.
>>>> [UTF8TextConverter strictUtf8Conversions: true.
>>>> self should:[ 'Grüß Gott' utf8ToSqueak ] raise: Error.
>>>> ] ensure:[UTF8TextConverter strictUtf8Conversions: strict].!
>>>>
>>>> ----- Method: UTF8TextConverterTest>>testUtf8ToSqueak (in category
>>>> 'tests')
>>>> -----
>>>> testUtf8ToSqueak
>>>> "Ensure proper encoding"
>>>>
>>>> self assert: '' utf8ToSqueak equals: ''.
>>>> self assert: 'Hello World' utf8ToSqueak equals: 'Hello World'.
>>>> self assert: #[71 114 195 188 195 159 32 71 111 116 116] asString
>>>> utf8ToSqueak
>>>> equals: 'Grüß Gott'
>>>>
>>>> !
>>>>
>>>>
>>>>
>>>
>>
>>
>>
>