Crashes when responding in conversational AI.

[stc1988]

Build environment: macOS
Moddable SDK version: 8.1.0
Target device: desktop simulator, M5stack CoreS3

Steps to Reproduce

1. Build and install the conversationalAI app.
2. The application crashes when responding to a conversation.

Other information

This is a crash report on MacOS. 　The ESP32 also restarts at the same timing.

Triggered by Thread: 0, Dispatch Queue: com.apple.main-thread

Exception Type:    EXC_BAD_ACCESS (SIGSEGV)
Exception Subtype: KERN_INVALID_ADDRESS at 0x0000000000000020
Exception Codes:   0x0000000000000001, 0x0000000000000020

Termination Reason:  Namespace SIGNAL, Code 11, Segmentation fault: 11
Terminating Process: exc handler [61846]


VM Region Info: 0x20 is not in any region.  Bytes before following region: 4342923232
      REGION TYPE                    START - END         [ VSIZE] PRT/MAX SHRMOD  REGION DETAIL
      UNUSED SPACE AT START
--->  
      __TEXT                      102dbc000-102ee8000    [ 1200K] r-x/r-x SM=COW  /Users/USER/*/mcsim.app/Contents/MacOS/main

Thread 0 Crashed::  Dispatch queue: com.apple.main-thread
0   mc.so                         	       0x10dbc8ae4 PiuViewDrawStringAux + 536 (piuView.c:506)
1   mc.so                         	       0x10dbc7f2c PiuViewUpdateStep + 536 (piuView.c:1144)
2   mc.so                         	       0x10dbc7c88 PiuViewEnd + 584 (piuView.c:661)
3   mc.so                         	       0x10dbc6934 PiuViewUpdate + 152 (piuView.c:1052)
4   mc.so                         	       0x10dbc6878 PiuView_onIdle + 204 (piuView.c:1567)
5   mc.so                         	       0x10db7df20 fxRunID + 3472 (xsRun.c:953)
6   mc.so                         	       0x10db21b24 fxRunCount + 36 (xsAPI.c:1229)
7   mc.so                         	       0x10dbb4fa4 fxScreenIdle + 1492 (screen.c:226)
8   Foundation                    	       0x18ecdbda4 __NSFireTimer + 104
9   CoreFoundation                	       0x18d471d50 __CFRUNLOOP_IS_CALLING_OUT_TO_A_TIMER_CALLBACK_FUNCTION__ + 32
10  CoreFoundation                	       0x18d471a48 __CFRunLoopDoTimer + 980
11  CoreFoundation                	       0x18d4715c0 __CFRunLoopDoTimers + 280
12  CoreFoundation                	       0x18d4578c8 __CFRunLoopRun + 1816
13  CoreFoundation                	       0x18d529be0 _CFRunLoopRunSpecificWithOptions + 532
14  HIToolbox                     	       0x19a22c560 RunCurrentEventLoopInMode + 320
15  HIToolbox                     	       0x19a22f8bc ReceiveNextEventCommon + 488
16  HIToolbox                     	       0x19a3b913c _BlockUntilNextEventMatchingListInMode + 48
17  AppKit                        	       0x191f2f1a4 _DPSBlockUntilNextEventMatchingListInMode + 228
18  AppKit                        	       0x191883084 _DPSNextEvent + 576
19  AppKit                        	       0x19241869c -[NSApplication(NSEventRouting) _nextEventMatchingEventMask:untilDate:inMode:dequeue:] + 688
20  AppKit                        	       0x1924183a8 -[NSApplication(NSEventRouting) nextEventMatchingMask:untilDate:inMode:dequeue:] + 72
21  AppKit                        	       0x19187613c -[NSApplication run] + 368
22  main                          	       0x102eb9694 main + 456
23  dyld                          	       0x18cfdfda4 start + 6992

Thread 1:

Thread 2:

Thread 3:

Thread 4:: com.apple.NSEventThread
0   libsystem_kernel.dylib        	       0x18d357c34 mach_msg2_trap + 8
1   libsystem_kernel.dylib        	       0x18d36a574 mach_msg2_internal + 76
2   libsystem_kernel.dylib        	       0x18d3609c0 mach_msg_overwrite + 480
3   libsystem_kernel.dylib        	       0x18d357fc0 mach_msg + 24
4   CoreFoundation                	       0x18d458d68 __CFRunLoopServiceMachPort + 160
5   CoreFoundation                	       0x18d457654 __CFRunLoopRun + 1188
6   CoreFoundation                	       0x18d529be0 _CFRunLoopRunSpecificWithOptions + 532
7   AppKit                        	       0x1919a4c64 _NSEventThread + 184
8   libsystem_pthread.dylib       	       0x18d39bc58 _pthread_start + 136
9   libsystem_pthread.dylib       	       0x18d396c1c thread_start + 8

Thread 5:: com.apple.CFSocket.private
0   libsystem_kernel.dylib        	       0x18d362e80 __select + 8
1   CoreFoundation                	       0x18d47e200 __CFSocketManager + 708
2   libsystem_pthread.dylib       	       0x18d39bc58 _pthread_start + 136
3   libsystem_pthread.dylib       	       0x18d396c1c thread_start + 8

Thread 6:

Thread 7:
0   libsystem_kernel.dylib        	       0x18d357c34 mach_msg2_trap + 8
1   libsystem_kernel.dylib        	       0x18d36a574 mach_msg2_internal + 76
2   libsystem_kernel.dylib        	       0x18d3609c0 mach_msg_overwrite + 480
3   libsystem_kernel.dylib        	       0x18d357fc0 mach_msg + 24
4   CoreFoundation                	       0x18d458d68 __CFRunLoopServiceMachPort + 160
5   CoreFoundation                	       0x18d457654 __CFRunLoopRun + 1188
6   CoreFoundation                	       0x18d529be0 _CFRunLoopRunSpecificWithOptions + 532
7   CoreFoundation                	       0x18d4cd524 CFRunLoopRun + 64
8   mc.so                         	       0x10dbca764 fxWorkerLoop + 36 (pcWorker.c:99)
9   libsystem_pthread.dylib       	       0x18d39bc58 _pthread_start + 136
10  libsystem_pthread.dylib       	       0x18d396c1c thread_start + 8

Thread 8:: caulk.messenger.shared:17
0   libsystem_kernel.dylib        	       0x18d357bb0 semaphore_wait_trap + 8
1   caulk                         	       0x199cd4e00 caulk::semaphore::timed_wait(double) + 224
2   caulk                         	       0x199cd4cac caulk::concurrent::details::worker_thread::run() + 32
3   caulk                         	       0x199cd494c void* caulk::thread_proxy<std::__1::tuple<caulk::thread::attributes, void (caulk::concurrent::details::worker_thread::*)(), std::__1::tuple<caulk::concurrent::details::worker_thread*>>>(void*) + 96
4   libsystem_pthread.dylib       	       0x18d39bc58 _pthread_start + 136
5   libsystem_pthread.dylib       	       0x18d396c1c thread_start + 8

Thread 9:: caulk.messenger.shared:high
0   libsystem_kernel.dylib        	       0x18d357bb0 semaphore_wait_trap + 8
1   caulk                         	       0x199cd4e00 caulk::semaphore::timed_wait(double) + 224
2   caulk                         	       0x199cd4cac caulk::concurrent::details::worker_thread::run() + 32
3   caulk                         	       0x199cd494c void* caulk::thread_proxy<std::__1::tuple<caulk::thread::attributes, void (caulk::concurrent::details::worker_thread::*)(), std::__1::tuple<caulk::concurrent::details::worker_thread*>>>(void*) + 96
4   libsystem_pthread.dylib       	       0x18d39bc58 _pthread_start + 136
5   libsystem_pthread.dylib       	       0x18d396c1c thread_start + 8

Thread 10:: caulk::deferred_logger
0   libsystem_kernel.dylib        	       0x18d357bb0 semaphore_wait_trap + 8
1   caulk                         	       0x199cd4e00 caulk::semaphore::timed_wait(double) + 224
2   caulk                         	       0x199cd4cac caulk::concurrent::details::worker_thread::run() + 32
3   caulk                         	       0x199cd494c void* caulk::thread_proxy<std::__1::tuple<caulk::thread::attributes, void (caulk::concurrent::details::worker_thread::*)(), std::__1::tuple<caulk::concurrent::details::worker_thread*>>>(void*) + 96
4   libsystem_pthread.dylib       	       0x18d39bc58 _pthread_start + 136
5   libsystem_pthread.dylib       	       0x18d396c1c thread_start + 8

Thread 11:: AQConverterThread
0   libsystem_kernel.dylib        	       0x18d35b50c __psynch_cvwait + 8
1   libsystem_pthread.dylib       	       0x18d39c128 _pthread_cond_wait + 980
2   libAudioToolboxUtility.dylib  	       0x19f913074 CADeprecated::CAGuard::Wait() + 76
3   AudioToolbox                  	       0x1a10f7524 AQConverterManager::AQConverterThread::ConverterThreadEntry(void*) + 412
4   libAudioToolboxUtility.dylib  	       0x19f8fdd58 CADeprecated::CAPThread::Entry(void*) + 96
5   libsystem_pthread.dylib       	       0x18d39bc58 _pthread_start + 136
6   libsystem_pthread.dylib       	       0x18d396c1c thread_start + 8

Thread 12:: com.apple.audio.IOThread.client
0   libsystem_kernel.dylib        	       0x18d357bbc semaphore_wait_signal_trap + 8
1   caulk                         	       0x199cf2290 caulk::mach::semaphore::wait_signal_or_error(caulk::mach::semaphore&) + 36
2   CoreAudio                     	       0x1906e7a44 HALC_ProxyIOContext::IOWorkLoop() + 4952
3   CoreAudio                     	       0x1906e6050 invocation function for block in HALC_ProxyIOContext::HALC_ProxyIOContext(unsigned int, unsigned int) + 172
4   CoreAudio                     	       0x1908a40b0 HALC_IOThread::Entry(void*) + 88
5   libsystem_pthread.dylib       	       0x18d39bc58 _pthread_start + 136
6   libsystem_pthread.dylib       	       0x18d396c1c thread_start + 8


Thread 0 crashed with ARM Thread State (64-bit):
    x0: 0x0000000000000000   x1: 0x0000000000003082   x2: 0x0000000000000001   x3: 0x00000000000000ff
    x4: 0x00000000000000a5   x5: 0x00000000000000a8   x6: 0x0000000000000000   x7: 0x0000000000000000
    x8: 0x0000000000000000   x9: 0x00000000000000b7  x10: 0x00000000000000b7  x11: 0x000000016d03ffd0
   x12: 0x0000000000000000  x13: 0x0000000000000018  x14: 0x0000000000000134  x15: 0x000000016d03fd80
   x16: 0x000000018d3a50f0  x17: 0x00000001fa822d80  x18: 0x0000000000000000  x19: 0x0000000affaec9c0
   x20: 0x0000000afe6fe580  x21: 0x0000000102ee2a2b  x22: 0x0000000affa032f0  x23: 0x000000018ecdbd3c
   x24: 0x0000000affa032e8  x25: 0x00000000141300c9  x26: 0x00000001fa82fa88  x27: 0x000012c9670ddb3a
   x28: 0x000000018ecda658   fp: 0x000000016d040070   lr: 0x000000010dbc8adc
    sp: 0x000000016d03ffd0   pc: 0x000000010dbc8ae4 cpsr: 0x60001000
   far: 0x0000000000000020  esr: 0x92000006 (Data Abort) byte read Translation fault

Binary Images:
       0x102dbc000 -        0x102ee7fff tech.moddable.mcsim (mcsim 2.0) <d18594a3-a690-3119-b68f-db1bb87b9ff0> /Users/USER/*/mcsim.app/Contents/MacOS/main
       0x10b0e0000 -        0x10b0ebfff libobjc-trampolines.dylib (*) <a4dd56f1-375a-3540-844b-5e397f0b78b3> /usr/lib/libobjc-trampolines.dylib
       0x10e4ac000 -        0x10ecaffff com.apple.AGXMetalG14X (350.38) <7b5e00e6-a646-33a1-99a1-efc11ec044db> /System/Library/Extensions/AGXMetalG14X.bundle/Contents/MacOS/AGXMetalG14X
       0x10db1c000 -        0x10dca3fff mc.so (*) <97abfdf7-bddb-35a0-9085-8629ceeb9faa> /Users/USER/Library/Application Support/tech.moddable.mcsim/mc.so
       0x18ec47000 -        0x18fc291df com.apple.Foundation (6.9) <8e9a5c62-7e95-3047-81e7-735ae1aee5f8> /System/Library/Frameworks/Foundation.framework/Versions/C/Foundation
       0x18d3db000 -        0x18d938c5f com.apple.CoreFoundation (6.9) <04941709-2330-3bf8-9213-6d33964db448> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
       0x19a16f000 -        0x19a46a05f com.apple.HIToolbox (2.1.1) <bcb81496-c81f-3d3e-a617-ccca047989e0> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox.framework/Versions/A/HIToolbox
       0x19184a000 -        0x192f6cabf com.apple.AppKit (6.9) <59e23bd5-d01e-305a-b96f-a5790356049a> /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
       0x18cfc0000 -        0x18d065ec7 dyld (*) <9f682dcf-340c-3bfa-bcdd-dd702f30313e> /usr/lib/dyld
               0x0 - 0xffffffffffffffff ??? (*) <00000000-0000-0000-0000-000000000000> ???
       0x18d3a2000 -        0x18d3aa8f3 libsystem_platform.dylib (*) <d93ec420-f465-3a3a-916d-a04af9b023eb> /usr/lib/system/libsystem_platform.dylib
       0x18d357000 -        0x18d39428f libsystem_kernel.dylib (*) <51565b39-f595-3e96-a217-fef29815057a> /usr/lib/system/libsystem_kernel.dylib
       0x18d395000 -        0x18d3a1b3b libsystem_pthread.dylib (*) <e7a73008-0c09-31e3-9dd9-0c61652f0e85> /usr/lib/system/libsystem_pthread.dylib
       0x199cd3000 -        0x199cfc03f com.apple.audio.caulk (1.0) <2bdd6811-ce34-3098-9833-10d9f74b7ffc> /System/Library/PrivateFrameworks/caulk.framework/Versions/A/caulk
       0x19f8f4000 -        0x19f91920f libAudioToolboxUtility.dylib (*) <c2b4cf76-e4a5-32c0-a5f3-8127bdca92eb> /usr/lib/libAudioToolboxUtility.dylib
       0x1a10d2000 -        0x1a12a6b9f com.apple.audio.toolbox.AudioToolbox (1.14) <0d8b0da8-c582-3cca-b648-5ee242e876d8> /System/Library/Frameworks/AudioToolbox.framework/Versions/A/AudioToolbox
       0x1904e6000 -        0x190c7be9f com.apple.audio.CoreAudio (5.0) <72080a9b-8c5b-3e6d-8de7-0f86c3e698ec> /System/Library/Frameworks/CoreAudio.framework/Versions/A/CoreAudio

[phoddie]

The problem looks like it might be related to the text rendering changes - hardening or missing glyph substitution. That sai,d I've been working with conversational AI extensively the last few days on both macOS and ESP32 and have't seen this once (or I would have investigated !). I might need more detailed instructions for reproducing the error.

[phoddie]

The fix is probably to change piuView.c:506 to if (glyph && glyph->substitute) {. I imagine the problem is a glyph not found and with no substitute – maybe a Japanese character that's unavailable?

Which raises a question – the substitution table is for symbols and common Western language patterns:

	{ 0x00A9, "(C)" },  /* COPYRIGHT SIGN                                   */
	{ 0x00DE, "Th"  },  /* LATIN CAPITAL LETTER THORN                       */
	{ 0x00E6, "ae"  },  /* LATIN SMALL LETTER AE                            */
	{ 0x2014, "--"  },  /* EM DASH                                          */
	{ 0x2121, "TEL" },  /* TELEPHONE SIGN                                   */

I imagine there may be common substitutions for other languages. If so, we could allow the table to be managed by the manifest, so that projects can apply substitutions for the language and domain needs. Are you aware of any Japanese language substitutions that we could consider here?

[stc1988]

Indeed, it seems to work fine in English and crash when the response is in Japanese.

I imagine there may be common substitutions for other languages. If so, we could allow the table to be managed by the manifest, so that projects can apply substitutions for the language and domain needs. Are you aware of any Japanese language substitutions that we could consider here?

In this case, it’s happening with ordinary Japanese characters, not ones that can reasonably be substituted.
Previously, Japanese text was displayed using a symbol like □.

[phoddie]

Indeed, it seems to work fine in English and crash when the response is in Japanese.

Thanks for confirming.

In this case, it’s happening with ordinary Japanese characters...

I understand. I was wondering more broadly if there were any Japanese substitutions that might be appropriate to support.