Full log
88/211 Test #88: interface.ClientApiServiceTest.ListModelsReturnsOpenAIListShape .................................. Passed 0.10 sec
Start 89: interface.ClientApiServiceTest.ChatCompletionsRejectsExplicitReasoningForUnsupportedModel
89/211 Test #89: interface.ClientApiServiceTest.ChatCompletionsRejectsExplicitReasoningForUnsupportedModel ........ Passed 0.10 sec
Start 90: interface.ClientApiServiceTest.ListEnginesReturnsArray
90/211 Test #90: interface.ClientApiServiceTest.ListEnginesReturnsArray ........................................... Passed 0.10 sec
Start 91: interface.ClientApiServiceTest.UnloadMissingModelReturnsNotFound
91/211 Test #91: interface.ClientApiServiceTest.UnloadMissingModelReturnsNotFound ................................. Passed 0.10 sec
Start 92: interface.ClientApiServiceTest.TextOnlyVlmRequestUsesVlmTaskWithChatMLInput
92/211 Test #92: interface.ClientApiServiceTest.TextOnlyVlmRequestUsesVlmTaskWithChatMLInput ...................... Passed 0.11 sec
Start 93: interface.ClientApiServiceTest.ConfigManagerOnlyVlmModelUsesVlmTaskWithChatMLInput
93/211 Test #93: interface.ClientApiServiceTest.ConfigManagerOnlyVlmModelUsesVlmTaskWithChatMLInput ............... Passed 0.11 sec
Start 94: interface.ClientApiServiceTest.NonVlmImageRequestIsRejected
94/211 Test #94: interface.ClientApiServiceTest.NonVlmImageRequestIsRejected ...................................... Passed 0.10 sec
Start 95: interface.ClientApiServiceTest.PreferredEngineMustMatchModelEngine
95/211 Test #95: interface.ClientApiServiceTest.PreferredEngineMustMatchModelEngine ............................... Passed 0.11 sec
Start 96: interface.ClientApiServiceTest.CompletedNonStreamResponseContainsActualUsage
96/211 Test #96: interface.ClientApiServiceTest.CompletedNonStreamResponseContainsActualUsage ..................... Passed 0.12 sec
Start 97: interface.ClientApiServiceTest.StreamUsageIsOnlyReturnedInAnExtraFinalChunkWhenRequested
97/211 Test #97: interface.ClientApiServiceTest.StreamUsageIsOnlyReturnedInAnExtraFinalChunkWhenRequested ......... Passed 0.11 sec
Start 98: interface.MessagesFormatTest.ValidateExtraBodyEnableLoraAcceptsBooleanOrMissingValue
98/211 Test #98: interface.MessagesFormatTest.ValidateExtraBodyEnableLoraAcceptsBooleanOrMissingValue ............. Passed 0.01 sec
Start 99: interface.MessagesFormatTest.ValidateExtraBodyEnableLoraRejectsNonBooleanValue
99/211 Test #99: interface.MessagesFormatTest.ValidateExtraBodyEnableLoraRejectsNonBooleanValue ................... Passed 0.11 sec
Start 100: interface.MessagesFormatTest.ValidateEmptyMessagesArrayRejected
100/211 Test #100: interface.MessagesFormatTest.ValidateEmptyMessagesArrayRejected .................................. Passed 0.01 sec
Start 101: interface.MessagesFormatTest.ValidateMessagesNotArrayRejected
101/211 Test #101: interface.MessagesFormatTest.ValidateMessagesNotArrayRejected .................................... Passed 0.02 sec
Start 102: interface.MessagesFormatTest.ValidateMissingRoleOrContentRejected
102/211 Test #102: interface.MessagesFormatTest.ValidateMissingRoleOrContentRejected ................................ Passed 0.01 sec
Start 103: interface.MessagesFormatTest.ValidateEmptyContentRejected
103/211 Test #103: interface.MessagesFormatTest.ValidateEmptyContentRejected ........................................ Passed 0.01 sec
Start 104: interface.MessagesFormatTest.ValidateEmptyArrayContentRejected
104/211 Test #104: interface.MessagesFormatTest.ValidateEmptyArrayContentRejected ................................... Passed 0.01 sec
Start 105: interface.MessagesFormatTest.ValidateContentMustBeStringOrArray
105/211 Test #105: interface.MessagesFormatTest.ValidateContentMustBeStringOrArray .................................. Passed 0.01 sec
Start 106: interface.MessagesFormatTest.ValidateAssistantFirstRejected
106/211 Test #106: interface.MessagesFormatTest.ValidateAssistantFirstRejected ...................................... Passed 0.01 sec
Start 107: interface.MessagesFormatTest.ValidateRelaxedRoleOrderingAccepted
107/211 Test #107: interface.MessagesFormatTest.ValidateRelaxedRoleOrderingAccepted ................................. Passed 0.01 sec
Start 108: interface.MessagesFormatTest.ValidateSystemPlacementRulesRejected
108/211 Test #108: interface.MessagesFormatTest.ValidateSystemPlacementRulesRejected ................................ Passed 0.01 sec
Start 109: interface.MessagesFormatTest.ValidateReasoningContentOnlyOnAssistant
109/211 Test #109: interface.MessagesFormatTest.ValidateReasoningContentOnlyOnAssistant ............................. Passed 0.01 sec
Start 110: interface.MessagesFormatTest.ValidateAssistantEmptyContentWithReasoningAccepted
110/211 Test #110: interface.MessagesFormatTest.ValidateAssistantEmptyContentWithReasoningAccepted .................. Passed 0.01 sec
Start 111: interface.MessagesFormatTest.ValidateReasoningContentMustBeString
111/211 Test #111: interface.MessagesFormatTest.ValidateReasoningContentMustBeString ................................ Passed 0.01 sec
Start 112: interface.MessagesFormatTest.ValidateReasoningContentWhitespaceOnlyTreatedAsEmpty
112/211 Test #112: interface.MessagesFormatTest.ValidateReasoningContentWhitespaceOnlyTreatedAsEmpty ................ Passed 0.01 sec
Start 113: interface.MessagesFormatTest.ValidateImageOnlyContentAccepted
113/211 Test #113: interface.MessagesFormatTest.ValidateImageOnlyContentAccepted .................................... Passed 0.01 sec
Start 114: interface.MessagesFormatTest.ValidateInvalidImageUrlRejected
114/211 Test #114: interface.MessagesFormatTest.ValidateInvalidImageUrlRejected ..................................... Passed 0.01 sec
Start 115: interface.MessagesFormatTest.ValidateImageUrlWithoutUrlFieldRejected
115/211 Test #115: interface.MessagesFormatTest.ValidateImageUrlWithoutUrlFieldRejected ............................. Passed 0.02 sec
Start 116: interface.MessagesFormatTest.ValidateDataImageWithoutBase64MarkerRejected
116/211 Test #116: interface.MessagesFormatTest.ValidateDataImageWithoutBase64MarkerRejected ........................ Passed 0.01 sec
Start 117: interface.MessagesFormatTest.ValidateDataImageEmptyBase64PayloadRejected
117/211 Test #117: interface.MessagesFormatTest.ValidateDataImageEmptyBase64PayloadRejected ......................... Passed 0.01 sec
Start 118: interface.MessagesFormatTest.ValidateImageUrlFieldNotObjectRejected
118/211 Test #118: interface.MessagesFormatTest.ValidateImageUrlFieldNotObjectRejected .............................. Passed 0.01 sec
Start 119: interface.MessagesFormatTest.ValidateUnsupportedContentTypeRejected
119/211 Test #119: interface.MessagesFormatTest.ValidateUnsupportedContentTypeRejected .............................. Passed 0.01 sec
Start 120: interface.MessagesFormatTest.ValidateContentPartFieldTypesRejected
120/211 Test #120: interface.MessagesFormatTest.ValidateContentPartFieldTypesRejected ............................... Passed 0.01 sec
Start 121: interface.MessagesFormatTest.ValidateContentArrayNonObjectElementRejected
121/211 Test #121: interface.MessagesFormatTest.ValidateContentArrayNonObjectElementRejected ........................ Passed 0.01 sec
Start 122: interface.MessagesFormatTest.ValidateImageUrlBoundaryValuesRejected
122/211 Test #122: interface.MessagesFormatTest.ValidateImageUrlBoundaryValuesRejected .............................. Passed 0.01 sec
Start 123: interface.MessagesFormatTest.ValidateTextFieldMissingNullObjectRejected
123/211 Test #123: interface.MessagesFormatTest.ValidateTextFieldMissingNullObjectRejected .......................... Passed 0.01 sec
Start 124: interface.MessagesFormatTest.ValidateContentArrayOnlyEmptyTextRejected
124/211 Test #124: interface.MessagesFormatTest.ValidateContentArrayOnlyEmptyTextRejected ........................... Passed 0.01 sec
Start 125: interface.MessagesFormatTest.ValidateContentArrayEmptyTextWithImageAccepted
125/211 Test #125: interface.MessagesFormatTest.ValidateContentArrayEmptyTextWithImageAccepted ...................... Passed 0.01 sec
Start 126: interface.MessagesFormatTest.FormatThreeRoundsPlainText
126/211 Test #126: interface.MessagesFormatTest.FormatThreeRoundsPlainText .......................................... Passed 0.01 sec
Start 127: interface.MessagesFormatTest.FormatSystemMessageChatMLStructure
127/211 Test #127: interface.MessagesFormatTest.FormatSystemMessageChatMLStructure .................................. Passed 0.01 sec
Start 128: interface.MessagesFormatTest.FormatContentWithSpecialCharacters
128/211 Test #128: interface.MessagesFormatTest.FormatContentWithSpecialCharacters .................................. Passed 0.01 sec
Start 129: interface.MessagesFormatTest.FormatRejectsInvalidMessagesDirectly
129/211 Test #129: interface.MessagesFormatTest.FormatRejectsInvalidMessagesDirectly ................................ Passed 0.10 sec
Start 130: interface.MessagesFormatTest.FormatMessagesNotArrayRejected
130/211 Test #130: interface.MessagesFormatTest.FormatMessagesNotArrayRejected ...................................... Passed 0.01 sec
Start 131: interface.MessagesFormatTest.FormatMultiTurnTwoImagesOrderMatchesPlaceholders
131/211 Test #131: interface.MessagesFormatTest.FormatMultiTurnTwoImagesOrderMatchesPlaceholders .................... Passed 0.01 sec
Start 132: interface.MessagesFormatTest.FormatMixedTextAndMultipleImagesInSingleTurn
132/211 Test #132: interface.MessagesFormatTest.FormatMixedTextAndMultipleImagesInSingleTurn ........................ Passed 0.01 sec
Start 133: interface.MessagesFormatTest.FormatValidBase64ImagePopulatesBuffers
133/211 Test #133: interface.MessagesFormatTest.FormatValidBase64ImagePopulatesBuffers .............................. Passed 0.01 sec
Start 134: interface.MessagesFormatTest.FormatInvalidBase64DataUrlRejected
134/211 Test #134: interface.MessagesFormatTest.FormatInvalidBase64DataUrlRejected .................................. Passed 0.10 sec
Start 135: interface.MessagesFormatTest.FormatAssistantReasoningContentInjectedToChatML
135/211 Test #135: interface.MessagesFormatTest.FormatAssistantReasoningContentInjectedToChatML ..................... Passed 0.01 sec
Start 136: interface.MessagesFormatTest.FormatAssistantReasoningOnlyNoContent
136/211 Test #136: interface.MessagesFormatTest.FormatAssistantReasoningOnlyNoContent ............................... Passed 0.01 sec
Start 137: interface.MessagesFormatTest.FormatQwenThinkingDisabledAppendsEmptyBlock
137/211 Test #137: interface.MessagesFormatTest.FormatQwenThinkingDisabledAppendsEmptyBlock ......................... Passed 0.01 sec
Start 138: interface.MessagesFormatTest.FormatQwen3BaseThinkingEnabledNoOpenTag
138/211 Test #138: interface.MessagesFormatTest.FormatQwen3BaseThinkingEnabledNoOpenTag ............................. Passed 0.01 sec
Start 139: interface.MessagesFormatTest.FormatQwen35ThinkingEnabledAppendsOpenTag
139/211 Test #139: interface.MessagesFormatTest.FormatQwen35ThinkingEnabledAppendsOpenTag ........................... Passed 0.01 sec
Start 140: interface.MessagesFormatTest.FormatQwen35ThinkingDisabledAppendsEmptyBlock
140/211 Test #140: interface.MessagesFormatTest.FormatQwen35ThinkingDisabledAppendsEmptyBlock ....................... Passed 0.01 sec
Start 141: interface.MessagesFormatTest.FormatNonQwen3ModelNoThinkingSuffix
141/211 Test #141: interface.MessagesFormatTest.FormatNonQwen3ModelNoThinkingSuffix ................................. Passed 0.01 sec
Start 142: interface.MessagesFormatTest.FormatQwenEndsWithAssistantNoThinkingSuffix
142/211 Test #142: interface.MessagesFormatTest.FormatQwenEndsWithAssistantNoThinkingSuffix ......................... Passed 0.01 sec
Start 143: interface.MessagesFormatTest.FormatQwenEndsWithAssistantReasoningDoesNotAppendGenerationSuffix
143/211 Test #143: interface.MessagesFormatTest.FormatQwenEndsWithAssistantReasoningDoesNotAppendGenerationSuffix ... Passed 0.01 sec
Start 144: interface.MessagesFormatTest.ParseThinkingDefaultWhenOmitted
144/211 Test #144: interface.MessagesFormatTest.ParseThinkingDefaultWhenOmitted ..................................... Passed 0.01 sec
Start 145: interface.MessagesFormatTest.ParseThinkingDisabled
145/211 Test #145: interface.MessagesFormatTest.ParseThinkingDisabled ............................................... Passed 0.01 sec
Start 146: interface.MessagesFormatTest.ParseThinkingEnabled
146/211 Test #146: interface.MessagesFormatTest.ParseThinkingEnabled ................................................ Passed 0.01 sec
Start 147: interface.MessagesFormatTest.ParseTopLevelEnableThinkingFalse
147/211 Test #147: interface.MessagesFormatTest.ParseTopLevelEnableThinkingFalse .................................... Passed 0.01 sec
Start 148: interface.MessagesFormatTest.ParseTopLevelEnableThinkingTrue
148/211 Test #148: interface.MessagesFormatTest.ParseTopLevelEnableThinkingTrue ..................................... Passed 0.01 sec
Start 149: interface.MessagesFormatTest.ParseExtraBodyEnableThinkingAlone
149/211 Test #149: interface.MessagesFormatTest.ParseExtraBodyEnableThinkingAlone ................................... Passed 0.01 sec
Start 150: interface.MessagesFormatTest.ParseThinkingAllSourcesConsistent
150/211 Test #150: interface.MessagesFormatTest.ParseThinkingAllSourcesConsistent ................................... Passed 0.01 sec
Start 151: interface.MessagesFormatTest.ParseThinkingAllSourcesConsistentDisabled
151/211 Test #151: interface.MessagesFormatTest.ParseThinkingAllSourcesConsistentDisabled ........................... Passed 0.01 sec
Start 152: interface.MessagesFormatTest.ParseThinkingNonBooleanRejected
152/211 Test #152: interface.MessagesFormatTest.ParseThinkingNonBooleanRejected ..................................... Passed 0.01 sec
Start 153: interface.MessagesFormatTest.ParseThinkingTypeMissingOrNotStringRejected
153/211 Test #153: interface.MessagesFormatTest.ParseThinkingTypeMissingOrNotStringRejected ......................... Passed 0.01 sec
Start 154: interface.MessagesFormatTest.ParseThinkingConflictRejected
154/211 Test #154: interface.MessagesFormatTest.ParseThinkingConflictRejected ....................................... Passed 0.01 sec
Start 155: interface.MessagesFormatTest.ParseReasoningFormatDefaultsToAuto
155/211 Test #155: interface.MessagesFormatTest.ParseReasoningFormatDefaultsToAuto .................................. Passed 0.01 sec
Start 156: interface.MessagesFormatTest.ParseReasoningFormatExplicitModes
156/211 Test #156: interface.MessagesFormatTest.ParseReasoningFormatExplicitModes ................................... Passed 0.01 sec
Start 157: interface.MessagesFormatTest.ResolveThinkingStyleFromModelsJson
157/211 Test #157: interface.MessagesFormatTest.ResolveThinkingStyleFromModelsJson .................................. Passed 0.01 sec
Start 158: interface.MessagesFormatTest.ResolveThinkingStyleQwen3DotXFromJson
158/211 Test #158: interface.MessagesFormatTest.ResolveThinkingStyleQwen3DotXFromJson ............................... Passed 0.01 sec
Start 159: interface.MessagesFormatTest.ResolveThinkingStyleUnregisteredModelReturnsNone
159/211 Test #159: interface.MessagesFormatTest.ResolveThinkingStyleUnregisteredModelReturnsNone .................... Passed 0.01 sec
Start 160: interface.MessagesFormatTest.ResolveThinkingStyleReturnsNoneForBadConfig
160/211 Test #160: interface.MessagesFormatTest.ResolveThinkingStyleReturnsNoneForBadConfig ......................... Passed 0.01 sec
Start 161: interface.ToolCallRequestTest.ToolsNotArrayRejected
161/211 Test #161: interface.ToolCallRequestTest.ToolsNotArrayRejected .............................................. Passed 0.01 sec
Start 162: interface.ToolCallRequestTest.ToolsObjectRejected
162/211 Test #162: interface.ToolCallRequestTest.ToolsObjectRejected ................................................ Passed 0.01 sec
Start 163: interface.ToolCallRequestTest.ToolChoiceNumberRejected
163/211 Test #163: interface.ToolCallRequestTest.ToolChoiceNumberRejected ........................................... Passed 0.01 sec
Start 164: interface.ToolCallRequestTest.InvalidToolChoiceObjectRejected
164/211 Test #164: interface.ToolCallRequestTest.InvalidToolChoiceObjectRejected .................................... Passed 0.01 sec
Start 165: interface.ToolCallRequestTest.ToolChoiceArrayRejected
165/211 Test #165: interface.ToolCallRequestTest.ToolChoiceArrayRejected ............................................ Passed 0.01 sec
Start 166: interface.ToolCallForwardTest.ToolsAndToolChoiceForwardsAsToolCallTask
166/211 Test #166: interface.ToolCallForwardTest.ToolsAndToolChoiceForwardsAsToolCallTask ........................... Passed 0.10 sec
Start 167: interface.ToolCallForwardTest.ToolChoiceDefaultsToAutoWhenOmitted
167/211 Test #167: interface.ToolCallForwardTest.ToolChoiceDefaultsToAutoWhenOmitted ................................ Passed 0.11 sec
Start 168: interface.ToolCallForwardTest.ToolChoiceAutoForwardsAsToolCallTask
168/211 Test #168: interface.ToolCallForwardTest.ToolChoiceAutoForwardsAsToolCallTask ............................... Passed 0.10 sec
Start 169: interface.ToolCallForwardTest.ToolChoiceFunctionObjectForwardsAsToolCallTask
169/211 Test #169: interface.ToolCallForwardTest.ToolChoiceFunctionObjectForwardsAsToolCallTask ..................... Passed 0.10 sec
Start 170: interface.ToolCallForwardTest.EmptyToolsArrayDoesNotForwardAsToolCall
170/211 Test #170: interface.ToolCallForwardTest.EmptyToolsArrayDoesNotForwardAsToolCall ............................ Passed 0.10 sec
Start 171: interface.ToolCallForwardTest.MissingToolsDoesNotForwardAsToolCall
171/211 Test #171: interface.ToolCallForwardTest.MissingToolsDoesNotForwardAsToolCall ............................... Passed 0.10 sec
Start 172: interface.ToolCallForwardTest.ToolChoiceWithoutToolsDoesNotForwardAsToolCall
172/211 Test #172: interface.ToolCallForwardTest.ToolChoiceWithoutToolsDoesNotForwardAsToolCall ..................... Passed 0.11 sec
Start 173: api.GewuSmartServeApiTest.NullArgumentsReturnInvalidArgument
173/211 Test #173: api.GewuSmartServeApiTest.NullArgumentsReturnInvalidArgument ..................................... Passed 0.02 sec
Start 174: api.GewuSmartServeApiTest.InitializeFinalizeAreIdempotent
174/211 Test #174: api.GewuSmartServeApiTest.InitializeFinalizeAreIdempotent ........................................ Passed 0.11 sec
Start 175: api.GewuSmartServeApiTest.CACertificatePathRoundTrips
175/211 Test #175: api.GewuSmartServeApiTest.CACertificatePathRoundTrips ............................................ Passed 0.02 sec
Start 176: api.GewuSmartServeApiTest.InvalidJsonIsRejectedBeforeServiceInitialization
176/211 Test #176: api.GewuSmartServeApiTest.InvalidJsonIsRejectedBeforeServiceInitialization ....................... Passed 0.02 sec
Start 177: api.GewuSmartServeApiTest.VersionAndListEnginesReturnValidData
177/211 Test #177: api.GewuSmartServeApiTest.VersionAndListEnginesReturnValidData ................................... Passed 0.11 sec
Start 178: api.GewuSmartServeApiTest.ChatCompletionsRejectsMalformedOrIncompleteRequests
178/211 Test #178: api.GewuSmartServeApiTest.ChatCompletionsRejectsMalformedOrIncompleteRequests .................... Passed 0.11 sec
Start 179: api.GewuSmartServeApiTest.ConfigJsonValidation
179/211 Test #179: api.GewuSmartServeApiTest.ConfigJsonValidation ................................................... Passed 0.02 sec
Start 180: api.GewuSmartServeApiTest.ConfigJsonCopiesInputBuffer
180/211 Test #180: api.GewuSmartServeApiTest.ConfigJsonCopiesInputBuffer ............................................ Passed 0.11 sec
Start 181: api.GewuSmartServeApiTest.SetModelsConfigPathLoadsConfigFile
181/211 Test #181: api.GewuSmartServeApiTest.SetModelsConfigPathLoadsConfigFile ..................................... Passed 0.11 sec
Start 182: api.GewuSmartServeApiTest.ListModelsUsesGewuOwnerAndOpenAIShape
182/211 Test #182: api.GewuSmartServeApiTest.ListModelsUsesGewuOwnerAndOpenAIShape .................................. Passed 0.11 sec
Start 183: api.GewuSmartServeApiTest.GetModelInfoAndDownloadInvalidModel
183/211 Test #183: api.GewuSmartServeApiTest.GetModelInfoAndDownloadInvalidModel .................................... Passed 0.11 sec
Start 184: api.GewuSmartServeApiTest.ListModelsReturnsValidShapeAndErrorStringIsThreadSafe
184/211 Test #184: api.GewuSmartServeApiTest.ListModelsReturnsValidShapeAndErrorStringIsThreadSafe .................. Passed 0.11 sec
Start 185: api.GewuSmartServeApiTest.RegisterEngineCanBeUnregistered
185/211 Test #185: api.GewuSmartServeApiTest.RegisterEngineCanBeUnregistered ........................................ Passed 0.11 sec
Start 186: api.GewuSmartServeApiTest.BuiltInEngineCannotBeExternallyRegisteredOrUnregistered
186/211 Test #186: api.GewuSmartServeApiTest.BuiltInEngineCannotBeExternallyRegisteredOrUnregistered ................ Passed 0.11 sec
Start 187: api.GewuSmartServeApiTest.AppleFoundationModelCanBeRegisteredAfterInitializeAndServeChat
187/211 Test #187: api.GewuSmartServeApiTest.AppleFoundationModelCanBeRegisteredAfterInitializeAndServeChat ......... Passed 0.12 sec
Start 188: api.GewuSmartServeApiTest.SmartServeApiRegistersSystemEngineAndServesChat
188/211 Test #188: api.GewuSmartServeApiTest.SmartServeApiRegistersSystemEngineAndServesChat ........................ Passed 0.12 sec
Start 189: api.GewuSmartServeApiTest.AppleFoundationModelHandlesConcurrentRequests
189/211 Test #189: api.GewuSmartServeApiTest.AppleFoundationModelHandlesConcurrentRequests ..........................***Failed 10.12 sec
Running main() from /home/HwHiAiUser/repos/smartserve/third-party/googletest/googletest/src/gtest_main.cc
Note: Google Test filter = GewuSmartServeApiTest.AppleFoundationModelHandlesConcurrentRequests
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from GewuSmartServeApiTest
[ RUN ] GewuSmartServeApiTest.AppleFoundationModelHandlesConcurrentRequests
2026-08-05 11:54:01.418 [ WARN][SmartServe][Service] applefm engine not registered, skipping model: applefm
2026-08-05 11:54:01.418 [ WARN][SmartServe][Service] gewu engine not registered, skipping model: qwen2.5-0.5b-q4-gewu
2026-08-05 11:54:01.418 [ WARN][SmartServe][Service] mnn engine not registered, skipping model: qwen3.5-0.8b-mnn
2026-08-05 11:54:01.418 [ WARN][SmartServe][Service] mnn engine not registered, skipping model: qwen3-0.6b-mnn
2026-08-05 11:54:01.418 [ WARN][SmartServe][Service] Model file not found, skipping: qwen3-8b-gguf (/home/HwHiAiUser/.cache/models/Qwen3-8B-Q4_K_M.gguf)
2026-08-05 11:54:01.418 [ WARN][SmartServe][Service] mnn engine not registered, skipping model: qwen3-0.6b-mnn-lora
2026-08-05 11:54:01.419 [ WARN][SmartServe][Service] applefm-concurrent-engine engine not registered, skipping model: applefm-concurrent
2026-08-05 11:54:01.419 [ WARN][SmartServe][Service] applefm-concurrent-engine engine not registered, skipping model: applefm-concurrent
/home/HwHiAiUser/repos/smartserve/test/api/gewu_smartserve_api_test.cpp:886: Failure
Expected equality of these values:
failures.load()
Which is: 2
0
[ FAILED ] GewuSmartServeApiTest.AppleFoundationModelHandlesConcurrentRequests (10106 ms)
[----------] 1 test from GewuSmartServeApiTest (10106 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (10106 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] GewuSmartServeApiTest.AppleFoundationModelHandlesConcurrentRequests
1 FAILED TEST
Start 190: api.GewuSmartServeApiTest.AppleFoundationModelStreamingReturnsChunksAndEof
190/211 Test #190: api.GewuSmartServeApiTest.AppleFoundationModelStreamingReturnsChunksAndEof ....................... Passed 0.11 sec
Start 191: api.GewuSmartServeApiTest.CancelActiveRequestReturnsCancelledOnGetResponse
191/211 Test #191: api.GewuSmartServeApiTest.CancelActiveRequestReturnsCancelledOnGetResponse ....................... Passed 0.11 sec
Start 192: api.GewuSmartServeApiTest.CancelCompletedRequestReturnsOk
192/211 Test #192: api.GewuSmartServeApiTest.CancelCompletedRequestReturnsOk ........................................ Passed 0.12 sec
Start 193: api.GewuSmartServeApiTest.StreamingRequestCanBeCancelledAfterFirstChunk
193/211 Test #193: api.GewuSmartServeApiTest.StreamingRequestCanBeCancelledAfterFirstChunk .......................... Passed 0.11 sec
Start 194: api.GewuSmartServeApiTest.DeleteAndUnloadReturnBusyWhileInferenceIsActive
194/211 Test #194: api.GewuSmartServeApiTest.DeleteAndUnloadReturnBusyWhileInferenceIsActive ........................ Passed 0.12 sec
Start 195: api.GewuSmartServeApiTest.AppleFoundationModelLoadsFromConfigPathAfterInitializeAndRegister
195/211 Test #195: api.GewuSmartServeApiTest.AppleFoundationModelLoadsFromConfigPathAfterInitializeAndRegister ...... Passed 0.12 sec
Start 196: api.GewuSmartServeApiTest.MultiFileDownloadReportsInstalledFileProgressProportionally
196/211 Test #196: api.GewuSmartServeApiTest.MultiFileDownloadReportsInstalledFileProgressProportionally ............ Passed 0.11 sec
Start 197: api.GewuSmartServeApiTest.SingleFileDownloadUsesNameInsideModelPathDirectory
197/211 Test #197: api.GewuSmartServeApiTest.SingleFileDownloadUsesNameInsideModelPathDirectory ..................... Passed 0.11 sec
Start 198: api.GewuSmartServeApiTest.SingleFileDirectoryPathIsNotReportedDownloaded
198/211 Test #198: api.GewuSmartServeApiTest.SingleFileDirectoryPathIsNotReportedDownloaded ......................... Passed 0.11 sec
Start 199: api.GewuSmartServeApiTest.MultiFileModelRequiresValidChecksumsToBeDownloaded
199/211 Test #199: api.GewuSmartServeApiTest.MultiFileModelRequiresValidChecksumsToBeDownloaded ..................... Passed 0.11 sec
Start 200: api.GewuSmartServeApiTest.DownloadRejectsPathTraversalInModelAndFilePaths
200/211 Test #200: api.GewuSmartServeApiTest.DownloadRejectsPathTraversalInModelAndFilePaths ........................ Passed 0.11 sec
Start 201: api.GewuSmartServeApiTest.ServiceLoadModelsUsesSingleFileNameInsideModelPathDirectory
201/211 Test #201: api.GewuSmartServeApiTest.ServiceLoadModelsUsesSingleFileNameInsideModelPathDirectory ............ Passed 0.12 sec
Start 202: api.GewuSmartServeApiTest.ServiceLoadModelsRejectsDirectoryForSingleFileModel
202/211 Test #202: api.GewuSmartServeApiTest.ServiceLoadModelsRejectsDirectoryForSingleFileModel .................... Passed 0.11 sec
Start 203: api.GewuSmartServeApiTest.ServiceLoadModelsRejectsEscapedConfiguredPaths
203/211 Test #203: api.GewuSmartServeApiTest.ServiceLoadModelsRejectsEscapedConfiguredPaths ......................... Passed 0.11 sec
Start 204: api.GewuSmartServeApiTest.DownloadPersistsMetadataAndDeleteCleansIt
204/211 Test #204: api.GewuSmartServeApiTest.DownloadPersistsMetadataAndDeleteCleansIt .............................. Passed 0.11 sec
Start 205: api.GewuSmartServeApiTest.PauseDownloadCancelsAndNextDownloadResumes
205/211 Test #205: api.GewuSmartServeApiTest.PauseDownloadCancelsAndNextDownloadResumes ............................. Passed 0.15 sec
Start 206: api.GewuSmartServeApiTest.ErrorStringCoversPublicErrorCodes
206/211 Test #206: api.GewuSmartServeApiTest.ErrorStringCoversPublicErrorCodes ...................................... Passed 0.02 sec
Start 207: model_runtime.MultiSessionTest.MultiSessionAndSingleSessionMultiTask
207/211 Test #207: model_runtime.MultiSessionTest.MultiSessionAndSingleSessionMultiTask .............................***Timeout 600.22 sec
Running main() from /home/HwHiAiUser/repos/smartserve/third-party/googletest/googletest/src/gtest_main.cc
Note: Google Test filter = MultiSessionTest.MultiSessionAndSingleSessionMultiTask
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from MultiSessionTest
2026-08-05 11:54:13.443 [ WARN][SmartServe][Service] applefm engine not registered, skipping model: applefm
2026-08-05 11:54:13.444 [ WARN][SmartServe][Service] gewu engine not registered, skipping model: qwen2.5-0.5b-q4-gewu
2026-08-05 11:54:13.444 [ WARN][SmartServe][Service] mnn engine not registered, skipping model: qwen3.5-0.8b-mnn
2026-08-05 11:54:13.444 [ WARN][SmartServe][Service] mnn engine not registered, skipping model: qwen3-0.6b-mnn
2026-08-05 11:54:13.444 [ WARN][SmartServe][Service] Model file not found, skipping: qwen3-8b-gguf (/home/HwHiAiUser/.cache/models/Qwen3-8B-Q4_K_M.gguf)
2026-08-05 11:54:13.444 [ WARN][SmartServe][Service] mnn engine not registered, skipping model: qwen3-0.6b-mnn-lora
[ RUN ] MultiSessionTest.MultiSessionAndSingleSessionMultiTask
2026-08-05 11:54:14.434 [ WARN][SmartServe][llamacpp | EngineCreator] model qwen3-0.6b-gguf: toolcall meta not found at /home/HwHiAiUser/.cache/models/qwen3-0.6b-gguf-toolcall.gguf, fallback to main model
...........................................................................
...........................................................
clip_model_loader: model name: Qwen3.5-0.8B
clip_model_loader: description:
clip_model_loader: GGUF version: 3
clip_model_loader: alignment: 32
clip_model_loader: n_tensors: 154
clip_model_loader: n_kv: 32
clip_model_loader: has vision encoder
clip_model_loader: tensor[0]: n_dims = 1, name = v.blk.0.attn_out.bias, tensor_size=3072, offset=0, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[1]: n_dims = 2, name = v.blk.0.attn_out.weight, tensor_size=1179648, offset=3072, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[2]: n_dims = 1, name = v.blk.0.attn_qkv.bias, tensor_size=9216, offset=1182720, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[3]: n_dims = 2, name = v.blk.0.attn_qkv.weight, tensor_size=3538944, offset=1191936, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[4]: n_dims = 1, name = v.blk.0.ffn_up.bias, tensor_size=12288, offset=4730880, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[5]: n_dims = 2, name = v.blk.0.ffn_up.weight, tensor_size=4718592, offset=4743168, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[6]: n_dims = 1, name = v.blk.0.ffn_down.bias, tensor_size=3072, offset=9461760, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[7]: n_dims = 2, name = v.blk.0.ffn_down.weight, tensor_size=4718592, offset=9464832, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[8]: n_dims = 1, name = v.blk.0.ln1.bias, tensor_size=3072, offset=14183424, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[9]: n_dims = 1, name = v.blk.0.ln1.weight, tensor_size=3072, offset=14186496, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[10]: n_dims = 1, name = v.blk.0.ln2.bias, tensor_size=3072, offset=14189568, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[11]: n_dims = 1, name = v.blk.0.ln2.weight, tensor_size=3072, offset=14192640, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[12]: n_dims = 1, name = v.blk.1.attn_out.bias, tensor_size=3072, offset=14195712, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[13]: n_dims = 2, name = v.blk.1.attn_out.weight, tensor_size=1179648, offset=14198784, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[14]: n_dims = 1, name = v.blk.1.attn_qkv.bias, tensor_size=9216, offset=15378432, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[15]: n_dims = 2, name = v.blk.1.attn_qkv.weight, tensor_size=3538944, offset=15387648, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[16]: n_dims = 1, name = v.blk.1.ffn_up.bias, tensor_size=12288, offset=18926592, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[17]: n_dims = 2, name = v.blk.1.ffn_up.weight, tensor_size=4718592, offset=18938880, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[18]: n_dims = 1, name = v.blk.1.ffn_down.bias, tensor_size=3072, offset=23657472, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[19]: n_dims = 2, name = v.blk.1.ffn_down.weight, tensor_size=4718592, offset=23660544, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[20]: n_dims = 1, name = v.blk.1.ln1.bias, tensor_size=3072, offset=28379136, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[21]: n_dims = 1, name = v.blk.1.ln1.weight, tensor_size=3072, offset=28382208, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[22]: n_dims = 1, name = v.blk.1.ln2.bias, tensor_size=3072, offset=28385280, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[23]: n_dims = 1, name = v.blk.1.ln2.weight, tensor_size=3072, offset=28388352, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[24]: n_dims = 1, name = v.blk.10.attn_out.bias, tensor_size=3072, offset=28391424, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[25]: n_dims = 2, name = v.blk.10.attn_out.weight, tensor_size=1179648, offset=28394496, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[26]: n_dims = 1, name = v.blk.10.attn_qkv.bias, tensor_size=9216, offset=29574144, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[27]: n_dims = 2, name = v.blk.10.attn_qkv.weight, tensor_size=3538944, offset=29583360, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[28]: n_dims = 1, name = v.blk.10.ffn_up.bias, tensor_size=12288, offset=33122304, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[29]: n_dims = 2, name = v.blk.10.ffn_up.weight, tensor_size=4718592, offset=33134592, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[30]: n_dims = 1, name = v.blk.10.ffn_down.bias, tensor_size=3072, offset=37853184, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[31]: n_dims = 2, name = v.blk.10.ffn_down.weight, tensor_size=4718592, offset=37856256, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[32]: n_dims = 1, name = v.blk.10.ln1.bias, tensor_size=3072, offset=42574848, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[33]: n_dims = 1, name = v.blk.10.ln1.weight, tensor_size=3072, offset=42577920, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[34]: n_dims = 1, name = v.blk.10.ln2.bias, tensor_size=3072, offset=42580992, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[35]: n_dims = 1, name = v.blk.10.ln2.weight, tensor_size=3072, offset=42584064, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[36]: n_dims = 1, name = v.blk.11.attn_out.bias, tensor_size=3072, offset=42587136, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[37]: n_dims = 2, name = v.blk.11.attn_out.weight, tensor_size=1179648, offset=42590208, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[38]: n_dims = 1, name = v.blk.11.attn_qkv.bias, tensor_size=9216, offset=43769856, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[39]: n_dims = 2, name = v.blk.11.attn_qkv.weight, tensor_size=3538944, offset=43779072, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[40]: n_dims = 1, name = v.blk.11.ffn_up.bias, tensor_size=12288, offset=47318016, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[41]: n_dims = 2, name = v.blk.11.ffn_up.weight, tensor_size=4718592, offset=47330304, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[42]: n_dims = 1, name = v.blk.11.ffn_down.bias, tensor_size=3072, offset=52048896, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[43]: n_dims = 2, name = v.blk.11.ffn_down.weight, tensor_size=4718592, offset=52051968, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[44]: n_dims = 1, name = v.blk.11.ln1.bias, tensor_size=3072, offset=56770560, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[45]: n_dims = 1, name = v.blk.11.ln1.weight, tensor_size=3072, offset=56773632, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[46]: n_dims = 1, name = v.blk.11.ln2.bias, tensor_size=3072, offset=56776704, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[47]: n_dims = 1, name = v.blk.11.ln2.weight, tensor_size=3072, offset=56779776, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[48]: n_dims = 1, name = v.blk.2.attn_out.bias, tensor_size=3072, offset=56782848, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[49]: n_dims = 2, name = v.blk.2.attn_out.weight, tensor_size=1179648, offset=56785920, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[50]: n_dims = 1, name = v.blk.2.attn_qkv.bias, tensor_size=9216, offset=57965568, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[51]: n_dims = 2, name = v.blk.2.attn_qkv.weight, tensor_size=3538944, offset=57974784, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[52]: n_dims = 1, name = v.blk.2.ffn_up.bias, tensor_size=12288, offset=61513728, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[53]: n_dims = 2, name = v.blk.2.ffn_up.weight, tensor_size=4718592, offset=61526016, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[54]: n_dims = 1, name = v.blk.2.ffn_down.bias, tensor_size=3072, offset=66244608, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[55]: n_dims = 2, name = v.blk.2.ffn_down.weight, tensor_size=4718592, offset=66247680, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[56]: n_dims = 1, name = v.blk.2.ln1.bias, tensor_size=3072, offset=70966272, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[57]: n_dims = 1, name = v.blk.2.ln1.weight, tensor_size=3072, offset=70969344, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[58]: n_dims = 1, name = v.blk.2.ln2.bias, tensor_size=3072, offset=70972416, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[59]: n_dims = 1, name = v.blk.2.ln2.weight, tensor_size=3072, offset=70975488, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[60]: n_dims = 1, name = v.blk.3.attn_out.bias, tensor_size=3072, offset=70978560, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[61]: n_dims = 2, name = v.blk.3.attn_out.weight, tensor_size=1179648, offset=70981632, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[62]: n_dims = 1, name = v.blk.3.attn_qkv.bias, tensor_size=9216, offset=72161280, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[63]: n_dims = 2, name = v.blk.3.attn_qkv.weight, tensor_size=3538944, offset=72170496, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[64]: n_dims = 1, name = v.blk.3.ffn_up.bias, tensor_size=12288, offset=75709440, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[65]: n_dims = 2, name = v.blk.3.ffn_up.weight, tensor_size=4718592, offset=75721728, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[66]: n_dims = 1, name = v.blk.3.ffn_down.bias, tensor_size=3072, offset=80440320, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[67]: n_dims = 2, name = v.blk.3.ffn_down.weight, tensor_size=4718592, offset=80443392, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[68]: n_dims = 1, name = v.blk.3.ln1.bias, tensor_size=3072, offset=85161984, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[69]: n_dims = 1, name = v.blk.3.ln1.weight, tensor_size=3072, offset=85165056, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[70]: n_dims = 1, name = v.blk.3.ln2.bias, tensor_size=3072, offset=85168128, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[71]: n_dims = 1, name = v.blk.3.ln2.weight, tensor_size=3072, offset=85171200, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[72]: n_dims = 1, name = v.blk.4.attn_out.bias, tensor_size=3072, offset=85174272, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[73]: n_dims = 2, name = v.blk.4.attn_out.weight, tensor_size=1179648, offset=85177344, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[74]: n_dims = 1, name = v.blk.4.attn_qkv.bias, tensor_size=9216, offset=86356992, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[75]: n_dims = 2, name = v.blk.4.attn_qkv.weight, tensor_size=3538944, offset=86366208, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[76]: n_dims = 1, name = v.blk.4.ffn_up.bias, tensor_size=12288, offset=89905152, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[77]: n_dims = 2, name = v.blk.4.ffn_up.weight, tensor_size=4718592, offset=89917440, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[78]: n_dims = 1, name = v.blk.4.ffn_down.bias, tensor_size=3072, offset=94636032, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[79]: n_dims = 2, name = v.blk.4.ffn_down.weight, tensor_size=4718592, offset=94639104, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[80]: n_dims = 1, name = v.blk.4.ln1.bias, tensor_size=3072, offset=99357696, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[81]: n_dims = 1, name = v.blk.4.ln1.weight, tensor_size=3072, offset=99360768, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[82]: n_dims = 1, name = v.blk.4.ln2.bias, tensor_size=3072, offset=99363840, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[83]: n_dims = 1, name = v.blk.4.ln2.weight, tensor_size=3072, offset=99366912, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[84]: n_dims = 1, name = v.blk.5.attn_out.bias, tensor_size=3072, offset=99369984, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[85]: n_dims = 2, name = v.blk.5.attn_out.weight, tensor_size=1179648, offset=99373056, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[86]: n_dims = 1, name = v.blk.5.attn_qkv.bias, tensor_size=9216, offset=100552704, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[87]: n_dims = 2, name = v.blk.5.attn_qkv.weight, tensor_size=3538944, offset=100561920, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[88]: n_dims = 1, name = v.blk.5.ffn_up.bias, tensor_size=12288, offset=104100864, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[89]: n_dims = 2, name = v.blk.5.ffn_up.weight, tensor_size=4718592, offset=104113152, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[90]: n_dims = 1, name = v.blk.5.ffn_down.bias, tensor_size=3072, offset=108831744, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[91]: n_dims = 2, name = v.blk.5.ffn_down.weight, tensor_size=4718592, offset=108834816, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[92]: n_dims = 1, name = v.blk.5.ln1.bias, tensor_size=3072, offset=113553408, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[93]: n_dims = 1, name = v.blk.5.ln1.weight, tensor_size=3072, offset=113556480, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[94]: n_dims = 1, name = v.blk.5.ln2.bias, tensor_size=3072, offset=113559552, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[95]: n_dims = 1, name = v.blk.5.ln2.weight, tensor_size=3072, offset=113562624, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[96]: n_dims = 1, name = v.blk.6.attn_out.bias, tensor_size=3072, offset=113565696, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[97]: n_dims = 2, name = v.blk.6.attn_out.weight, tensor_size=1179648, offset=113568768, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[98]: n_dims = 1, name = v.blk.6.attn_qkv.bias, tensor_size=9216, offset=114748416, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[99]: n_dims = 2, name = v.blk.6.attn_qkv.weight, tensor_size=3538944, offset=114757632, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[100]: n_dims = 1, name = v.blk.6.ffn_up.bias, tensor_size=12288, offset=118296576, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[101]: n_dims = 2, name = v.blk.6.ffn_up.weight, tensor_size=4718592, offset=118308864, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[102]: n_dims = 1, name = v.blk.6.ffn_down.bias, tensor_size=3072, offset=123027456, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[103]: n_dims = 2, name = v.blk.6.ffn_down.weight, tensor_size=4718592, offset=123030528, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[104]: n_dims = 1, name = v.blk.6.ln1.bias, tensor_size=3072, offset=127749120, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[105]: n_dims = 1, name = v.blk.6.ln1.weight, tensor_size=3072, offset=127752192, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[106]: n_dims = 1, name = v.blk.6.ln2.bias, tensor_size=3072, offset=127755264, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[107]: n_dims = 1, name = v.blk.6.ln2.weight, tensor_size=3072, offset=127758336, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[108]: n_dims = 1, name = v.blk.7.attn_out.bias, tensor_size=3072, offset=127761408, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[109]: n_dims = 2, name = v.blk.7.attn_out.weight, tensor_size=1179648, offset=127764480, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[110]: n_dims = 1, name = v.blk.7.attn_qkv.bias, tensor_size=9216, offset=128944128, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[111]: n_dims = 2, name = v.blk.7.attn_qkv.weight, tensor_size=3538944, offset=128953344, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[112]: n_dims = 1, name = v.blk.7.ffn_up.bias, tensor_size=12288, offset=132492288, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[113]: n_dims = 2, name = v.blk.7.ffn_up.weight, tensor_size=4718592, offset=132504576, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[114]: n_dims = 1, name = v.blk.7.ffn_down.bias, tensor_size=3072, offset=137223168, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[115]: n_dims = 2, name = v.blk.7.ffn_down.weight, tensor_size=4718592, offset=137226240, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[116]: n_dims = 1, name = v.blk.7.ln1.bias, tensor_size=3072, offset=141944832, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[117]: n_dims = 1, name = v.blk.7.ln1.weight, tensor_size=3072, offset=141947904, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[118]: n_dims = 1, name = v.blk.7.ln2.bias, tensor_size=3072, offset=141950976, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[119]: n_dims = 1, name = v.blk.7.ln2.weight, tensor_size=3072, offset=141954048, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[120]: n_dims = 1, name = v.blk.8.attn_out.bias, tensor_size=3072, offset=141957120, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[121]: n_dims = 2, name = v.blk.8.attn_out.weight, tensor_size=1179648, offset=141960192, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[122]: n_dims = 1, name = v.blk.8.attn_qkv.bias, tensor_size=9216, offset=143139840, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[123]: n_dims = 2, name = v.blk.8.attn_qkv.weight, tensor_size=3538944, offset=143149056, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[124]: n_dims = 1, name = v.blk.8.ffn_up.bias, tensor_size=12288, offset=146688000, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[125]: n_dims = 2, name = v.blk.8.ffn_up.weight, tensor_size=4718592, offset=146700288, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[126]: n_dims = 1, name = v.blk.8.ffn_down.bias, tensor_size=3072, offset=151418880, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[127]: n_dims = 2, name = v.blk.8.ffn_down.weight, tensor_size=4718592, offset=151421952, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[128]: n_dims = 1, name = v.blk.8.ln1.bias, tensor_size=3072, offset=156140544, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[129]: n_dims = 1, name = v.blk.8.ln1.weight, tensor_size=3072, offset=156143616, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[130]: n_dims = 1, name = v.blk.8.ln2.bias, tensor_size=3072, offset=156146688, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[131]: n_dims = 1, name = v.blk.8.ln2.weight, tensor_size=3072, offset=156149760, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[132]: n_dims = 1, name = v.blk.9.attn_out.bias, tensor_size=3072, offset=156152832, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[133]: n_dims = 2, name = v.blk.9.attn_out.weight, tensor_size=1179648, offset=156155904, shape:[768, 768, 1, 1], type = f16
clip_model_loader: tensor[134]: n_dims = 1, name = v.blk.9.attn_qkv.bias, tensor_size=9216, offset=157335552, shape:[2304, 1, 1, 1], type = f32
clip_model_loader: tensor[135]: n_dims = 2, name = v.blk.9.attn_qkv.weight, tensor_size=3538944, offset=157344768, shape:[768, 2304, 1, 1], type = f16
clip_model_loader: tensor[136]: n_dims = 1, name = v.blk.9.ffn_up.bias, tensor_size=12288, offset=160883712, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[137]: n_dims = 2, name = v.blk.9.ffn_up.weight, tensor_size=4718592, offset=160896000, shape:[768, 3072, 1, 1], type = f16
clip_model_loader: tensor[138]: n_dims = 1, name = v.blk.9.ffn_down.bias, tensor_size=3072, offset=165614592, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[139]: n_dims = 2, name = v.blk.9.ffn_down.weight, tensor_size=4718592, offset=165617664, shape:[3072, 768, 1, 1], type = f16
clip_model_loader: tensor[140]: n_dims = 1, name = v.blk.9.ln1.bias, tensor_size=3072, offset=170336256, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[141]: n_dims = 1, name = v.blk.9.ln1.weight, tensor_size=3072, offset=170339328, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[142]: n_dims = 1, name = v.blk.9.ln2.bias, tensor_size=3072, offset=170342400, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[143]: n_dims = 1, name = v.blk.9.ln2.weight, tensor_size=3072, offset=170345472, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[144]: n_dims = 1, name = mm.0.bias, tensor_size=12288, offset=170348544, shape:[3072, 1, 1, 1], type = f32
clip_model_loader: tensor[145]: n_dims = 2, name = mm.0.weight, tensor_size=18874368, offset=170360832, shape:[3072, 3072, 1, 1], type = f16
clip_model_loader: tensor[146]: n_dims = 1, name = mm.2.bias, tensor_size=4096, offset=189235200, shape:[1024, 1, 1, 1], type = f32
clip_model_loader: tensor[147]: n_dims = 2, name = mm.2.weight, tensor_size=6291456, offset=189239296, shape:[3072, 1024, 1, 1], type = f16
clip_model_loader: tensor[148]: n_dims = 1, name = v.post_ln.bias, tensor_size=3072, offset=195530752, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[149]: n_dims = 1, name = v.post_ln.weight, tensor_size=3072, offset=195533824, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[150]: n_dims = 1, name = v.patch_embd.bias, tensor_size=3072, offset=195536896, shape:[768, 1, 1, 1], type = f32
clip_model_loader: tensor[151]: n_dims = 4, name = v.patch_embd.weight, tensor_size=1179648, offset=195539968, shape:[16, 16, 3, 768], type = f16
clip_model_loader: tensor[152]: n_dims = 4, name = v.patch_embd.weight.1, tensor_size=1179648, offset=196719616, shape:[16, 16, 3, 768], type = f16
clip_model_loader: tensor[153]: n_dims = 2, name = v.position_embd.weight, tensor_size=7077888, offset=197899264, shape:[768, 2304, 1, 1], type = f32
clip_ctx: CLIP using CPU backend
load_hparams: projector: qwen3vl_merger
load_hparams: n_embd: 768
load_hparams: n_head: 12
load_hparams: n_ff: 3072
load_hparams: n_layer: 12
load_hparams: ffn_op: gelu
load_hparams: projection_dim: 1024
--- vision hparams ---
load_hparams: image_size: 768
load_hparams: patch_size: 16
load_hparams: has_llava_proj: 0
load_hparams: minicpmv_version: 0
load_hparams: n_merge: 2
load_hparams: n_wa_pattern: 0
load_hparams: image_min_pixels: 1048576 (custom value)
load_hparams: image_max_pixels: 4194304
load_hparams: model size: 195.48 MiB
load_hparams: metadata size: 0.05 MiB
load_tensors: loaded 154 tensors from /home/HwHiAiUser/.cache/models/qwen3.5-0.8b-gguf/mmproj-F16.gguf
warmup: warmup with image size = 1472 x 1472
reserve_compute_meta: CPU compute buffer size = 161.31 MiB
reserve_compute_meta: graph splits = 1, nodes = 388
warmup: flash attention is enabled
add_text: <|im_start|>user
What is the capital of China?<|im_end|>
<|im_start|>assistant
<think>
Start 208: model_runtime.MultiSessionTest.RuntimeCancelThenImmediateNewRequest
208/211 Test #208: model_runtime.MultiSessionTest.RuntimeCancelThenImmediateNewRequest .............................. Passed 6.31 sec
Start 209: model_runtime.SmartServeTest.SmartServeLLMInterfaceTest
209/211 Test #209: model_runtime.SmartServeTest.SmartServeLLMInterfaceTest .......................................... Passed 50.95 sec
Start 210: model_runtime.SmartServeTest.SmartServeMnnLoraInterfaceTest
210/211 Test #210: model_runtime.SmartServeTest.SmartServeMnnLoraInterfaceTest ......................................***Not Run (Disabled) 0.00 sec
Start 211: model_runtime.SmartServeTest.SmartServeVLMInterfaceTest
211/211 Test #211: model_runtime.SmartServeTest.SmartServeVLMInterfaceTest .......................................... Passed 3.61 sec
99% tests passed, 2 tests failed out of 210
Total Test time (real) = 681.20 sec
The following tests did not run:
210 - model_runtime.SmartServeTest.SmartServeMnnLoraInterfaceTest (Disabled)
The following tests FAILED:
189 - api.GewuSmartServeApiTest.AppleFoundationModelHandlesConcurrentRequests (Failed)
207 - model_runtime.MultiSessionTest.MultiSessionAndSingleSessionMultiTask (Timeout)
Errors while running CTest
=== finished status=failure exit=8 duration=2702s timeout_sec=6000 attempts=2 ===