Run Archive · Permanent · Append-Only
Benchmark Run — 2026-11-21
Traditional Chinese Quality Benchmark v1.0 · Corpus v1.0 (24 segments) · Tested 2026-11-21 00:48–00:50 CST, browser-route supplement 00:52–00:57 CST · Zero-budget run: free public endpoints and free API tiers only; no new accounts registered.
Conditions disclosure
AI/LLM engines received the corpus with one shared neutral prompt ('Translate into Traditional Chinese as used in Taiwan' plus fixed formatting instructions). Machine-translation engines received the source text directly, with no prompt. The groups were measured under different conditions; this disclosure travels with the scores wherever they appear.
Supplement & Bing condition
Supplement (same run, 2026-11-21 00:52-00:57 CST): DeepL and Microsoft Translator (Bing) were measured afterwards through a real-browser route - free web translators, not logged in - after their scripted channels proved unreachable; the failed attempts remain archived. Bing condition disclosure: the translator's tone preset was left at its default 'casual' setting, so its output uses the informal address form throughout with colloquial phrasing. The benchmark's three metrics (script residue, mainland wording, terminology) do not score register or tone; read Bing's score with that condition attached.
Results
| Engine | Version / channel | Simplified residue | Mainland wording hits | Terminology (pref:mainland) | Purity | Wording | Terminology | Score | Grade |
|---|---|---|---|---|---|---|---|---|---|
| Gemini | gemini-3.5-flash-lite | 0.0% | 1 (0.26/100) | 34:0 | 100.0 | 97.4 | 100.0 | 99 | A |
| Microsoft Translator | web UI; model not exposed, recorded by access date | 0.26% | 2 (0.52/100) | 35:0 | 99.0 | 94.8 | 100.0 | 98 | A |
| Groq | openai/gpt-oss-120b | 0.0% | 3 (0.82/100) | 35:1 | 100.0 | 91.8 | 97.2 | 96 | A |
| DeepL | not exposed by web UI; recorded by access date | 0.25% | 3 (0.75/100) | 32:3 | 99.0 | 92.5 | 91.4 | 95 | A |
| Google Translate | not exposed by endpoint; recorded by access date | 0.25% | 7 (1.77/100) | 30:6 | 99.0 | 82.3 | 83.3 | 89 | B |
Reproducibility check: the Google Translate measurement was independently re-run the same day by a second operator using the archived corpus and method, and produced identical figures (score 89/B, purity 99.0, wording 82.3, terminology 83.3, residue 0.25%, 7 wording hits). Scores on this page are computed by a deterministic script from the archived outputs below — not written by hand.
Full evidence — every segment, every output
Gemini — 99 (Grade A) · gemini-3.5-flash-lite · connector CLI chat · 2026-11-21 00:50:13 CST
| ID | Source (EN) | Raw output (archived) | Flags & term verdicts |
|---|---|---|---|
| M1 | Watch the video to see how our software helps your team work online. | 觀看影片,了解我們的軟體如何協助您的團隊進行線上協作。 | — |
| M2 | High-quality sound and unbeatable value for money — download the app today. | 高音質且物超所值——立即下載應用程式。 | terms: quality=other, value for money=other |
| M3 | Get instant message notifications and free shipping on every order. | 獲得即時訊息通知,且每筆訂單皆享免運費。 | — |
| M4 | Our network covers the whole city, so you can take a taxi or a bus to get anywhere. | 我們的網路涵蓋全市,因此您可以搭乘計程車或公車前往任何地方。 | — |
| M5 | Sign up now and print your boarding pass before the countdown ends. | 立即註冊,並在倒數結束前列印您的登機證。 | — |
| M6 | This smartphone has a bigger screen and a smarter default search. | 這款智慧型手機擁有更大的螢幕與更聰明的預設搜尋。 | — |
| U1 | Settings | 設定 | — |
| U2 | Log in to your account | 登入您的帳戶 | — |
| U3 | Search settings and message notifications | 搜尋設定與訊息通知 | — |
| U4 | Download the software update | 下載軟體更新 | — |
| U5 | Watch the video in high quality | 以高畫質觀看影片 | terms: quality=other |
| U6 | Default network settings | 預設網路設定 | — |
| G1 | Watch the opening video, then open settings to adjust the screen brightness. | 觀看開場影片,然後開啟設定來調整螢幕亮度。 | — |
| G2 | Collect 100 coins to level up and unlock the secret level. | 收集 100 枚金幣來升級並解鎖祕密關卡。 | — |
| G3 | The final countdown begins! Your team must protect the crystal at all costs. | 最後倒數開始!您的團隊必須不計一切代價保護水晶。 | — |
| G4 | Check your messages — the guild leader has sent you a new quest. | 查看您的訊息——公會會長傳送了新任務給您。 | — |
| G5 | This boss drops high-quality gear with excellent value for money. | 這隻頭目會掉落品質優良且CP值極高的裝備。 | — |
| G6 | Download the update to play online with friends around the world. | 下載更新,與世界各地的朋友一起線上遊玩。 | — |
| S1 | Please contact our online support team if you cannot log in. | 若您無法登入,請聯絡我們的線上客服團隊。 | — |
| S2 | You can print your receipt from the account settings page. | 您可以從帳戶設定頁面列印收據。 | — |
| S3 | We will send you a text message to verify your phone number. | 我們將傳送簡訊給您以驗證手機號碼。 | wording: 手機號 |
| S4 | If the video will not play, check your network connection. | 如果影片無法播放,請檢查您的網路連線。 | — |
| S5 | Your software license expires in 7 days. Download the latest version now. | 您的軟體授權將在 7 天後到期。請立即下載最新版本。 | — |
| S6 | Thank you for your message. Our support team will reply within 24 hours. | 感謝您的留言。我們的支援團隊將在 24 小時內回覆。 | terms: message=other |
Microsoft Translator (Bing) — 98 (Grade A) · web UI; model not exposed, recorded by access date · real browser session, bing.com/translator (free, not logged in) · 2026-11-21 00:52-00:57 CST
| ID | Source (EN) | Raw output (archived) | Flags & term verdicts |
|---|---|---|---|
| M1 | Watch the video to see how our software helps your team work online. | 觀看影片,看看我們的軟體如何幫助你的團隊在線上協作。 | wording: 在線 |
| M2 | High-quality sound and unbeatable value for money — download the app today. | 高品質音效,物超所值 — 今天就下載這個應用程式吧。 | terms: value for money=other |
| M3 | Get instant message notifications and free shipping on every order. | 即時接收訊息通知,每筆訂單享免費運送。 | — |
| M4 | Our network covers the whole city, so you can take a taxi or a bus to get anywhere. | 我們的網路覆蓋整個城市,所以你可以搭計程車或公車到任何地方。 | — |
| M5 | Sign up now and print your boarding pass before the countdown ends. | 現在就註冊,在倒數結束前列印你的登機證。 | — |
| M6 | This smartphone has a bigger screen and a smarter default search. | 這款智慧型手機螢幕更大,預設搜尋功能也更智慧。 | — |
| U1 | Settings | 設定 | — |
| U2 | Log in to your account | 登入您的帳戶 | — |
| U3 | Search settings and message notifications | 搜尋設定與訊息通知 | — |
| U4 | Download the software update | 下載軟體更新 | — |
| U5 | Watch the video in high quality | 以高畫質觀看影片 | terms: quality=other |
| U6 | Default network settings | 預設網路設定 | — |
| G1 | Watch the opening video, then open settings to adjust the screen brightness. | 先看開場影片,然後打開設定調整螢幕亮度。 | — |
| G2 | Collect 100 coins to level up and unlock the secret level. | 收集100個硬幣升級並解鎖祕密關卡。 | — |
| G3 | The final countdown begins! Your team must protect the crystal at all costs. | 最終倒數開始!你的隊伍必須不惜一切代價保護水晶。 | — |
| G4 | Check your messages — the guild leader has sent you a new quest. | 查看你的訊息——公會會長寄給你一個新任務。 | — |
| G5 | This boss drops high-quality gear with excellent value for money. | 這個Boss會掉落高品質裝備,超值划算。 | simplified residue: 1 char(s); terms: value for money=other |
| G6 | Download the update to play online with friends around the world. | 下載更新以便和世界各地的朋友一起線上遊玩。 | — |
| S1 | Please contact our online support team if you cannot log in. | 如果你無法登入,請聯繫我們的線上支援團隊。 | — |
| S2 | You can print your receipt from the account settings page. | 你可以從帳戶設定頁面列印你的收據。 | — |
| S3 | We will send you a text message to verify your phone number. | 我們會發送簡訊來驗證你的手機號碼。 | wording: 手機號 |
| S4 | If the video will not play, check your network connection. | 如果影片無法播放,請檢查你的網路連線。 | — |
| S5 | Your software license expires in 7 days. Download the latest version now. | 你的軟體授權將在 7 天後到期。立即下載最新版本吧。 | — |
| S6 | Thank you for your message. Our support team will reply within 24 hours. | 感謝你的訊息。我們的支援團隊會在 24 小時內回覆你。 | — |
Groq — 96 (Grade A) · openai/gpt-oss-120b · connector CLI chat · 2026-11-21 00:50:27 CST
| ID | Source (EN) | Raw output (archived) | Flags & term verdicts |
|---|---|---|---|
| M1 | Watch the video to see how our software helps your team work online. | 觀看影片,了解我們的軟體如何協助您的團隊在線上工作。 | wording: 在線 |
| M2 | High-quality sound and unbeatable value for money — download the app today. | 高品質音效,超值價格 — 今日就下載應用程式。 | terms: value for money=other |
| M3 | Get instant message notifications and free shipping on every order. | 即時訊息通知,且每筆訂單皆免運費。 | — |
| M4 | Our network covers the whole city, so you can take a taxi or a bus to get anywhere. | 我們的網路覆蓋全市,您搭計程車或公車都能到達任何地方。 | — |
| M5 | Sign up now and print your boarding pass before the countdown ends. | 立即註冊,並在倒數結束前列印您的登機證。 | — |
| M6 | This smartphone has a bigger screen and a smarter default search. | 此智慧手機配備更大螢幕與更智慧的預設搜尋功能。 | — |
| U1 | Settings | 設定 | — |
| U2 | Log in to your account | 登入您的帳號 | — |
| U3 | Search settings and message notifications | 搜尋設定與訊息通知 | — |
| U4 | Download the software update | 下載軟體更新 | — |
| U5 | Watch the video in high quality | 以高畫質觀看影片 | terms: quality=other |
| U6 | Default network settings | 預設網路設定 | — |
| G1 | Watch the opening video, then open settings to adjust the screen brightness. | 先觀看開場影片,然後開啟設定以調整螢幕亮度。 | — |
| G2 | Collect 100 coins to level up and unlock the secret level. | 收集 100 枚金幣以升級並解鎖祕密關卡。 | — |
| G3 | The final countdown begins! Your team must protect the crystal at all costs. | 最後倒數開始!您的團隊必須不惜一切代價保護水晶。 | — |
| G4 | Check your messages — the guild leader has sent you a new quest. | 檢查您的訊息 — 公會會長已傳送新任務給您。 | — |
| G5 | This boss drops high-quality gear with excellent value for money. | 此首領掉落高品質裝備,性價比極佳。 | wording: 性價比; terms ✗: value for money=mainland |
| G6 | Download the update to play online with friends around the world. | 下載更新,即可與全球好友線上對戰。 | — |
| S1 | Please contact our online support team if you cannot log in. | 若無法登入,請聯絡我們的線上客服團隊。 | — |
| S2 | You can print your receipt from the account settings page. | 您可在帳號設定頁面列印收據。 | — |
| S3 | We will send you a text message to verify your phone number. | 我們會傳送簡訊給您,以驗證手機號碼。 | wording: 手機號 |
| S4 | If the video will not play, check your network connection. | 如果影片無法播放,請檢查您的網路連線。 | — |
| S5 | Your software license expires in 7 days. Download the latest version now. | 您的軟體授權將於 7 天後到期,請立即下載最新版本。 | — |
| S6 | Thank you for your message. Our support team will reply within 24 hours. | 感謝您的訊息,我們的客服團隊將在 24 小時內回覆。 | — |
DeepL — 95 (Grade A) · not exposed by web UI; recorded by access date · real browser session, deepl.com web translator (free tier, not logged in) · 2026-11-21 00:52-00:57 CST
| ID | Source (EN) | Raw output (archived) | Flags & term verdicts |
|---|---|---|---|
| M1 | Watch the video to see how our software helps your team work online. | 觀看影片,了解我們的軟體如何協助您的團隊進行線上協作。 | — |
| M2 | High-quality sound and unbeatable value for money — download the app today. | 音質優異且性價比無與倫比——立即下載這款應用程式。 | wording: 性價比; terms ✗: value for money=mainland; terms: quality=other |
| M3 | Get instant message notifications and free shipping on every order. | 每筆訂單皆可享有即時訊息通知及免運費服務。 | — |
| M4 | Our network covers the whole city, so you can take a taxi or a bus to get anywhere. | 我們的網絡覆蓋全市,因此您可以搭乘計程車或公車前往任何地方。 | wording: 網絡; terms ✗: network=mainland |
| M5 | Sign up now and print your boarding pass before the countdown ends. | 立即註冊,並在倒數結束前列印您的登機證。 | — |
| M6 | This smartphone has a bigger screen and a smarter default search. | 這款智慧型手機擁有更大的螢幕,並具備更智慧的預設搜尋功能。 | — |
| U1 | Settings | 設定 | — |
| U2 | Log in to your account | 登入您的帳戶 | — |
| U3 | Search settings and message notifications | 搜尋設定與訊息通知 | — |
| U4 | Download the software update | 下載軟體更新 | — |
| U5 | Watch the video in high quality | 以高畫質觀看影片 | terms: quality=other |
| U6 | Default network settings | 預設網路設定 | — |
| G1 | Watch the opening video, then open settings to adjust the screen brightness. | 觀看開場影片後,請開啟設定來調整螢幕亮度。 | — |
| G2 | Collect 100 coins to level up and unlock the secret level. | 收集 100 枚金幣即可升級並解鎖秘密關卡。 | simplified residue: 1 char(s) |
| G3 | The final countdown begins! Your team must protect the crystal at all costs. | 最終倒數計時開始!你的隊伍必須不惜一切代價守護水晶。 | — |
| G4 | Check your messages — the guild leader has sent you a new quest. | 查看你的訊息——公會會長已傳送給你一項新任務。 | — |
| G5 | This boss drops high-quality gear with excellent value for money. | 這隻頭目會掉落高品質且性價比極高的裝備。 | wording: 性價比; terms ✗: value for money=mainland |
| G6 | Download the update to play online with friends around the world. | 下載更新版本,即可與世界各地的朋友線上同樂。 | — |
| S1 | Please contact our online support team if you cannot log in. | 若您無法登入,請聯絡我們的線上支援團隊。 | — |
| S2 | You can print your receipt from the account settings page. | 您可從「帳戶設定」頁面列印收據。 | — |
| S3 | We will send you a text message to verify your phone number. | 我們將發送簡訊給您,以驗證您的電話號碼。 | — |
| S4 | If the video will not play, check your network connection. | 若影片無法播放,請檢查您的網路連線。 | — |
| S5 | Your software license expires in 7 days. Download the latest version now. | 您的軟體授權將於 7 天後到期。請立即下載最新版本。 | — |
| S6 | Thank you for your message. Our support team will reply within 24 hours. | 感謝您的來信。我們的支援團隊將於 24 小時內回覆。 | terms: message=other |
Google Translate — 89 (Grade B) · not exposed by endpoint; recorded by access date · public web endpoint translate.googleapis.com/translate_a/single (client=gtx) · 2026-11-21 00:48:19 CST
| ID | Source (EN) | Raw output (archived) | Flags & term verdicts |
|---|---|---|---|
| M1 | Watch the video to see how our software helps your team work online. | 觀看視頻,了解我們的軟體如何幫助您的團隊在線上工作。 | wording: 觀看視頻, 在線; terms ✗: video=mainland |
| M2 | High-quality sound and unbeatable value for money — download the app today. | 高品質音質和無與倫比的性價比 - 立即下載應用程式。 | wording: 性價比; terms ✗: value for money=mainland |
| M3 | Get instant message notifications and free shipping on every order. | 每個訂單都會收到即時訊息通知和免費送貨。 | — |
| M4 | Our network covers the whole city, so you can take a taxi or a bus to get anywhere. | 我們的網路覆蓋整個城市,因此您可以乘坐計程車或巴士前往任何地方。 | — |
| M5 | Sign up now and print your boarding pass before the countdown ends. | 立即註冊並在倒數結束前列印您的登機證。 | — |
| M6 | This smartphone has a bigger screen and a smarter default search. | 這款智慧型手機擁有更大的螢幕和更聰明的預設搜尋。 | — |
| U1 | Settings | 設定 | — |
| U2 | Log in to your account | 登入您的帳戶 | — |
| U3 | Search settings and message notifications | 搜尋設定和訊息通知 | — |
| U4 | Download the software update | 下載軟體更新 | — |
| U5 | Watch the video in high quality | 觀看高品質視頻 | wording: 視頻; terms ✗: video=mainland |
| U6 | Default network settings | 預設網路設定 | — |
| G1 | Watch the opening video, then open settings to adjust the screen brightness. | 觀看開場視頻,然後打開設定來調整螢幕亮度。 | wording: 視頻; terms ✗: video=mainland |
| G2 | Collect 100 coins to level up and unlock the secret level. | 收集 100 個硬幣即可升級並解鎖秘密關卡。 | simplified residue: 1 char(s) |
| G3 | The final countdown begins! Your team must protect the crystal at all costs. | 最後倒數計時開始!你的團隊必須不惜一切代價保護水晶。 | — |
| G4 | Check your messages — the guild leader has sent you a new quest. | 檢查你的訊息-公會領導給你發送了一個新任務。 | — |
| G5 | This boss drops high-quality gear with excellent value for money. | 這位老闆會掉落物超所值的高品質裝備。 | terms: value for money=other |
| G6 | Download the update to play online with friends around the world. | 下載更新即可與世界各地的朋友在線玩。 | wording: 在線; terms ✗: online=mainland |
| S1 | Please contact our online support team if you cannot log in. | 如果您無法登錄,請聯絡我們的線上支援團隊。 | wording: 登錄; terms ✗: log in=mainland |
| S2 | You can print your receipt from the account settings page. | 您可以從帳戶設定頁面列印收據。 | — |
| S3 | We will send you a text message to verify your phone number. | 我們將向您發送一封簡訊來驗證您的電話號碼。 | — |
| S4 | If the video will not play, check your network connection. | 如果影片無法播放,請檢查您的網路連線。 | — |
| S5 | Your software license expires in 7 days. Download the latest version now. | 您的軟體許可證將在 7 天後過期。立即下載最新版本。 | — |
| S6 | Thank you for your message. Our support team will reply within 24 hours. | 謝謝您的留言。我們的支援團隊將在 24 小時內回覆。 | terms: message=other |
Not measured in this run (with reasons)
| Tool | Status & reason |
|---|---|
| Weglot | Requires connecting a live test website to the Weglot proxy; no site connected in this run. |
| Crowdin | Account-based run of built-in pre-translation scheduled; not executed in this run. |
| Phrase | Account-based run scheduled; not executed in this run. |
| Lokalise | Account-based run scheduled; not executed in this run. |
| Smartling | Output services are paid per word; the zero-budget program does not place paid orders. |
| OpenRouter | Free model returned HTTP 429 (rate-limited upstream); not retried within the run, per policy. |
| MyMemory | Free API daily quota exhausted on the test network throughout the window (HTTP 429, archived); retest queued. |
Cite this run
LocRank, Traditional Chinese Quality Benchmark v1.0, Run 2026-11-21. locrank.com/directory/benchmarks/zh-hant/2026-11-21/ — corpus, method and scoring formulas: methodology. Machine-readable scores: /directory/api/v1/scores.json.
Get the full benchmark dataset — and every future score — by email
The public pages show the headline scores. The email edition carries the complete dataset behind them:
- The full per-segment benchmark dataset for every run (all 24 segments, every engine, every flag)
- New-tool test alerts — the day a pending tool gets its first measured score
- Quarterly re-test results, including score changes and what caused them
Free. One list, no spam, unsubscribe anytime. You will receive a confirmation email first.