首个公开的中文盲文翻译系统The first public Chinese braille translator

拍下盲文,读懂中文。 Photograph braille.
Read Chinese.

一张手机照片,点读通就能识别中文盲文、翻译成文字并朗读出来,让明眼的老师和家长也能读懂盲文作业。 From one phone photo, Vision-Braille reads Chinese braille, turns it into text, and speaks it aloud, so sighted teachers and families can understand braille homework.

免费Free 任意手机照片any phone photo 无需安装nothing to install

盲文照片Braille photo

识别与翻译Recognized & translated

工作原理How it works

四步,从盲文到声音Four steps, from dots to voice

01

拍照Photograph

用手机对着盲文页面拍一张照片。Snap a photo of the braille page with any phone.

02

识别Recognize

OCR 定位并读取页面上每一个盲文点位。Our OCR locates and reads every dot on the page.

03

翻译Translate

微调的大模型把盲文还原成中文,并补回省略的声调。A fine-tuned model restores Chinese, filling in omitted tones.

04

朗读Speak

一键把翻译结果自然地朗读出来。One tap reads the result aloud in a natural voice.

适合谁Who it's for

同一道障碍,为不同的人打通One barrier, removed for everyone

用户Users

视障学生与用户Blind & low-vision users

让你写下的盲文被看见、被听见,也更容易与他人分享。Make the braille you write seen, heard, and easy to share with anyone.

教育Education

老师与家长Educators & families

批改盲文作业、核对盲文考卷,即使你自己不懂盲文。Grade braille homework and check exams, even if you don't read braille yourself.

研究Research

研究者与开发者Researchers & developers

开放的盲文-中文语料、模型与端到端代码,欢迎在此之上继续研究。An open braille-Chinese corpus, model, and end-to-end code to build on.

对许多视障学生来说,盲文是他们书写世界的方式,可明眼的老师往往读不懂。点读通,想让这道墙消失。 For many students with visual impairments, braille is how they write the world. Their sighted teachers often can't read it. Vision-Braille exists to take that wall down.

背后的研究The research behind it

用课程学习攻克声调省略Curriculum learning for tone omission

Vision-Braille: A Curriculum Learning Toolkit and Braille-Chinese Corpus for Braille Translation
作者信息在匿名评审期间暂不公开。Author information is withheld during anonymous review.

中文盲文常省略声调,使翻译格外困难。我们构建了盲文-中文语料库,并用四阶段课程学习,逐步教会模型在缺少声调时也能准确还原文字。 Chinese braille routinely omits tones, which makes translation hard. We built a braille-Chinese corpus and used a four-stage curriculum to teach the model to recover text even when tones are missing.

83.28
BLEU · 段落级BLEU · passage-level

致谢Acknowledgments

感谢每一位同行者With thanks to everyone who made this possible

为满足匿名评审要求,致谢名单、合作机构与资助信息暂不公开,将在评审结束后补充。

To comply with anonymous review, the acknowledgments, partner institutions, and funding information are temporarily hidden and will be restored after the review period.

现在就试试看See it for yourself

上传一张中文盲文照片,几秒钟就能得到文字和朗读。Upload one photo of Chinese braille and get text and audio in seconds.

上传盲文照片Upload a braille photo

更新日志Changelog