拍照Photograph
用手机对着盲文页面拍一张照片。Snap a photo of the braille page with any phone.
首个公开的中文盲文翻译系统The first public Chinese braille translator
拍下盲文，读懂中文。
Photograph braille.
Read Chinese.
一张手机照片，点读通就能识别中文盲文、翻译成文字并朗读出来，让明眼的老师和家长也能读懂盲文作业。 From one phone photo, Vision-Braille reads Chinese braille, turns it into text, and speaks it aloud, so sighted teachers and families can understand braille homework.
免费Free 任意手机照片any phone photo 无需安装nothing to install
盲文照片Braille photo
识别与翻译Recognized & translated
工作原理How it works
四步，从盲文到声音Four steps, from dots to voice
识别Recognize
OCR 定位并读取页面上每一个盲文点位。Our OCR locates and reads every dot on the page.
翻译Translate
微调的大模型把盲文还原成中文，并补回省略的声调。A fine-tuned model restores Chinese, filling in omitted tones.
朗读Speak
一键把翻译结果自然地朗读出来。One tap reads the result aloud in a natural voice.
适合谁Who it's for
同一道障碍，为不同的人打通One barrier, removed for everyone
视障学生与用户Blind & low-vision users
让你写下的盲文被看见、被听见，也更容易与他人分享。Make the braille you write seen, heard, and easy to share with anyone.
老师与家长Educators & families
批改盲文作业、核对盲文考卷，即使你自己不懂盲文。Grade braille homework and check exams, even if you don't read braille yourself.
研究者与开发者Researchers & developers
开放的盲文-中文语料、模型与端到端代码，欢迎在此之上继续研究。An open braille-Chinese corpus, model, and end-to-end code to build on.
对许多视障学生来说，盲文是他们书写世界的方式，可明眼的老师往往读不懂。点读通，想让这道墙消失。 For many students with visual impairments, braille is how they write the world. Their sighted teachers often can't read it. Vision-Braille exists to take that wall down.
背后的研究The research behind it
用课程学习攻克声调省略Curriculum learning for tone omission
Vision-Braille: A Curriculum Learning Toolkit and Braille-Chinese Corpus for Braille Translation
1北京大学 计算机学院 多媒体信息处理国家重点实验室 · PKU-Anker LLM Lab 2康奈尔大学 农业与生命科学学院 3加州大学洛杉矶分校 计算机科学系
1State Key Laboratory for Multimedia Information Processing, School of Computer Science, PKU-Anker LLM Lab, Peking University 2College of Agriculture and Life Sciences, Cornell University 3Computer Science Department, University of California, Los Angeles
中文盲文常省略声调，使翻译格外困难。我们构建了盲文-中文语料库，并用四阶段课程学习，逐步教会模型在缺少声调时也能准确还原文字。 Chinese braille routinely omits tones, which makes translation hard. We built a braille-Chinese corpus and used a four-stage curriculum to teach the model to recover text even when tones are missing.
83.28
BLEU · 段落级BLEU · passage-level
致谢Acknowledgments
感谢每一位同行者With thanks to everyone who made this possible
感谢兰州大学苏伟老师、中国盲文在线平台、中国科学院计算技术研究所刘宏老师，以及北京市盲人学校，在数据与专业知识方面给予的支持。
We thank Su Wei (Lanzhou University), the Braille online platform of China, Liu Hong (Institute of Computing Technology, Chinese Academy of Sciences), and the Beijing School for the Blind for their support with data and domain expertise.
也感谢知乎网友 @风之轨迹、河南推拿职业学院，以及所有在线参与的朋友，他们对网站与模型输出提出了宝贵的反馈意见。
We also thank Zhihu user @风之轨迹, Henan Vocational College of Tuina (河南推拿职业学院), and the online participants who gave us valuable feedback on the websites and model outputs.
本研究部分受国家重点研发计划资助，项目编号 2023YFC3341203。
This work is partially supported by grants from the National Key Research and Development Program of China, Grant No. 2023YFC3341203.
现在就试试看See it for yourself
上传一张中文盲文照片，几秒钟就能得到文字和朗读。Upload one photo of Chinese braille and get text and audio in seconds.
上传盲文照片Upload a braille photo