Liao Yuan-Hong

About me

I am an undergraduate research student at National Tsing Hua University, majoring in Electrical Engineering. Though most of the lectures I took is EE-related, I’ve learned much more in my project. My research interest is to combine the different modality(including natural language and control signal) with visual representation via machine learning. I’m also interested in reinforcement learning, and aspire to utilize the visual signal to build a better control and planning agent.

So far, I've been conducting research on image detection, image captioning, visual question answering, etc. My advisor is Prof. Min Sun. Learn more in the Research Background[PDF]

I love to share my work and thought to others, so I have a blog on this website. To share some open source and notes.

My CV [PDF], last updated March 2017.


Leveraging Video Descriptions to Learn Video Question Answering
[project page] [dataset]
Kuo-Hao Zeng, Tseng-Hung Chen, Ching-Yao Chuang, Yuan-Hong Liao, Juan Carlos Niebles, Min Sun
AAAI, 2017

Tactics for Adversarial Attack on Deep Reinforcement Learning Agents  [Project Website]
Yen-Chen Lin, Zhang-Wei Hong, Yuan-Hong Liao, Meng-Li Shih, Ming-Yu Liu, Min Sun
IJCAI 2017 (shorter version accepted by ICLR 2017 workshop)

Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner  [Project Website]
Tseng-Hung Chen, Yuan-Hong Liao, Ching-Yao Chuang, Wan-Ting Hsu, Jianlong Fu, Min Sun


National Tsing Hua University
Electrical Engineering, B.S. Degree • Sep. 2013 – Present
National Tsing Hua University is a research university located in Hsinchu City, Taiwan. NTHU is generally considered to be one of the best universities in Taiwan.

Working Experience

Vision Science Lab in National Tsing Hua University
Research Assistant • Dec. 2015 – Present
I focus on combining multi-modal learning, especially in vision and language. I've done several works on image captioning and visual question answering.

Computational Intelligence Technology Center in Industrial Technology Research Institute(ITRI)
Research Intern • Mar. 2016 – Present
I do the reserch on deep reinforcement learning and present to our panel in ITRI. I have a repo for the survey on deep RL.

Umbo Computer Vision Inc.
Research Intern • Jun. 2016 – Sept. 2016
I work on grounding via natural language with my mentor, Tingfan Wu. I focus on combing vision and language, and do some data analysis.

Last updated: 18 Mar 2017