I recently graduated from the Master's program in the Department of Computer Science at National Taiwan University in June 2023.
Throughout my academic journey, I have specialized in computer vision algorithms and machine learning research,
conducting research at the Digital Camera and Computer Vision Laboratory.
Previously, I interned at MediCapture.
I am actively contributing to the development of image processing algorithms for orthopedic surgeries and ophthalmic surgeries,
gaining valuable industry experience.
With my foundation and experience in computer vision and deep learning,
I am actively seeking for an opportunity where I can use my skills to take on the position of a
software engineer.
MediCapture Software Engineer Intern
National Taiwan University M.S. in CSIE
Yuan-Ze University B.S. in EE
News
[07/2023] One paper accepted at CVGIP'23.
[01/2023] Start my software engineer internship at MediCapture.
[04/2022] One paper accepted at ITAOI'22. (Best Paper Award)
In this paper, we propose LinAlign: a computer vision algorithm for aligning X-ray images before and after surgery,
providing a system for surgeons to compare images before and after surgery more efficiently and replace manually aligning procedure.
LinAlign allows only align specific area when aligning images, and solve the problem that linear transformation cannot be performed
on non-rigid objects. Therefore, it is suitable for comparing the position of bones during the hip replacement surgery,
allowing orthopedic surgeons to make sure that implants have been installed correctly.
In our experiment, we took the X-ray images of the pelvis as our experimental data: each set of images contains the X-ray
photographs of the same patient taken at different times. We experiment with different methods. By comparing similar features
between images and calculating the displacement of these feature points, the images can be aligned.
We evaluate the performance of the algorithm by the error of pre-defined landmarks after alignment. These landmarks are
anatomically important features of the skeletal system. The goal of our experiment is to minimize the distance of landmarks
between image pair. We take the mean square error of these landmark distances as the performance metric to our algorithm.
Detection of Operators’ Inspection Quality in Car Factory. Cheng-Wei Lin and Chiou-Shann Fuh
ITAOI 2022 (Best Paper Award)
In this paper, we propose a computer vision, image processing, and automatic optical inspection solution to detect
operator motion and quality assurance in the car factory. Our goal is to create a system to check the operators have
inspected all inspection points on each car.
We set up two cameras on both sides of production line to detect car and operator locations. Inspection points defined
by car factory are mapped onto the car. Initially, these points are uninspected and marked by gray. When the operator’s
glove touches the inspection point, the inspected points are changed into green as inspected. After the car passes
through the inspected area, we save inspection result, and inspect next car.
Deep learning and image processing algorithm are used in our system. We first use object detection algorithm to detect
the wheel and map inspection points onto the car by relative position to wheels. Then, we find the operator by pose
estimation algorithm, Blazepose. When the glove touches inspection point, then that point will be recorded as inspected
(changed from gray to green).
Projects
Toric IOL Implant Digital Alignment (TIOLIDA)
This project is proposed by Bausch + Lomb for cataract surgery requirement.
We augment graphic overlay over the live video of an eye from the surgical microscope to assist the surgeon with
the alignment of the toric intraocular lens implant.
Accurate alignment of lens implant is a prerequisite for achieving optimal visual outcome.
With the assist of our system, surgeons can be more precise during the operation, and reduce the risk of astigmatism.
Automatic Image Alignment for Total Hip Arthroplasty
Proposed an automatic image alignment algorithm for images taken before and during Total Hip Arthroplasty.
Deploy our algorithm as desktop application and web application to make our system easy to use at clinic.
| video |
Object Detection on UAV images
Detect and recognize the tiny objects on aerial images in different scenarios.
We took YOLOv7 as our model, and imporoved the performance with additional detection head and attentional modules.
| code |
pdf |
Speed Estimation using Optical Flow
With dashcam recoreded videos, we proposed a method to estimate the vehicle speed using optical flow model and
CNN based speed estimater. For a video or live stream, we first compute its optical flow for each consecutive frames,
and predict the speed with a deep neural network.
| video |
code |
pdf |
Training with Noisy Labeled Dataset
In this project, we survey some common
techniques of noisy training and present a framework that combines multi-round
training and label refurbishment. We showed that our method outperform the
normal training process. In the two-class classification problem, even when 40%
of the data is mislabeled, our model still gets an accuracy of 85%.
|
code |
pdf |
Object Detection and Recognition with Its Application to Smart Homecare
This is a Collaboration Project with Industrial Technology Research Institute (ITRI) and Taipei Veterans General Hospital (TVGH).
We designed the real-time recognition system (OD-RASH) to obtain blood pressure values and emergency notifications.
To evaluate the accuracy of numerical identification, we simulate all the scenarios that will be encountered when shooting
blood pressure monitor images for testing, and achieve to 99.8% accuracy.
| video |
code |
pdf |