Zooey He

Zhuohong (Zooey) He

I am a computer vision researcher at Intuitive Surgical.
Previously, I was a researcher at Johns Hopkins University where I was advised by Dr. Gregory Hager and Dr. Russell Taylor.

News

[11.28.2022] I presented my first first-author publication, An Empirical Study on Activity Recognition in Long Surgical Videos at the Machine Learning for Health (ML4H) symposium.

Research Interests

I enjoy working on medical AI projects which leverage multi-modal data to enhance the decisions of medical professionals. My past projects are focused on activity detection from operating room videos and the automation of medical processes. I am interested in medical image & video summarization, 3D reconstruction & understanding, and natural language processing of unstructured medical text.

My goal is to expand the capability of medical AI while making contributions to the general machine learning knowledge.

Education

Johns Hopkins University, 2020 – 2021
M.S.E Robotics, Perception and Cognitive Systems Track

Johns Hopkins University, 2016 – 2020
B.S. Mechanical Engineering, Computer Science Minor

Publications

An Empirical Study on Activity Recognition in Long Surgical Videos
Zhuohong He, Ali Mottaghi, Aidean Sharghi, Muhammad Abdullah Jamal, Omid Mohareri, Machine Learning for Health (ML4H), 2022
[paper][poster]

Guiding Multi-Step Rearrangement Tasks with Natural Language Instructions
Elias Stengel-Eskin, Andrew Hundt, Zhuohong He, Aditya Murali, Nakul Gopalan, Matthew Gombolay, Gregory Hager, Conference on Robotic Learning (CoRL), 2022
[paper][code]

*report is not peer reviewed

Progress in development of an automated mosquito salivary gland extractor: A step forward to malaria vaccine mass production
Wanze Li, Zhuqun Zhang, Zhuohong He, Parth Vora, Alan Lai, Balazs Vagvolgyi, Simon Leonard, Anna Goodridge, Iulian Iordachita, Sumana Chakravarty, Kim Lee Sim, Stephen L. Hoffman, Russell H. Taylor, Conference on Automation Science and Engineering (CASE), 2021
[paper][report]*

Automated mosquito salivary gland extractor for PfSPZ-based malaria vaccine production
Wanze Li, Zhuohong He, Parth Vora, Yanzhou Wang, Balazs Vagvolgyi, Simon Leonard, Anna Goodridge, Iulian Iordachita, Stephen L. Hoffman, Sumana Chakravarty, Russell H. Taylor IEEE International Conference on Robotics and Automation (ICRA), 2021
[paper]

Teaching

[EN.530.646] Robot Dynamics, Kinematics, Devices, and Control at Johns Hopkins (2022) – Teaching Assistant for Dr. Jin Seob Kim
[EN.171.103] General Physics I: Mechanics at Johns Hopkins (2019) – Teaching Assistant
[EN.171.108] General Physics II: Electricity & Magnetism at Johns Hopkins (2017-18) – Teaching Assistant
Competition Math Course at Northampton Community College (2015-16) – Head Teacher

Other Projects & Experience

Multi-Task Learning: Depth Estimation

Improved monocular depth estimation results by simultaneously training two heads, one for depth estimation and one for instance segmentation.
[report][code]

Internship @ Volvo : Repair Stall IoT

Developed an internet of things system to tracking the progress and status of repairs stalls on the Volvo Trucks production line as part of a summer internship.
[more][code]

Internship @ Artskills: Virtual Shopper

Developed a website to recreate the in-store shopping experience online using 360-deg views.
[demo]

Internship @ Bosch: Parallel Robot Control

Developed a hexapod parallel manipulator robot capable of reproducing real vibration frequencies for dampener testing on security cameras. Completed project for client Bosch Security Systems.
[more]

Course Projects

I worked on several projects for my courses covering ROS, Matlab, machine learning, and other areas.
[more]

Other Interests: In my free time, I enjoy playing soccer & tennis, traveling, and cooking. Since I moved to the Bay Area, I have also picked up surfing 🙂