Home » Research
Category Archives: Research
Our NeuroLens project has gained a tremendous amount of publicity in the last two months, presented as a demo at NSF’s congressional showcase at Capitol Hill as a part of NSF Athena AI Institute (left picture), and also at NSF Computing Systems Research (CSR) PI meeting (right picture). In the left picture below, NSF Director Sethuraman Panchanathan is placing a catheter to the brain ventricular system using our AR guidance system, wearing a Microsoft HoloLens 2 (LinkedIn posts about this demo can be found here: NSF’s Post , Dr. Gorlatova’s Post). Very grateful for the opportunity to present our system to a diverse audience at those meetings!
I’ve completed my 14 weeks research internship at Bosch (Pittsburgh, PA) last week. During my internship, I worked on developing an ontology-based digital twin for industrial augmented reality applications. This was a great opportunity and I’m thankful for mentorship received from the RDS team at Bosch.
In the past two weeks, I have given research talks about Augmented Reality in Surgical Applications at the WiSE lab, Prof. Anthony Rowe’s group at CMU (6/15), and Duke’s REU seminar (6/21). The talk covered the development of AR-assisted surgical guidance systems for applications in neurosurgery and ophthalmology.
The demo for Edge-based Augmented Reality Guidance System for Retinal Laser Therapy was presented at IPSN ’23 (co-located with CPS-IoT Week) in San Antonio, Tx. Participants were able to wear our custom ophthalmoscope-integrated AR headset and navigate the retina phantom model with contextual guidance in AR. We had many attendees showing their interest in our work. This news is also featured as a news article on Duke Eye Center’s webpage, https://dukeeyecenter.duke.edu/news/duke-phd-student-presents-research-utilizing-ar-guidance-system-retinal-laser-therapy.
Our work on Augmented Reality for Retinal Laser Therapy was presented during the poster session at ARVO Annual Meeting in New Orleans, LA. We showcased the custom AR headset integrated with the binocular indirect ophthalmoscope and let other ARVO attendees try out our AR app to see the retinal landmark hologram in the view of the ophthalmoscope lens. We are grateful that we received a big interest from both engineers and doctors at ARVO.
I will be joining Bosch Research and Technology Center in Pittsburgh, PA as a PhD research intern to work with the Reliable Distributed Systems group this summer. The group collaborates with Professor Anthony Rowe‘s group at Carnegie Mellon University. I will be working on developing an edge-cloud system infrastructure and applying the architecture to run on Bosch embedded hardware systems that incorporate an AR/VR digital representation and user interface.
A pilot study of the investigation of thermal perception and emotional response in Augmented Reality (AR) using digital biomarkers was virtually presented at the XR for Healthcare and Wellbeing workshop, co-located with IEEE VR 2023. This work is along the line of our goal in enhancing dialectical behavior therapy (DBT) skill exercises with AR. The team will continue analyzing the physiological data collected during the pilot user study, and developing more realistic AR settings in manipulating users’ thermal perceptions for the future user study. The paper can be found here: [Paper]
A demo, AR-magnifier for retinal laser therapy was presented in 2022 ACM SenSys, held in Boston from Nov. 6th to 9th. This works highlights a real-time AR magnification system using sensing and edge computing, collaborated with Duke Ophthalmology. We received a large amount of interest and great feedback from the community. More information about the demo can be found here: [Paper][Video]
Our work on NeuroLens is featured in Duke’s 2022 ECE Magazine as a part of the topics covering the future of the Metaverse. We believe AR/VR/MR plays a crucial role in revolutionizing the medical industries, and it’s wonderful to have our collaborative work with Duke’s School of Medicine acknowledged.
A digital version of the magazine article can be found here: https://magazine.pratt.duke.edu/2022/the-dawning-of-the-age-of-the-metaverse/.