PP's RESEARCH

Websockets & Networking in MAgic Leap 참고자료 1: https://forum.magicleap.com/hc/en-us/community/posts/360023794311-WebSockets-in-Unity?page=1#community_comment_360004665432 참고자료 2: https://medium.com/@sairao1996/solving-websockets-networking-issues-in-magic-leap-unity3d-4d3b2196dff2 UDP socket  Around early August last year Magic Leap One : Creator edition was finally announced. Offering a better field of view, larger compute(because of the Lightpack) and a handy controller with 6DoF tracking, it opened avenue for a large number of applications. Since I have been working at company in San Francisco ( one of the first 6 cities to which magic leap provided shipping), I was lucky enough to test one of these early on when the company bought couple of them. When I started developing applications on it as part of my work, one of the challenges I faced was to get networking and websockets working. The main issue was that everything seemed to work well in Zero Iteration but when I deploye...

  1. WebRTC :  WebRTC (Web Real-Time Communication) is a technology which enables applications to capture and optionally stream audio and/or video media, as well as to exchange arbitrary data between apps without requiring an intermediary. The set of standards that comprise WebRTC makes it possible to share data and perform teleconferencing peer-to-peer, without requiring that the user install plug-ins or any other third-party software. WebRTC는 앱에서 audio, video를 캡쳐하거나 스트림할 수 있도록 하고, 두 앱 사이에서의 데이터 교환을 돕는 기술이다. WebRTC의 구성요소는 데이터를 공유하고 유저 간의 플러그인이나 다른 소프트웨어 없이 영상통화, p2p를 가능하게 한다.  근데 2020.2를 사용해야 하고 MLSDK는 0.25.0을 사용해야 한다고 한다.  2. Content Persistence : Local 1. Attach digital content to the real world  2. persist digital content when you close an app or reboot ML1 3. Share spatialized digital content with other users and devices 3. Transmission Transmission  is a cross-platform solution for connecting devices over a local area network (LAN). Add Transmission t...

 https://link.springer.com/chapter/10.1007/978-3-030-28619-4_26 pringer Proceedings in Advanced Robotics  book series Communicating Robot Arm Motion Intent Through Mixed Reality Head-Mounted Displays Efficient motion intent communication is necessary for safe and collaborative work environments with collocated humans and robots. Humans efficiently communicate their motion intent to other humans through gestures, gaze, and social cues. However, robots often have difficulty efficiently communicating their motion intent to humans via these methods. Many existing methods for robot motion intent communication rely on 2D displays, which require the human to continually pause their work and check a visualization. We propose a mixed reality head-mounted display visualization of the proposed robot motion over the wearer’s real-world view of the robot and its environment. To evaluate the effectiveness of this system against a 2D display visualization and against no visualization, we ask...

 journals from IEEE Transactions on Visualization and Computer Graphics #1. https://ieeexplore.ieee.org/document/9222325 CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization Deep learning's great success motivates many practitioners and students to learn about this exciting technology. However, it is often challenging for beginners to take their first step due to the complexity of understanding and applying deep learning. We present CNN Explainer, an interactive visualization tool designed for non-experts to learn and examine convolutional neural networks (CNNs), a foundational deep learning model architecture. Our tool addresses key challenges that novices face while learning about CNNs, which we identify from interviews with instructors and a survey with past students. CNN Explainer tightly integrates a model overview that summarizes a CNN's structure, and on-demand, dynamic visual explanation views that help users understand the underlying com...