中文标题#
时空混合和增强现实体验描述用于交互式回放
英文标题#
Spatio-Temporal Mixed and Augmented Reality Experience Description for Interactive Playback
中文摘要#
我们提出了时空混合增强现实体验描述（MAR-ED），这是一种新的框架，用于标准化过去事件的表示，以便在用户当前的物理空间中进行交互和自适应播放。 尽管当前的空间媒体技术主要专注于将内容作为静态资产进行捕获或回放，通常与观看者的环境脱节或提供有限的交互性，但描述体验底层语义和交互结构的方法仍缺乏深入研究。 我们提出了一种称为 MAR-ED 的描述框架，该框架基于三个核心原语：1）事件原语用于语义场景图表示，2）关键帧原语用于高效且有意义的数据访问，以及 3）播放原语用于用户驱动的自适应交互式播放记录的 MAR 体验。 所提出的 MAR-ED 框架的三阶段过程的流程图在播放期间将记录的体验转换为独特的自适应 MAR 体验，其中其时空结构动态适应新环境，其叙述可以通过实时用户输入进行更改。 基于此框架，个人数字记忆和记录的事件可以超越被动的 2D/3D 视频，进入沉浸式的、空间集成的群体体验，为培训、文化遗产和互动叙事开辟新的范式，而无需复杂的、针对每个用户的自适应渲染。
英文摘要#
We propose the Spatio-Temporal Mixed and Augmented Reality Experience Description (MAR-ED), a novel framework to standardize the representation of past events for interactive and adaptive playback in a user's present physical space. While current spatial media technologies have primarily focused on capturing or replaying content as static assets, often disconnected from the viewer's environment or offering limited interactivity, the means to describe an experience's underlying semantic and interactive structure remains underexplored. We propose a descriptive framework called MAR-ED based on three core primitives: 1) Event Primitives for semantic scene graph representation, 2) Keyframe Primitives for efficient and meaningful data access, and 3) Playback Primitives for user-driven adaptive interactive playback of recorded MAR experience. The proposed flowchart of the three-stage process of the proposed MAR-ED framework transforms a recorded experience into a unique adaptive MAR experience during playback, where its spatio-temporal structure dynamically conforms to a new environment and its narrative can be altered by live user input. Drawing on this framework, personal digital memories and recorded events can evolve beyond passive 2D/3D videos into immersive, spatially-integrated group experiences, opening new paradigms for training, cultural heritage, and interactive storytelling without requiring complex, per-user adaptive rendering.
文章页面#
PDF 获取#
抖音扫码查看更多精彩内容