Rewind

Rewind

HackMIT 2024 — Intersystems AI Challenge 3rd Place

A memory preservation web app for Apple Vision Pro.

Key Features

  • • Store and revisit memories in multiple formats (video, photos, text, audio)
  • • Natural language search for memory retrieval
  • • 3D scene generation using Gaussian splatting
  • • WebXR integration for immersive memory viewing

Overview

Rewind Apple Vision Pro User Interface
Apple Vision Pro user interface for memory browsing

Intelligent Memory Retrieval & Interaction

Rewind leveraged InterSystems IRIS Vector Search to allow users to search for memories based on keywords, dates, or people. With langchain integration, the search accuracy continuously improves by adapting to user behavior and preferences.


The application features a user-friendly timeline navigation system that simplifies memory browsing. Additionally, archive sharing makes it easy to share a user's memory archive, fostering a shared interactive experience.

Rewind 3D Splat Reconstruction
3D Gaussian splat viewed in Apple Vision Pro

3D Scene Generation

Users can upload videos, and through Gaussian splatting, Rewind generated interactive 3D scenes available for immersive AR exploration via Apple Vision Pro or through the web interface.


By transforming 2D video sequences into spatial 3D splats, the system creates interactive environments that can be explored from any angle, preserving physical contexts alongside virtual elements.

Rewind 3D Scene Generation Pipeline - From 2D video capture to 3D scene generation and Apple Vision Pro immersive mode
3D scene generation pipeline: video capture → Gaussian splatting → immersive AR
HackMIT 3rd Place Winner Certificate - PneumoAssist AI & Rewind
HackMIT 2024 — InterSystems AI Challenge 3rd Place
Rewind Example Scene Reconstructed
Example reconstructed 3D scene