iOS 空间视频和空间照片的生成和转换

type
status
date
slug
summary
tags
category
icon
password
最近研究了一下如何生成和解析空间照片和空间视频，相关资料也比较少，目前 Appstore 上相关功能的 app 还挺贵的，我把搜集到的资料整理到一起，方便查阅和学习。
 
notion image
 

空间照片

  • 解析 Apple Vision Pro 空间图片格式
解析 Apple Vision Pro 空间图片格式
Apple Vision Pro 支持的空间照片是以 HEIF 格式存储的图像序列（两张左右视差图像），这也是 iPhone 自 2017 年开始采用的照片格式
解析 Apple Vision Pro 空间图片格式
https://mp.weixin.qq.com/s?__biz=MzI0NjIxMzE5OQ==&mid=2656698906&idx=1&sn=c1d840077183e74264cf695f70fd3125&scene=19#wechat_redirect
解析 Apple Vision Pro 空间图片格式
 
  • 使用图像 I/O 读取和写入空间照片
Reading and Writing Spatial Photos with Image I/O
This is a follow up to my previous post on Reading and Writing Spatial Video with AVFoundation.
Reading and Writing Spatial Photos with Image I/O
https://www.finnvoorhees.com/words/reading-and-writing-spatial-photos-with-image-io
Reading and Writing Spatial Photos with Image I/O
 

空间视频

  • 解码 Vision Pro 空间视频格式 MV-HEVC
解码 Vision Pro 空间视频格式 MV-HEVC
本文主要总结记录了使用苹果官方 SDK （Video Toolbox）对 iPhone 和 Vision Pro 支持的空间视频格式进行编解码操作的方法。
解码 Vision Pro 空间视频格式 MV-HEVC
https://mp.weixin.qq.com/s?__biz=MzI0NjIxMzE5OQ==&mid=2656699085&idx=1&sn=eef35cac12efd3b90511bc536d10efb8&chksm=f2ec1dedc59b94fb39106238f36460c5224aa476dfb8d77fcd0266da5025d90a98867cd0dc21&token=1303726531&lang=zh_CN#rd
解码 Vision Pro 空间视频格式 MV-HEVC
 
  • 使用 AVFoundation 读写空间视频
Reading and Writing Spatial Video with AVFoundation
If you’ve worked with AVFoundation’s APIs, you’ll be familiar with CVPixelBuffer, an object which represents a single video frame. AVFoundation manages the tasks of reading, writing, and playing video frames, but the process changes when dealing with spatial video (aka MV-HEVC), which features video from two separate angles.
Reading and Writing Spatial Video with AVFoundation
https://www.finnvoorhees.com/words/reading-and-writing-spatial-video-with-avfoundation
Reading and Writing Spatial Video with AVFoundation
 
  • 从空间视频提取多视图视频
Reading multiview 3D video files | Apple Developer Documentation
Render single images for the left eye and right eye from a multiview High Efficiency Video Coding format file by reading individual video frames.
Reading multiview 3D video files | Apple Developer Documentation
https://developer.apple.com/documentation/avfoundation/media_reading_and_writing/reading_multiview_3d_video_files
Reading multiview 3D video files | Apple Developer Documentation
 
  • 将并排视频转换为空间视频 HEVC
Converting side-by-side 3D video to multiview HEVC | Apple Developer Documentation
Create video content for visionOS by converting an existing 3D HEVC file to a multiview HEVC format.
Converting side-by-side 3D video to multiview HEVC | Apple Developer Documentation
https://developer.apple.com/documentation/avfoundation/media_reading_and_writing/converting_side-by-side_3d_video_to_multiview_hevc
Converting side-by-side 3D video to multiview HEVC | Apple Developer Documentation
 
  • 在线将 2D 视频转换为空间视频
Depthify.ai
Convert 2D RGB Photos and Videos to 3D Spatial Photos and Videos for Apple Vision Pro.
Depthify.ai
https://www.depthify.ai/
Depthify.ai
 
 
notion image
  • 📕 小红书/即刻：@轻舟
  • ☕ 如果我的内容有帮助到你，可以请我喝杯咖啡，这将鼓励我为你创造更多有价值的内容。
Buy Me A Coffee
  • Giscus

© 轻舟 2017-2024