How to design Immersive Experiences for Apple Vision Pro with Our Avatars

Design Immersives Experience For Apple Vision Pro

Explore how integrating our avatar with Apple Vision Pro redefines virtual presence and interactions, opening doors to endless possibilities

In the ever-evolving world of technology, the fusion of our daily lives with digital elements has reached a new pinnacle with Apple Vision Pro – a breakthrough in spatial computing that blurs the lines between the real and the virtual. As we stand on the brink of this new era, our avatar maker’s integration into Apple Vision Pro opens up a universe of commercial possibilities, redefining how we interact, work, and entertain in digital realms.

This blog post delves into the synergistic potential of merging personalized avatars with the unparalleled immersive experience offered by Apple Vision Pro, setting a new standard for digital interaction. Stay tuned as we explore the step-by-step guide to integrating our avatar maker, promising to enhance your virtual presence and revolutionize the way we perceive and engage with the world around us.

Requirements

To embark on building for the Vision Pro device, ensure you’re equipped with the following:

  • Hardware Requirement: Own an Apple silicon Mac (M1 or newer) for compiling applications aimed at visionOS.
  • Xcode Version: Ensure you have Xcode version 15.2 or newer installed. Guidance on installation and setup will be provided in the following steps.
  • Unity Version: Use Unity version 2022.3 (LTS) or later, necessary for leveraging Unity PolySpatial and its support for visionOS. Instructions for setting up both the editor and the package will be discussed.
  • Unity Pro Subscription: Unity Pro is a prerequisite for accessing the PolySpatial package. For those without a subscription, a 30-day free trial is available through the Unity Pro page, which we’ll navigate you to.

1. Create your avatar in Vision OS

Createavatar 1
  • Create your avatar
Createavatar 2
Create avatar

2. How to install and setup XCode

  • Install XCode from the App Store
  • Open XCode
  • Open settings from the top bar
installing XCode from App Store
  • Go to platforms and get the latest visionOS release
VisionOS release in XCode from Apple

3. Install Unity 2022 and VisionOs modules

install unity 2022
  • During the installation, check the iOS Build Support and the visionOS Build Support
selection of the ios build support and visionos build support

4. Setup the Unity Project

  • Create a new URP 3D project
create a 3d URP project in Unity

Go to File > Build Settings

  1. Select VisionOS and press Switch Platform
  2. Check the Target SDK to Simulator SDK (only for development)
  3. Check the Development Build setting (only for development)
set the build settings

Go to Window > Package Manager. Add the following packages by name:

  1. com.unity.polyspatial.xr
  2. com.unity.polyspatial.visionos
  3. com.unity.polyspatial
  4. com.unity.cloud.gltfast
add package manager

When asked about enabling the backends, press Yes

enabling backends

Select the PolySpatial package, go to Samples and import the Unity PolySpatial Samples.

Import Unity PolySpatial Samples

Go to Edit > Project Settings > XR Plug-in Management and enable the Apple visionOS plugin provider for the Vision Pro platform.

enable xr-plugin management

Now go to Project Validation and press Fix All. There might be some problems that require manual input, make sure to go over them and fix each one following the instructions.

Project Validation

Go to Apple visionOS and change the App Mode to Mixed Reality.

Apple visionOS mixed reality

Lastly, you might encounter some build problems because of the microphone access. To solve them, go to Project Settings > Player and scroll down to Microphone Usage Description. Make sure the field is not empty.

5. Testing the PolySpatial sample

Go to your assets folder and open the Manipulation sample scene. You will find it under Samples/PolySpatial/Scenes.

testing the polyspatial sample

Go to Build Settings and press Add Open Scenes, to make sure the sample scene is included in the build. Then press the Build button.

build settings in scene build

Once the XCode project is built, open it in XCode and press Run. A build process will start and once it is finished you should see the simulator pop up with the project we just built. You can move around and interact with the scene.

Run the Xcode project

6. Adding the avatar to the project

Go to www.unionavatars.com in your browser and login. Then select the avatar you previously created and press Download GLB.

Download Avatar Glb

Drag and drop the downloaded file into your Unity project. Create a new folder called “Avatar” to keep it organized.

bring the avatar to Unity Project

Now you can drag and drop your avatar into your scene and position it as you want. However, we are not done yet. Due to some lack of support for visionOS for GLTF materials, we will need to update them manually. This might change in the future as new releases get posted, but for now this is required.

drag a drop the avatar to the scene

Right-click in your assets folder and create a new material. We will call it “Face”. Make sure the material shader is “Universal Render Pipeline / Lit”.

create a new material for the avatar texture

Press the un-fold button in the avatar asset and you will see all the textures used by the avatar. Find the face texture and drag it to the Base Map in the material you just created.

base map texture

Do the same for the rest of the objects of the avatar. Most of the times the avatar contains the following materials:

  • Head / Face
  • Hair
  • Body
  • Top
  • Bottom
  • Shoes

Sometimes an avatar might contain one or two additional materials. Also, some of the materials contain Normal Maps that you can add to increase the details. Lastly, you can tweak the Smoothness parameter of the materials to make them look more realistic.

Drag and drop the materials you created to the model in your scene:

add the materials to the model avatar

Build the project again and run it. You will see your avatar in Mixed Reality!

see the avatar in mixed reality

Most Popular

Get The Latest Updates

Subscribe To Our Monthly Newsletter

No spam, notifications only about new products, updates.

Categories

The Future Begins With You

Open up to a realm of new possibilities with Union Avatars

Ua-2
EN_Funded_by_the_European_Union_RGB_WHITE
plan de recuperación logo
18367_214214202211593-1-1024x190

Subvencionado por el CDTI

Logo Maetd White

Financiado por el Ministerio de Asuntos Económicos y Transformación Digital

Proyecto FAV-010100-2022-21 financiado por

Mtdfp Bis Gob 1
logo 4yfn startup awards
Award Best Phygital Experience Union Avatars
logo forbes spanish company changing the world
logo cuatrecasas acelera

© 2024 · Union Avatars