Re-imaging Collaboration with AR+AI
Spatial Computing for the space, not for the face.
Context
01
SpatialPixel x Penn IPD
This is a capstone project at the University of Pennsylvania’s Integrated Product Design program, our team of four students partnered with Spatial Pixel, a pioneering company in the field of Artificial Intelligence in spatial computing. Together, we explored how Spatial Pixel’s innovative platform, Procession, could empower creative teams to enhance and streamline collaborative workflows. Through research, prototyping, and testing, our project investigated the potential of Procession to augment team-based design processes and help creative professionals level up their work in makerspaces and studio environments.
Info
02
Project Topics:
-
Spatial Computing
-
Augmented Reality
-
GenAI
​
Contributions:
-
Research
-
Design Strategy
-
Spatial Wizarding
-
Video Creation
Timeline:
2025 March - 2021 May
3 months
Impact:
Client has implemented the template tool we developed into their technology
Client
03
Who's Spatial Pixel?
Spatial Pixel is a creative technology company focused on developing tools that enable designers, artists, and educators to create interactive, real-world experiences using natural language and mixed reality interfaces.
Founders
of Spatial Pixel
Violet Whitney
William Martin
What is Procession?
Procession is Spatial Pixel’s flagship platform—an open, natural language programming environment designed to make spatial computing more accessible. It allows users to build interactive installations and prototypes using:
-
Mixed reality (AR/VR)
-
Voice and gesture recognition
-
Sensors and actuators
-
Physical computing elements
The system is inspired by open-source platforms like Arduino and Processing, with the goal of making spatial programming more physical, communal, and intuitive.
What are some ‘killer use cases” for procession, specifically in creative makerspace/studio environments where a lot of collaboration happens?
Client's Needs
Challenge
Right off the bat, we faced the challenge...
We faced an immediate challenge at the start of the project: working with a completely new and emerging technology. Because Procession is not meant to replace or redesign an existing tool, there was little precedent or documentation available to guide us. Much of our work centered on exploring potential applications and uncovering user perceptions, often without the benefit of established user feedback or market expectations. It was both an exciting and uncertain journey of defining how a novel technology could meaningfully integrate into creative team workflows.
Embrace Ambiguity
04
Observing, Testing, and Iterating
How we approached the ambiguity
4 in-depth interviews
1 group interview with 7 professionals
4 intercept interviews
3 Co-design
observations
Insights
How do people interact with Procession?
Insight 1
Physical brainstorming is fast, intuitive and crucial for a project, but it is hard to make sure everyone is on the same page, and the results/insights get properly captured
Insight 2
The biggest part of collaboration is communication, with classmates/colleagues but also users, stakeholders, and professors.
Use Case 1/3
Real Time Visualization
-
Use sketches to create different concepts
-
Explore different iterations in context rapidly
-
Collaborate and decide together using gestures & words
-
Reduce errors in collaboration by visualizing often & fast
Use Case 2/3
AI Spatial Collaborator
-
Gather new insights through computer-human collaboration.
-
Cognitive offloading and let AI organize and summarize data
-
Store specific information using hand gestures.
Use Case 3/3
Syncing Physical with Digital
-
Seamless hybrid gathering connect Physical <-> Digital
-
Higher engagement between the two parties
-
Digitally store & record all the information
Thinking Ahead
To enable the visions, the future of work need
-
Develop Platform that shows specific templates that deliver direct and significant added value to the user
-
Develop more templates based on user’s needs to keep delivering this value
-
Roll out Developer Platform where Power Users can develop & share templates with the community
-
Share success stories through different channels showing how Procession made their workflow better/more efficient