Application Design & AR & LLM Application

INTRODUCTION

This project focuses on how to enhance outdoor learning experience. We aim to infuse culture knowledge into nature learning by using Chinese cultural symbols as AR elements that bridge the abstract with the concrete. Based on formative studies, we formed our design ideas by three storyboards that eventually turned into three AR demos in Lens Studios. Then, we concluded 6 findings based on testing process.

TEAM

A project manager

A visual designer

An interaction design

MY ROLE

Interaction Designer

TIMELINE

May. 2023- Sep. 2023

CLIENT

Research Project

OVERVIEW

What is the problem?

In modern society, the pace of life is fast, parents are under great pressure from work, and children have less and less time to live in the city, so the demand for parent-child natural education is increasing. In the meantime, Chinese culture boasts a complex and rich system of symbols that are instructional to children. An interactive solution to connect nature with culture is currently lacking.

What is the solution?

Based on constructivism, we use three AR demos that focus on different stages of the 5E instructional model to enhance outdoor learning experience. MagicCritter Lens is used to augment exploration, AquaView Explorer is used to augment explanation, and WonderFlora Box is used to augment extension.

DISCOVER

In the post-epidemic era, the problem of smell has gradually become prominent ···

Define

Formative Study

How might we harness the characteristics of emerging technologies to enhance the interactive experience between nature, children, parents, and culture?

DeVOLOP

The design concept is shown in the following graphs.

Storyboard

We brainstormed by drawing a story board and finally selected three interaction flows from 20 alternatives for further design.

DeLIVER

Interactive gestures and three design demos are shown below.

Technical Implementation

The system algorithm design mainly includes a cultural image dataset and recognition algorithm in Lens Studios.

Evaluation

Then, we recruited 20 groups of subjects in Zijingang Campus of Zhejiang University, including 20 parents and 20 children, to conduct prototype tests and semi-structured interviews to explore the effects of AR demo and Outdoor learning.

PROJECT VIDEO

This is an introduction video of our design project.

Thank you so much for your time :) I’d love to chat! Say “hello” to my email.

Copyright @ 2024 Mary Xu. All rights reserved.