• HCI 2026
Modalverse UI

The Framework for Multimodal UI Design

  • HCI 2026

Project List

GAMAR (FULLY BOOKED)

  • You are an energetic teenager in your prime years. You use your phone to play games like Fortnite or Call of Duty. You use a dedicated app called Gamar to overlay valuable stats and information about your games, including information from other players, the community, news, updates, and more. Moreover, the experience expands as the teenager uses a headset and a smartwatch to view more data and information "around" the device/phone.

  • Design for: Mobile Phone, AR Headset, Smartwatch

ARGO

  • You are a skilled cargo crane operator. You manage and move delicate cargo from the coastal shipyard/naval dock. You use special devices to enhance your day-to-day skills: from a mobile phone to track the crane's status, to an AR headset to visualize points of interest around the dock, to a smartwatch for quick actions. You are an enhanced engineer, updated at a moment's notice, and ready to act when needed.

  • Design for: Mobile Phone, AR Headset, Smartwatch

AR-CHI-TECH

  • You are a senior professional architect who enjoys hands-on work on real estate design projects. This means the architect visits the site frequently and assesses the current progress. With trusty devices such as a powerful smartphone, rugged AR glasses, and a sturdy smartwatch, the architect scans the current site, observes progress, takes notes, marks points of interest, and collaborates with the engineering team.

  • Design for: Mobile Phone, AR Headset, Smartwatch

VENU

  • You are a charismatic, extroverted young adult who enjoys going to music festivals with friends. You do not hesitate and interact with all major company marketing displays, campaigns, or booths. You are helped by your trio combo of devices you bring along: smartphone, AR glasses, and smartwatch. You know where these activations are, access customized, contextual information, interact with your friends, and keep each other updated/tracked within the massive crowd.

  • Design for: Mobile Phone, AR Headset, Smartwatch

MEDICAPP (FULLY BOOKED)

  • You are a highly esteemed doctor who does both consultancies and surgeries. Your tech-savvy nature inspired you to use your smartphone, AR Glasses, and smartwatch in tandem. You check the schedule, analyze medical records, fact-check on the go or on delicate tasks, and interact with hospital staff or even patients before visits, and much more. You are the all-in-one medical performer that interns aspire to be.

  • Design for: Mobile Phone, AR Headset, Smartwatch

FLYAR

  • You are a successful businessperson who is a frequent flyer, taking 60 trips a year. You manage to be efficient thanks to your trusty devices: a smartphone Max Edition, a smartwatch, and AR glasses. You track your check-in, ticket, seat, and access lounge benefits. You take advantage of in-flight information on-screen or out the window. You always know where to go, what's happening, and what the next steps are. You are on the go, but always on top of the situation.

  • Design for: Mobile Phone, AR Headset, Smartwatch

PARENTR

  • You are an overwhelmed parent dealing with the ups and downs of caring for a high-energy toddler. Luckily, a friend introduces you to a new application that will help you out using the smartphone, smartwatch, and AR glasses. The Parent tracks the child's health, nutrition, education, entertainment, and growth in a quick, easy, and interactive way, making caring for children a relief.

  • Design for: Mobile Phone, AR Headset, Smartwatch

F1-PIT

  • You are a member of the pit-stop staff team of a high-profile F1 racing team. You visualize race information, vehicle data, and team communication. Using special AR glasses, you gain complementary insights into the race and the car, helping you complete your tasks even more effectively. At any time, you can jump into the first-person view stream of the racer to check data live. Last but not least, with your smartwatch, your work is even more immersive and transparent to the rest of the team.

  • Design for: Tablet/Mobile Phone, AR Headset, Smartwatch

COACHR (FULLY BOOKED)

  • You are a sports coach for a popular sports team (football, basketball, handball, etc.). You use a mobile device (tablet/phone) to access real-time data regarding performance, tactics, statistics, and more. During live matches, you also use a pair of special MR glasses to view live data mapped around the field and the players (including competitors). Moreover, with your special smartwatch, you can quickly communicate instructions to your staff.

  • Design for: Tablet/Mobile Phone, AR Headset, Smartwatch

TOY-C-AR

  • You are a dedicated parent who offers everything the child needs. From time to time, you do spoil the rascal while surfacing your inner child and reigniting lost memories. That's why you bought the latest in smart toy car (1:5 replica). The child can enter the car, drive it on their own, or have it driven remotely by the parent using the dedicated mobile/tablet app. Moreover, with AR glasses, you can view enhanced stats, augmented routes, and wayfinding to the car. Important critical information is also displayed on the smartwatch. The car itself has its own kid-friendly interface.

  • Design for: Tablet/Mobile Phone, AR Headset, Smartwatch, Toy Car Interface

INTELLIDEN (FULLY BOOKED)

  • You are a specialized engineer passionate about home automation. So passionate that you build a smart home ecosystem for your current living space, where you control it via your smartphone/tablet, smartwatch, and AR glasses. From adding new devices, viewing information and statistics, setting automations and gestures, to interacting co-op with others (family or roommates) and much more.

  • Design for: Tablet/Mobile Phone, AR Headset, Smartwatch

AR-PI-GI

  • You play a real-life RPG game. You select from a wide range of themes and main missions. You can access the game on a smartphone, smartwatch, and AR glasses. You select from different roles, access quests and interact with other people right in your hometown. It's SIMS meets FABLE but in 2026: mobile, wearable, and augmented.

  • Design for: Mobile Phone, AR Headset, Smartwatch

Monday 02.16.26
Posted by Alecsandru Grigoriu
Newer / Older

Modalverse UI