Projects

We are developing a suite of media experiences to introduce visitors to the rich cultural and economic history of Auburn Avenue. From about 1900 to 1960, Auburn Avenue was the center of African-American cultural and economic life in the city. The street also played a key role in the civil rights movement. From the 1960s on, the street suffered decline, and the local community disintegrated because of a range of social, economic, and urban planning factors.
This project helps teach STEM concepts with an audio-enabled version of the Lemonade Stand Game, in which visually impaired players (or any player that wants to experience a game that is sound dependent) need to manage their own stand while factoring in weather, local events, advertisement, and pricing in order to maximize profit for their business.
The graphs and figures that are so prevalent in math and science education make those topics largely inaccessible to blind students. We are working on auditory graphs that can represent equations and data to those who cannot see a visual graph. A number of new areas we're starting research on are: looking into teaching astronomy concepts through (like the Solar System) and the teaching and understanding of weather information through a combination of sonification and auditory description.
Before the onset of the pandemic, we used to be able to visit public places, like library and cafes, where we could work and enjoy the atmosphere of having others around. But then the pandemic hit, and with it came remote work where many were forced to work in isolation. Most of the face-to-face interactions we used to have were replaced with telecommunication, and many of us began to miss working around others. Enter: Audo, a sound-based virtual coworking space that features an auditory environment and user interface informed by two phases of user research.
In collaboration with policial science researchers from Georgia State University and University at Albany, we are developing augmented reality-based experiments to examine the impact of grievance, opportunity and risk as motivating factors when choosing to engage in political protest or terrorism. Study participants assume the role of a fictional ethnic minority in a fictional country and engage in dialogs with virtual characters that attempt to persude the participant to join a peaceful student-led protest or join a violent resistance movement.
Augmented Reality gaming promises new ways for humans to engage with their physical environment by overlaying gameplay elements via a head-mounted display. We present an artificial intelligence technique to automatically generate novel gameplay content for mixed-reality environments. We demonstrate the technique with a game we call "Augmented Reality Lemmings", a platform game in which the level content was procedurally generated.
As a college student, finding your internship or a job post graduation can be a daunting task. As a novice new to industry or even someone with experience, finding a job tends to be a black box experience. Deciding where, when and how to apply is a process that could benefit from improvement. Career services and fellow peers are great data resources for the job search however often this data is either not accessible or its not in a form that is easy to digest. On the flip side, career professionals such as career service office and program administrators constantly work with students to find
Automated safety systems, a first step toward autonomous vehicles, are already available in many commercial vehicles. These are systems such as adaptive cruise control, which has the capability to slow down due to traffic, and automatic lane keeping, which maintains position within a lane without driver intervention. In order to ensure that these systems are properly used by drivers it is essential that they understand and appropriately trust the technology.
Game design is a difficult and costly practice. We developed a machine learning-based method for automatically generating games. We feed our system a series of gameplay videos of different games. Our system then leverages a technique we've developed called conceptual expansion to recombine its knowledge of game design to produce novel games.  
In this project, we aim to develop and evaluate displays of automation uncertainty that aid in the transition of control from automated to manual driving. Currently, we are focused on two manipulations of these displays. The first manipulation, metric, is manipulated by presenting system reliability information (Reliability) or the level of engagement necessary for the driver (Required Driver Engagement, RDE). The second manipulation, modality, is manipulated by presenting the information visually, auditorily, or with a combination of visual and auditory information (multimodal).
Since its earliest days, flaming, trolling, harassment and abuse have plagued the Internet. Our aim is to computationally model abusive online behavior to build tools that help counter it, with the goal of making the Internet a more welcoming place. In particular, we look at a novel approach to identify online verbal abuse using cross-community linguistic similarities between posts on different communities. This work will enable a transformative new class of automated and semi-automated applications that depend on computationally generated abuse predictions.
The Aware Home, an Institute for People and Technology (IPaT) Living Lab, provides an authentic home environment in which to conduct research in the areas of: health and well-being, connected home, home security and resource management, and the future of digital media and entertainment at home. Common uses of the home include: 1. innovating the next home technology, 2. performing human subject studies of our research in a controlled environment, 3. testing installation of solutions before deploying into peoples‚ actual homes, such as those individuals enrolled in HomeLab.
Athletes frequently get injured and often need to undergo a difficult physical therapy process to return to recover. Participation in recommended home exercises is low due to their repetitive nature. Staying motivated and consistently practicing their exercises speeds recovery. We focus on how to use technology to motivate and guide athletes through basic balance exercises that are often required after lower leg injuries, such as ankle sprains and ligament tears. Our solution is a 2D platformer game that takes in input through the Wii balance board, requiring different balance exercises.
This project concerns the analysis and design of a wearable technology garment intended to aid with the instruction of ballet technique to adult beginners. A phenomenological framework is developed and used to assess physiological training tools. Following this, a garment is developed that incorporates visual feedback inspired by animation techniques that more directly convey the essential movements of ballet.

Pages