AI for Human Computer Interaction: A Modern Approach (Springer, 2021)
Explore the many interesting questions that lie at the intersection between AI and HCI. See perspectives, methods and projects that present the challenges and opportunities that modern AI methods bring to HCI researchers and practitioners.
Isopleth embeds scaffolds to expose hidden functional relationships, surface related slices of code, and support learners manipulating the code representations.
[Secondary Author] Ply is a CSS tool that implements visual relevance testing to identify properties that have visual effects on the page. Ply hides visually irrelevant code and surfaces unintuitive relationships between visual properties.
Readily Available Learning Experiences
Readily Available Learning Experiences on the open web surface hidden design patterns, code constructs, and relationships in professional websites to help inexperienced developers learn pro concepts. Committee includes Haoqi Zhang (Advisor), Rob Miller (MIT), Eleanor O'Rourke, Darren Gergle.
Rico UI Mining
[Secondary Author] A system that combines crowdsourcing and automation to scalably mine design and interaction data from Android apps at runtime.
YouTube: Coming Soon
GitHub: CrowdSTF, my contribution to this paper.
Telescope: UI Discovery
Unravel: Source Tracing
Crowd Camp: The Dancing Professor
During CrowdCamp at HCOMP 2014, we developed a project called “The Dancing Professor” that earned its name from the motions professors make when trying to explain visual ideas with physical body movements instead of making an illustration. While participating in online courses, students are often confused by ideas presented in a video lecture. How can we aid learning and improve the illustration of concepts and ideas for online courses? With an augmented web-learning interface, students can give and receive help at certain time intervals throughout a lecture.
Read more over at the Crowd Research Blog.
Stack Exchange Expertise
What does the reputation distribution look like within stack exchange communities? How does answer frequency correlate with reputation earned? How often are accepted solutions the best solutions? What are underdog answers? What are the batting averages of the top contributors of Stack Overflow? What tags are most likely to earn top reputation points? How can an interface augment reputation earned for the better?
The Peanut Gallery
A simple dashboard is provided for a presenter to see a real-time aggregate of thoughts and emotions submitted by audience members. With the ability to vote as an audience member, presenters can see popular and trending ideas and questions in their audience. Numerical and charted views update with responses, indicating whether the audience is feeling lost, content, angry, or a combination of emotional states.
The architecture of Peanut Gallery relies on live event propagation over WebSockets, NodeJS routing, and real-time in memory map-reduce.