Author Archives: kjschaef@andrew.cmu.edu

HCI Capstone team makes significant improvements to robotic arm controller

A project team in the HCI Undergraduate Capstone Project collaborated with researchers in the Personal Robotics Lab to design a new control for a popular assistive robotic arm. It is shown by pilot studies to dramatically cut cognitive demand, frustration, and the level of exerted effort by users.

 

The team consisted of Whitney Aaronson, Yeon Soo Park, Kevin Schaefer, and Shreepal Shah. They spent the semester with working with Laura Herlant, Dr. Tekin Mericli, and Professor Siddhartha Srinivasa of the Robotics Institute’s Personal Robotics Lab.

 

The robotic arm, MICO by Kinova Robotics, is an innovative wheelchair-mounted robotic manipulator arm with a two-fingered hand intended for people with paraplegia. The team found that its current control mechanisms are severely lacking in usability and learnability, finding it “mentally exhausting” to perform even simple tasks.

 

The team began by creating a simple experiment to evaluate people’s experiences and preferences in controlling a robotic arm through both manual, low-level movements (like “move left”, “move down”, etc) and high-level, automated movements  (like “pick up the bottle”). Their findings demonstrated that most people preferred the use of automated movements because of the ability to focus less on the task of controlling the arm.

 

The redesigned control is based primarily on a recording feature, that allows users of the arm to record repetitive movements and replay them using the joystick already built into in their wheelchair. It was designed in such a way to allow users to feel in control as well as capable of making adjustments to the recordings as they are played back.

 

Two early pilot studies suggest that the redesigned control offers significant benefits in certain situations. One study participant said “It was definitely easier to use the recording. The [current control] was difficult to use in comparison”, a sentiment shared by many of the participants.

 

HCI Undergrad Part of Winning Team at Disney Imagineering

When she graduates in May, Christina Brant hopes to use the skills she’s developed as an architecture and human-computer interaction major to design user experiences — physical, digital or both. Her recent first-place finish in the Walt Disney Imagineering “Imaginations” competition could make achieving that goal a whole lot easier.

Started in 1992, Imaginations challenges teams of students from universities across the U.S. to showcase their skills and talents by designing a Disney-related project. This year, the teams were tasked with selecting a large, densely populated urban environment and designing an experience that temporarily or permanently transformed the city for the enjoyment of its residents and visitors.

Brant and teammates John Brieger (senior, computer science), Angeline Chen (junior, communications design) and Matthew Ho (fifth-year senior, architecture) began their project not buy jumping right into the design, but by setting goals that would guide their whole process.

“First, we set the overall goal of creating an experience that someone wouldn’t be able to encounter in their lifetime,” Brant said. The team also focused on the notion of cultural exchange, and looked for a solution that would push its limits. They landed on the concept of antipodes — two locations literally across the world from each other. In this case, Bangkok and Lima, Peru.

Their project, aptly titled “Antipode,” takes the form of a two-week cultural-exchange festival that unfolds simultaneously in each country. The team created a backstory, in which two children long ago stumbled upon magical whispering tress — one each in Bangkok and in Lima. The trees allow the children to talk to each other from opposite ends of the globe, and they grow up sharing their lives. Eventually, though, the trees fill up with memories and stop working.

The Antipode Festival celebrates The Great Stumps — remnants of the magical trees that are converted into stages in each city to host cultural performances, and opening and closing ceremonies. At the closing ceremony, the Great Stump sinks into itself to become a portal between Lima and Bangkok, where guests can communicate with their counterparts from the other side of the world.

The students collaborated to create the backstory and characters for their project, and submitted a presentation to Disney Imagineering in November that contained original images and photomontages of their experience. They were named one of the six finalists in December, and earned an all-expense-paid trip to Walt Disney Imagineering the last week in January to present their work to a panel of Imagineering judges. The teams also went behind the scenes to see what makes Walt Disney Imagineering — and Disneyland — tick.

“We’ve been socializing with Imagineers, learning what they do and seeing projects. It’s been awesome,” Brant said. “It’s been interesting to see the collaborative process and how things work.”

At the end of the week, the CMU team took first place based on criteria Disney Imagineers use to critique their own work: the team’s ability to collaborate across different disciplines and backgrounds; mastery of their individual skills; whether the project provides an engaging guest experience; understanding of the local and tourist market in the chosen location; the ability to tell a compelling and engaging story; and knowledge and passion for the Disney brand and Walt Disney Imagineering. They’re the third consecutive CMU team to finish in the top three, but the first to win it all.

In addition to earning a cash prize, the CMU team members gained practical knowledge of design and multidisciplinary collaboration during their process.

“I learned how to work with people who had different backgrounds and skill sets, and how those can be melded into an overall proposal or product,” Brant said of the experience. “When people have diverse backgrounds and experiences, you have different opinions and ways of viewing things. And I think that really challenges and pushes the project further.”

For Brant and her teammates, that collaborative style could pay off in a big way, as Disney Imagineering uses Imaginations as a platform for scouting the next generation of creative and innovative thinkers for possible internships with the company. And what better way to design experiences — physical, digital or both — than as a Disney Imagineer?

Jodi Forlizzi Named to CHI Academy

Jodi Forlizzi, associate professor of human-computer interaction and design, has been named to the CHI Academy — an honorary group of individuals who have made substantial contributions to the HCI field. Each year, the Association for Computing Machinery’s Special Interest Group in Computer-Human Interaction elects five to seven new academy members whose efforts have shaped the discipline and the industry. Members are selected based on cumulative contributions to the HCI field, impact on the field through development of new research directions and/or innovations, influence on the work of others, and participation in the ACM SIGCHI community.

Forlizzi’s work in the field of interaction design ranges from understanding the limits of human attention to understanding how products and services evoke social behavior. She designs and researches systems ranging from peripheral displays to social and assistive robots and the interfaces that control them. Forlizzi has also applied her design research thinking to new research topics including big data, healthcare, and service design.

Forlizzi joins four current HCII faculty members who belong to the CHI Academy: Professor Scott Hudson, Hillman Professor of Computer Science and Human-Computer Interaction Sara Kiesler, Herbert A. Simon Professor of Human-Computer Interaction Robert E. Kraut, and Professor Brad Myers. Former HCII Professor Bonnie John the late Randy Pausch are also CHI Academy members.

Cassell Assumes Associate Vice Provost Responsibilities

Justine Cassell, the Charles M. Geschke Director of the Human-Computer Interaction Institute and co-director of The Simon Initiative, has taken on additional responsibilities as the university’s Associate Vice Provost of Technology Strategy and Impact.

In an email to faculty, Provost Mark Kamlet said Cassell’s duties as associate vice provost will include strategy and outreach efforts related to the Global Learning Council as well as university-wide efforts that fall broadly within the area of human-computer interaction.

The Global Learning Council, chaired by President Subra Suresh, is a component of The Simon Initiative. The GLC is a distinguished group of thought leaders from across the globe who are committed to the use of science and technology to enhance learning.

Crowdsourced RNA Designs Outperform Computer Algorithms

An enthusiastic group of non-experts, working through an online interface and receiving feedback from lab experiments, has produced designs for RNA molecules that are consistently more successful than those generated by the best computerized design algorithms, researchers at Carnegie Mellon University and Stanford University report.

Moreover, the researchers gathered some of the best design rules and practices generated by players of the online EteRNA design challenge and, using machine learning principles, generated their own automated design algorithm, EteRNABot, which also bested prior design algorithms. Though this improved computer design tool is faster than humans, the designs it generates still don’t match the quality of those of the online community, which now has more than 130,000 members.

The research will be published this week in the Proceedings of the National Academy of Sciences Online Early Edition.

“The quality of the designs produced by the online EteRNA community is just amazing and far beyond what any of us anticipated when we began this project three years ago,” said Adrien Treiulle, an assistant professor of computer science and robotics at Carnegie Mellon, who leads the project with Rhiju Das, an assistant professor of biochemistry at Stanford, and Jeehyung Lee, a Ph.D. student in computer science at Carnegie Mellon.

VizWiz: Nearly Real-Time Answers to Visual Questions

VizWiz, led by Professor Jeff Bigham of the Human-Computer Interaction Institute, answers questions that people who are blind or visually impaired have about the things around them. Users take a photo, ask a question, and receive answers back quickly from people on the web (the crowd). VizWiz leverages color identification, text recognition, and recognition of objects seen before, but automatic methods are limited to a small subset of questions in practice. The bulk of remaining questions are answered by humans, e.g. “is there a rash on my baby’s head,” “what number is on this credit card,” serving as challenges for computer vision. The VizWiz living laboratory illustrates the utility of deploying working crowd-powered systems to understand target domains via deployable Wizard-of-Oz. On-going work is using VizWiz to explore how people may volunteer their friends for microtasks they care about on social media.

Luis Von Ahn’s Duolingo Named iPhone App of the Year

In an early morning phone call on Tuesday, an Apple executive congratulated Duolingo founder Luis Von Ahn on the Oakland company’s designation as 2013 App of the Year — and warned him to secure company servers for a new onslaught of business.

Not long after, Apple announced publicly that the language learning software app was the editor’s choice for the iTunes App Store 2013 App of the Year.

The free iPhone app, described in the computer giant’s app store as “fantastically well-designed and easy to use,” beat out San Francisco-based photo editing app VSCO Cam and San Francisco-based educational game Endless Alphabet.

Mr. Von Ahn, a professor of computer science at Carnegie Mellon University, reported a definite increase in activity following the announcement.

But despite the push from Apple, an influx of new users isn’t exactly new to the company this year.

Duolingo has seen its user base soar from 3 million in May to 16 million in December.

He said the designation from Apple was particularly notable because it made Duolingo the first education app to take home App of the Year and also the first non-Silicon Valley based company to take home the prize.

(excerpt of Deborah M. Todd’s article for the Pittsburgh Post Gazette)

National Science Foundation Features CoBots on “Science Nation”

Collaborative robots, or CoBots, developed by Manuela Veloso and her Carnegie Mellon research team, have been running errands for occupants of the Gates and Hillman centers for more than two years. Now, they are the subject of a “Science Nation” video and special report by the National Science Foundation.

The robots operate autonomously, navigating their own way through the buildings as they deliver mail and messages, or guide visitors. But they also employ what Veloso, professor of computer science, calls “symbiotic autonomy,” in that they recognize their own limitations. Without arms, they must ask people for help pressing elevator buttons, opening doors and placing items in its delivery basket. They also can search the Internet for information that they lack.

The CoBots move on an omnidirectional base, ask questions using a synthesized voice and accept input from people through a touchscreen interface. Gates and Hillman center occupants can schedule tasks for CoBot through a special web site.

Bio-Inspired Robotic Device Could Aid Ankle-Foot Rehabilitation

A soft, wearable device that mimics the muscles, tendons and ligaments of the lower leg could aid in the rehabilitation of patients with ankle-foot disorders such as drop foot, said Yong-Lae Park, an assistant professor of robotics at Carnegie Mellon University.

Park, working with collaborators at Harvard University, the University of Southern California, MIT and BioSensics, developed an active orthotic device using soft plastics and composite materials, instead of a rigid exoskeleton. The soft materials, combined with pneumatic artificial muscles (PAMs), lightweight sensors and advanced control software, made it possible for the robotic device to achieve natural motions in the ankle.

The researchers reported on the development in the journal Bioinspiration & Biomimetics.

Park, who did the work while a post-doctoral researcher at Harvard’s Wyss Institute for Biologically Inspired Engineering, said the same approach could be used to create rehabilitative devices for other joints of the body or even to create soft exoskeletons that increase the strength of the wearer.

DARPA Selects Tartan Rescue Team For Robotics Challenge Funding

The Tartan Rescue Team from Carnegie Mellon University’s National Robotics Engineering Center ranked third among teams competing in the DARPA Robotics Challenge Trials this weekend in Homestead, Fla., and was selected by the agency as one of eight teams eligible for DARPA funding to prepare for next December’s Finals.

The team’s four-limbed CMU Highly Intelligent Mobile Platform, or CHIMP, robot scored 18 out of a possible 32 points during the two-day Trials. It demonstrated its ability to perform such tasks as removing debris, cutting a
hole through a wall and closing a series of valves.

The Defense Advanced Research Projects Agency is sponsoring the DARPA Robotics Challenge (DRC) to spur development of robotic technologies that could be used to respond to natural or man-made disasters in environments engineered for humans, such as the Fukushima nuclear power plant crisis of 2011.

Sixteen teams competed at the Trials. DARPA on Saturday announced it would enter into funding negotiations with Tartan Rescue and seven other teams, who tallied the highest scores during the Trials. Gill Pratt, DARPA’s program manager for the DRC, said the agency has $8 million budgeted for the teams and intends to spread the money evenly between them.