Customers in the hotel industry are writing online reviews more than ever via social networks and travel websites. But their comments are so numerous and hard to analyze using traditional statistical methods that it has been difficult for managers to use reviews to improve operations.
Cornell researchers have come up with a text-mining method of analyzing online customer reviews – and have found that they do not tell the full story of how guests view a hotel.
“Uncovering insights that have real service and managerial implications distinguishes this project from other text-mining and natural language processing works,” said one of the study’s authors, Shawn Mankad, assistant professor of operations, technology and information management at the Samuel Curtis Johnson Graduate School of Management.
For example, negative comments carry more weight in a guest’s rating than positive ones. That unevenness means a simple average of positive and negative scores may not provide a clear view of a guest’s opinion of the hotel. It underlines the importance of a hotel’s consistency: It’s better for hotels to provide guests with a moderately good overall experience than a hotel stay that is extremely good in some regards and terrible in others.
“The terrible service will outweigh the good feelings from the stay’s excellent aspects,” Mankad said.
The study, “What Guests Really Think of Your Hotel: Text Analytics of Online Customer Reviews,” was written by Hyun Jeong “Spring” Han of the National University Higher School of Economics in Moscow; Mankad; Nagesh Gavirneni, associate professor of operations, technology and information management at Johnson; and Rohit Verma, the Singapore Tourism Board Distinguished Professor in Asian Hospitality Management at Cornell’s School of Hotel Administration (SHA). The research was published in SHA’s Center for Hospitality Research.
The researchers analyzed 5,830 reviews from TripAdvisor, a leading hotel review website, covering 57 hotels in Moscow from 2012 to ’13. The study demonstrated how automated software tools with natural-language-processing algorithms analyzed large volumes of text. The tools identified and sorted more than 18,000 keywords related to amenities, location, transactions, value and experience. They also looked at the numerical satisfaction rating, from one to five, that each reviewer gave the hotel, and the type of traveler writing the review: business, family, couple or solo traveler.
The researchers found the reviews’ content can vary substantially – in sentiment, quality of writing and themes – from the numerical satisfaction ratings review writers assigned the hotel. “This suggests that information from the text can potentially yield insights not indicated in the ratings for how hotels can improve their operations and better meet customer expectations,” the study said.
As a whole, the hospitality industry could benefit from developing more precise text analysis methods, the study said. “Guests’ true feelings are found in those comments – particularly if they write lengthy reviews that focuses tightly on just a few issues.”
Source: University of Cornell
Categories: Leadership in Sociology