Surveying Patients about Health Care Providers Is Likely of Little Use

Oct 22, 2018

4 min

Keith Sanford, Ph.D.

But a newly developed questionnaire delves more deeply and may provide valuable information, Baylor University study finds


For anyone who has ever taken a survey after a medical appointment and wondered whether the effort was worthwhile, the answer is probably “No,” says a Baylor University psychologist and researcher.


Health care providers are pushing to assess patient satisfaction, and many companies charge millions of dollars to assess patients for the providers. But while the intentions are great, “when I started looking at the instruments currently being used to assess doctor-patient relationships, it became apparent they were highly problematic and not providing useful information,” said Keith Sanford, Ph.D. professor of psychology and neuroscience in Baylor’s College of Arts & Sciences.


After conducting a series of studies to clarify problems with existing scales, Sanford — a scholar of psychometrics who develops assessment instruments — has created a new tool to measure patient experience during consultations, and research findings suggest it works better than others.


The research — “Medical Consultation Experience Questionnaire: Assessing Perceived Alliance and Experienced Confusion During Medical Consultations” — was published in Psychological Assessment, a journal of the American Psychological Association, and funded in part by a grant from Baylor College of Medicine. Working with Baylor University psychologists were physicians with Texas Children’s Hospital and Baylor College of Medicine.


The new instrument — the Medical Consultation Experience Questionnaire (MCEQ) — measures two aspects of patient experience — “alliance” and “confusion.” Researchers stressed that it addresses the consultation, not treatment results.


Practitioners strive for a good alliance, in which the patient sees the practitioner as committed, competent and dedicated to understanding patient desires and views. Another goal is good exchange of information to avoid confusion.


But in attempting to measure how well those goals are being met, some questionnaires have limited options that may result in skewed results, Sanford said.

For example, one survey offers respondents a 4-point scale in which the answers range from “always” to "never” to such questions as “How often did doctors listen carefully to you?”


Another existing assessment instrument asks respondents to use a 5-point scale — from “poor” to “excellent” — to rate practitioner communication in such areas as whether they were treated with respect.


The problem is that most respondents choose the top response for each item, with fewer than 5 percent choosing the bottom option, previous research has shown. While such a scale can identify “highly disgruntled” patients, “it cannot make reliable distinctions between patients having experiences ranging from marginally acceptable to extremely positive,” researchers wrote.


“The key question is whether a ‘good doctor’ is a single thing or whether there is a range of goodness,” Sanford said. “If you ask the right questions, you’re able to get results that show that range.”


To evaluate the new questionnaire, researchers conducted three studies with a total of 576 participants. They compared responses to the new survey with those participants’ responses to other questionnaires.


Respondents ranged from adults with diabetes and/or hypertension to parents of children requiring plastic surgery (for such conditions as a cleft palate or facial injury) to parents of children with medical conditions meeting one or more of such criteria as having to go to an emergency room, spend time in a hospital, cope with a chronic condition or deal with a life-threatening condition.


The study results support the validity of the new questionnaire in several important ways. It allows for measuring a wider range of patient experiences with more extensive and specific responses, making for better assessment of “alliance” and “confusion” — rather than merely identifying only the most dissatisfied or angry patients, Sanford said.


“One of the reasons this is so important is if you don’t form an alliance with your practitioner, they may give you all the wonderful advice in the world, but you might not follow it, or you might be skeptical,” Sanford said. “And if you don’t quite understand what you are supposed to do, that will interfere with your doing the recommended actions.”


Sanford noted that because the study relied on self-reported data and sampled only three groups with varying medical conditions, future research on patients with other health issues could be valuable. Tracking such outcomes as physiological measurements or frequency of attending rehabilitation sessions also could be of value, he said.


“My hope is that people who use these surveys might realize that just as there is a science behind medical treatment, there is a science behind getting good survey reports,” Sanford said. “We want to make this available freely to anyone who wants to administer it.”


*Co-researchers were Alannah Shelby Rivers, doctoral candidate in psychology and neuroscience at Baylor University; Dr. Tara L. Braun and Kelly P. Schultz, Division of Plastic Surgery at Baylor College of Medicine; and Dr. Edward P. Buchanan, Division of Plastic Surgery, Department of Surgery, Texas Children’s Hospital in Houston and Division of Plastic Surgery at Baylor College of Medicine.


ABOUT BAYLOR UNIVERSITY

Baylor University is a private Christian University and a nationally ranked research institution. The University provides a vibrant campus community for more than 17,000 students by blending interdisciplinary research with an international reputation for educational excellence and a faculty commitment to teaching and scholarship. Chartered in 1845 by the Republic of Texas through the efforts of Baptist pioneers, Baylor is the oldest continually operating University in Texas. Located in Waco, Baylor welcomes students from all 50 states and more than 80 countries to study a broad range of degrees among its 12 nationally recognized academic divisions.


ABOUT BAYLOR COLLEGE OF ARTS & SCIENCES

The College of Arts & Sciences is Baylor University’s oldest and largest academic division, consisting of 25 academic departments and seven academic centers and institutes. The more than 5,000 courses taught in the College span topics from art and theatre to religion, philosophy, sociology and the natural sciences. Faculty conduct research around the world, and research on the undergraduate and graduate level is prevalent throughout all disciplines. Visit www.baylor.edu/artsandsciences.


Connect with:
Keith Sanford, Ph.D.

Keith Sanford, Ph.D.

Professor of Psychology and Neuroscience

Expert who uses psychometrics to understand how interpersonal relationships & racial/ethnic discrimination shape health-related attitudes

Assessment Intstuments in PsychologyCouples and ConflictPsychometrics

You might also like...

Check out some other posts from Baylor University

2 min

Tattoos as Testimonies: Baylor Sociologist Explores How Ink Is Becoming a Spiritual Marker for a New Generation

New research reveals how religious tattoos reflect a cultural – and generational – shift in how faith is expressed through permanent body art. Dr. Kevin D. Dougherty, professor of sociology at Baylor University, brings a unique lens to this evolving phenomenon. An award-winning educator and active researcher, Dougherty teaches both undergraduates and graduate students in areas of sociology, including courses on religion, teaching and organizational life. His research explores religious affiliation, participation, racial diversity in congregations and the ways faith intersects with politics, work and community. In a recent study published in the Journal for the Scientific Study of Religion, Dougherty and his co-authors – Texas Tech sociology professors Jerome R. Koch, Ph.D. and Paticia Maloney, Ph.D. – examine how tattoos—once seen as rebellious—are now being embraced as spiritual markers, particularly among younger generations. The study used national data from the 2021 Baylor Religion Survey, administered by Gallup to a random sample of 1,248 U.S. adults. The findings reveal that nearly 10% of American adults have tattoos with religious or spiritual significance – suggesting a major cultural shift in how lived religion is publicly and permanently expressed. “What we’re seeing is that tattoos are becoming modern-day sacred objects,” said Koch. “They’re permanent, deeply personal and often worn as both a proclamation of faith and a private reminder of belief.” The research challenges longstanding stereotypes that religious individuals avoid tattoos. While highly religious adults remain slightly less likely overall to be tattooed, younger people with strong religious commitment were the most likely to mark their faith visibly and permanently on their bodies. The study also points to a broader evolution in faith practices. Tattoos are now joining other forms of spiritual expression like jewelry and clothing—but with one major distinction: permanence. “A religious tattoo doesn’t come off. It travels with you,” said Dougherty. “It encourages continuity, a lasting connection to what you believe.” Dougherty’s interest in the topic was sparked during a classroom assignment, where students were asked to document tattoos on campus. He was struck by how many were linked to religious themes. “Tattoos that once marked the fringes of respectable society are now being redeemed as testimonies of belief,” he said. “They’re a reminder that faith—like culture—is always adapting, always finding new ways to speak.” For media inquiries and to connect with Kevin, click the icon below. 

2 min

Historical Significance of the Papal Name

In the wake of the historic election of Pope Leo XIV, the first American to ascend to the papacy, scholars and observers alike are reflecting on the global, historical and theological implications of his early statements and symbolic choices. His decision to take the name Leo – a name not used for over a century – immediately evokes comparisons to both Leo XIII and Leo I (Leo the Great), popes known for their firm leadership and dynamic engagement with the world. Baylor University’s Elisabeth Rain Kincaid, J.D., Ph.D., director of the Institute for Faith and Learning and an expert on early modern theology and Catholic Social Thought, said choosing the name Leo is significant, especially in today’s world. Through his choice of name, rhetorical style and theological references, the new pope is signaling a clear vision for a Church that is simultaneously grounded in tradition and open to global dialogue, Kincaid said. Kincaid is currently at work on a monograph – “Business Ethics for a Flourishing Life: Catholic Social Thought in the Modern Workplace” – in which she argues for the continued importance of Leo XIII’s thought for modern life. If you're covering the news about Pope Leo XIV and are looking to know why Cardinal Robert Prevost chose that name - we can help. Elisabeth Rain Kincaid is an author, speaker, teacher, and theologian. She has published broadly in peer-reviewed journals and popular publications. She is a frequent speaker at conferences, churches, and professional events on topics including business ethics, virtue and character, Christian engagement with law and politics, and work and vocation. She is currently the Director for the Institute for Faith and Learning at Baylor University. In her teaching, she draws upon her years of experience as a white-collar criminal defense attorney and a private equity professional, along with her ministry experience. Elisabeth is available to speak with media about this topic - simply contact Shelby Cefaratti-Bertin, M.A., Assistant Director of Media and Public Relations at Baylor University, Shelby_Cefaratti@baylor.edu or 254-327-8012 to arrange an interview today.

5 min

Digital Dementia: Does Technology Use by ‘Digital Pioneers’ Correlate to Cognitive Decline?

As the first generation that interacted with digital technology reaches an age where dementia risks emerge, scientists have asked the question: Is there a correlation between digital technology use and an increased risk of dementia? With the phrases “brain rot” and “brain drain” circulating on social media, it would appear that most people would assume the answer is yes. However, a new study in Nature Human Behavior by neuroscientists at Baylor University and the University of Texas at Austin Dell Medical School reveals the opposite – digital technologies are actually associated with reduced cognitive decline. The study – A meta-analysis of technology use and cognitive aging – was sparked by the ongoing concern about the passive activity of digital technologies and their relation to accelerating risks of dementia. Study co-authors are Jared F. Benge, Ph.D., clinical neuropsychologist and associate professor of neurology at Dell Medical School and UT Health Austin’s Comprehensive Memory Center within the Mulva Clinic for the Neurosciences, and Michael K. Scullin, Ph.D., associate professor of psychology and neuroscience at Baylor. “You can flip on the news on just about any day and you’ll see people talking about how technologies are harming us,” Scullin said. “People often use the terms ‘brain drain’ and ‘brain rot,’ and now digital dementia is an emerging phrase. As researchers, we wanted to know if this was true.” The “digital dementia” hypothesis predicts that a lifetime of exposure to digital technology will worsen cognitive abilities. On the contrary, the study’s findings challenge this hypothesis, indicating instead that engagement with digital technology fosters cognitive resilience in these adults. Reviewing more than 136 studies with data that encompassed over 400,000 adults, and longitudinal studies with an average of 6 years of follow-up data, Scullin and Benge found compelling evidence that digital technology use is associated with better cognitive aging outcomes, rather than harm. The researchers’ study supported the “technological reserve” hypothesis, finding that digital technologies can promote behaviors that preserve cognition. In fact, their study revealed that digital technology use correlates with a 58% lower risk of cognitive impairment. This pattern of cognitive protection persisted when the researchers controlled for socioeconomic status, education, age, gender, baseline cognitive ability, social support, overall health, and engagement with mental activities like reading that might have explained the findings. Increase in problem-solving skills Scullin said that for some, these findings are surprising as technology use is often associated with being sedentary both physically and mentally. However, for the current generation of older adults who were introduced to the first technological advancements – computers, the Internet and smartphones – past their childhood, using technology is cognitively challenging because it is everchanging. “One of the first things that middle-age and older adults were saying is that ‘I’m so frustrated by this computer. This is hard to learn.’ That's actually a reflection of the cognitive challenge, which may be beneficial for the brain even if it doesn’t feel great in the moment.” Scullin said. Technology requires constant adaption, he said, such as understanding new software updates, troubleshooting Internet loss or filtering out website ads. “If you’re doing that for years and you’re really engaging with it, even though you might experience frustration, that may be a sign of you exercising your brain,” he said. Social connection Technology also enables communication and engagement like never before, which can expand opportunities for connectivity. Video calls, emails and messaging apps help maintain social networks, especially for people who would not otherwise regularly see their family members. “Now you can connect with families across generations,” Scullin said. “You not only can talk to them, you can see them. You can share pictures. You can exchange emails and it's all within a second or less. So that means there's a greater opportunity for decreasing loneliness.” Better social connectedness is a well-documented correlate of cognitive functioning in older adults, providing a link between decreased isolation from digital technologies and reduced risks of dementia. Impact of “digital scaffolding” A dementia diagnosis is indicated in part when cognitive changes lead to a loss of independence with daily tasks. Tools such as digital reminders, GPS navigation and online banking allow older adults to remain independent despite cognitive difficulties through digital scaffolding. According to the research article, this digital scaffold “facilitates better functional outcomes in older adults while general cognitive functioning declines.” Technologies can serve as a compensatory support system to maintain general independence and reduce the risk of a dementia diagnosis even with the presence of some cognitive decline. “As clinical practice continues to move toward an individualized, precision-medicine approach, it will be necessary for the field to identify for whom and for how long, such digital scaffolding is effective,” the researchers said. Promoting healthy technology use While Scullin recognizes the negative effects of technology, such as distracted driving or using technology over consistent face-to-face interaction, he also emphasizes how promoting a healthy use of digital tools in older adults is beneficial for their cognitive health. “If you have a parent or grandparent who’s just staying away from technology, maybe revisit that. Could they learn to use photo, messaging, or calendar apps on a smartphone or tablet? Start simple and be very patient while they learn,” he said. Social media use is another highly debated topic in terms of cognitive effects. While he says it’s hard to predict the cognitive effects of endlessly scrolling on TikTok, Scullin does argue that generating videos through creative cognition could be beneficial. In addition, he said that interacting with communities online can provide benefits by forming social connections. “We could spend a long time talking about all the specific ways in which technology use can be bad. However, the net effect since the 1990s has been positive for overall cognition in older adults,” he said. FUNDING The study was supported by funding from the National Institutes of Health (R01AG082783; M.K.S., J.F.B.). Michael Scullin was named Baylor’s inaugural Newsmaker of the Year in 2018, after his “to-do list” research was widely covered by media outlets, including ABC’s Good Morning America, TODAY.com, USA TODAY, Discover, LiveScience, HealthDay, BBC Radio and many more, reaching an international circulation and viewership of nearly 1 billion people. Looking to interview or chat with Michael Scullin? Simply click on his icon now to arrange an interview today.

View all posts