Performance of EncephalApp Stroop Test in Cirrhotic Patients for Evaluating Covert Hepatic Encephalopathy

Juferdy Kurniawan, Stefanus Satrio Ranty, Andri Sanityoso Sulaiman, Rino Alvani Gani


Background: Covert hepatic encephalopathy (HE) is the mildest HE spectrum that is difficult to detect, but associated with significant decrease in quality of life. Currently, there is no gold standard to detect covert HE. EncephalApp Stroop Test as a newer diagnostic tool is easier, faster and its ease of availability in various health institutions is expected to be applied in Indonesia for covert HE detection. This study aimed to validate and test the reliability and diagnostic ability of EncephalApp Stroop Test to diagnose covert HE, compared to the Psychometric Hepatic Encephalopathy Score (PHES) and critical flicker frequency (CFF). Methods: This study is a cross-sectional test, conducted from August to September 2018, targeted at patient with cirrhosis in Jakarta, to obtain Area Under The Curve (AUC), sensitivity, specificity, cut-off point, predictive value, likelihood ratio, and post-test probability of the EncephalApp Stroop Test, compared to PHES and CFF. The Validity and reliability tests were done before diagnostic study. Translation of the EncephalApp Stroop Test were first carried out using WHO protocol. All patients first underwent a Mini Mental State Examination and Ishihara Test to rule out color blindness. Results: Thirty subjects participated in validity and reliability tests, and eighty in diagnostic tests. The translated application showed excellent internal consistency (Chronbach’s Alpha of 0.942) and correlation coefficient of 0.82. The diagnostic study showed OnTime + OffTime as the best parameter (AUC: 0.897 (95% CI: 82.9% - 96.5%); sensitivity: 88.6%; specificity: 80%; positive predictive value (PPV): 0.77; negative predictive value (NPV): 0.9; positive likelihood ratio (LK+): 4.4; negative likelihood ratio (LK-): 1.4; positive post-test probability: 0,775; negative post-test probability: 0,1; and cut-off point ≥ 188.8 seconds. Conclusion: The EncephalApp Stroop Test is valid and reliable, with good AUC value, sensitivity, specificity, PPV, NPV and likelihood ratio in diagnosing covert hepatic encephalopathy in patients with cirrhosis in Indonesia.


Covert hepatic encephalopathy; liver cirrhosis; EncephalApp Stroop Test; history of HE; Critical Flicker Frequency (CFF); Psychometric Hepatic Encephalopathy Score (PHES)


Butterworth RF. Hepatic encephalopathy. Alcohol research & health : the journal of the National Institute on Alcohol Abuse and Alcoholism. 2003;27(3):240-6.

Aguire AM, Aguire AAC, Pinedo UG, Gastelum FJG. Molecular aspect of hepatic encephalopathy. Neurologia. 2010;25(4):239-47.

Lesmana LA, Nusi IA, Gani RA, et al. Panduan praktik klinik ensefalopati hepatik di Indonesia. In: Lesmana CRA, editor. Jakarta: Perhimpunan Peneliti Hati Indonesia; 2014.

Poh Z, Chang PE. A current review of the diagnostic and treatment strategies of hepatic encephalopathy. Int J Hepatol. 2012;2012:480309.

Riggio O, Ridola L, Pasquale C. Hepatic encephalopathy therapy: An overview. World J Gastrointest Pharmacol Ther. 2010;1(2):54-63.

Wakim-Fleming J. Hepatic encephalopathy: suspect it early in patients with cirrhosis. Cleve Clin J Med. 2011;78(9):597-605.

Vilstrup H, Amodio P, Bajaj J, et al. Hepatic encephalopathy in chronic liver disease: 2014 practice guideline by the American Association for the Study of Liver Diseases and the European Association for the Study of the Liver. Hepatology. 2014;60(2):715-35.

Bajaj JS, Cordoba J, Mullen KD, et al. Review article: the design of clinical trials in hepatic encephalopathy--an International Society for Hepatic Encephalopathy and Nitrogen Metabolism (ISHEN) consensus statement. Aliment Pharmacol Ther. 2011;33(7):739-47.

Kappus MR, Bajaj JS. Covert hepatic encephalopathy: not as minimal as you might think. Clin Gastroenterol Hepatol. 2012;10(11):1208-19.

Patidar KR, Bajaj JS. Covert and overt hepatic encephalopathy: diagnosis and management. Clin Gastroenterol Hepatol. 2015;13(12):2048-61.

Dhiman RK, Saraswat VA, Sharma BK, et al. Minimal hepatic encephalopathy: consensus statement of a working party of the Indian National Association for Study of the Liver. J Gastroenterol Hepatol. 2010;25(6):1029-41.

Nabi E, Bajaj JS. Useful tests for hepatic encephalopathy in clinical practice. Curr Gastroenterol Rep. 2014;16(1):362.

Weissenborn K, Ennen JC, Schomerus H, Ruckert N, Hecker H. Neuropsychological characterization of hepatic encephalopathy. J Hepatol. 2001;34(5):768-73.

Ferenci P, Lockwood A, Mullen K, Tarter R, Weissenborn K, Blei AT. Hepatic encephalopathy--definition, nomenclature, diagnosis, and quantification: final report of the working party at the 11th World Congresses of Gastroenterology, Vienna, 1998. Hepatology. 2002;35(3):716-21.

Zhan T, Stremmel W. The diagnosis and treatment of minimal hepatic encephalopathy. Dtsch Arztebl Int. 2012;109(10):180-7.

Torlot FJ, McPhail MJ, Taylor-Robinson SD. Meta-analysis: The diagnostic accuracy of critical flicker frequency in minimal hepatic encephalopathy. Aliment Pharmacol Ther. 2013;37(5):527-36.

Ozel Coskun BD, Ozen M. Critical flicker frequency test for diagnosing minimal hepatic encephalopathy in patients with cirrhosis. Turk J Gastroenterol. 2017;28(3):191-6.

Bajaj JS, Thacker LR, Heuman DM, et al. The stroop smartphone application is a short and valid method to screen for minimal hepatic encephalopathy. Hepatology. 2013;58(3):1122-32.

Bajaj JS, Heuman DM, Sterling RK, et al. Validation of EncephalApp, smartphone-based stroop test, for the diagnosis of covert hepatic encephalopathy. Clin Gastroenterol Hepatol. 2015;13(10):1828-35 e1.

Zubir N. Koma hepatik. Buku Ajar Ilmu Penyakit Dalam. 1. V ed. Jakarta: Interna Publishing; 2010. p. 677-80.

Iskandar M, Ndraha S, Hasan I. Prevalensi ensefalopati hepatik minimal di Rumah Sakit Cipto Mangunkusumo pada bulan Mei - Agustus 2009. KOPAPDI. 2009.

Wang JY, Zhang NP, Chi BR, et al. Prevalence of minimal hepatic encephalopathy and quality of life evaluations in hospitalized cirrhotic patients in China. World J Gastroenterol. 2013;19(30):4984-91.

Sharma P, Sharma BC. Predictors of minimal hepatic encephalopathy in patients with cirrhosis. Saudi J Gastroenterol. 2010;16(3):181-7.

Wang AJ, Peng AP, Li BM, et al. Natural history of covert hepatic encephalopathy: An observational study of 366 cirrhotic patients. World J Gastroenterol. 2017;23(34):6321-9.

NeSmith M, Ahn J, Flamm SL. Contemporary understanding and management of Overt and Covert Hepatic Encephalopathy. Gastroenterol Hepatol. 2016;12(2):91-100.

Dhiman RK. Impact of minimal/covert hepatic encephalopathy on patients with cirrhosis. Clinical Liver Disease. 2015;5(3):75-8.

Full Text: PDF


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.