Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 Jan 1;32(1):230-234.
doi: 10.1093/jamia/ocae250.

Secure messaging telehealth billing in the digital age: moving beyond time-based metrics

Affiliations

Secure messaging telehealth billing in the digital age: moving beyond time-based metrics

Dong-Gil Ko et al. J Am Med Inform Assoc. .

Abstract

Objective: We proposed adopting billing models for secure messaging (SM) telehealth services that move beyond time-based metrics, focusing on the complexity and clinical expertise involved in patient care.

Materials and methods: We trained 8 classification machine learning (ML) models using providers' electronic health record (EHR) audit log data for patient-initiated non-urgent messages. Mixed effect modeling (MEM) analyzed significance.

Results: Accuracy and area under the receiver operating characteristics curve scores generally exceeded 0.85, demonstrating robust performance. MEM showed that knowledge domains significantly influenced SM billing, explaining nearly 40% of the variance.

Discussion: This study demonstrates that ML models using EHR audit log data can improve and predict billing in SM telehealth services, supporting billing models that reflect clinical complexity and expertise rather than time-based metrics.

Conclusion: Our research highlights the need for SM billing models beyond time-based metrics, using EHR audit log data to capture the true value of clinical work.

Keywords: electronic health record; machine learning; mixed effect modeling; secure messaging; telehealth billing.

PubMed Disclaimer

Conflict of interest statement

The authors have no competing interests to declare.

Figures

Figure 1.
Figure 1.
Association between the Patient Portal Secure Messages and Audit Log. The 2 datasets are related through PATID, ENCID, and MSGID. The Patient Portal Secure Messages example shows message exchanges between a patient and provider. The Audit Log example shows the provider conducting clinical activities for 2 patient messages—message identifiers 300 on September 1, 2024 and 370 on September 3, 2024. ENCID, message encounter unique identifier; INFOVIEW, clinical information access; KD, knowledge domain; MSGID, message unique identifier; MSGNOTE, message note; MSGSUBJ, message subject; PATID, patient unique identifier; PROVID, provider unique identifier; TIME, timestamp of clinical activity.
Figure 2.
Figure 2.
Mixed effect modeling visuals. These bar plots visually represent the impact of each KD on the dependent variable (SM billing), with error bars indicating the SEs. The vertical dashed line at zero helps identifies whether the coefficients are positive or negative, which is important for understanding their effect. KD, knowledge domain; SM, secure messaging.

References

    1. Shimada SL, Petrakis BA, Rothendler JA, et al. An analysis of patient-provider secure messaging at two Veterans Health Administration medical centers: message content and resolution through secure messaging. J Am Med Inform Assoc. 2017;24:942-949. - PMC - PubMed
    1. North F, Luhman KE, Mallmann EA, et al. A retrospective analysis of provider-to-patient secure messages: how much are they increasing, who is doing the work, and is the work happening after hours? JMIR Med Inform. 2020;8:e16521. - PMC - PubMed
    1. Ko S-MA, Warm EJ, Schauer DP, Ko D-G. Secure messaging use among patients with depression: an analysis using real-world data. Telemed E-Health. 2024;30:2157-2164. - PubMed
    1. Holmgren AJ, Byron ME, Grouse CK, Adler-Milstein J. Association between billing patient portal messages as e-visits and patient messaging volume. JAMA. 2023;329:339-342. - PMC - PubMed
    1. Nath B, Williams B, Jeffery MM, et al. Trends in electronic health record inbox messaging during the COVID-19 pandemic in an ambulatory practice network in New England. JAMA Netw Open. 2021;4:e2131490. - PMC - PubMed

Publication types