LLM on FHIR – Demystifying Health Records

Beta Deployment codecov DOI

“Demystifying Health Records – A Conversational Interface to Your Health Data”

HealthRecords LabResultSummary ConverstationQuestion ConverstationFollowUpQuestion

This repository contains the LLM on FHIR Application to demonstrate the power of LLMs to explain and provide helpful context around patient data provided in the FHIR format. It demonstrates using the Spezi framework and builds on top of the Stanford Spezi Template Application. The application connects to the OpenAI GPT API to interpret FHIR resources using the GPT suite of large language models.

Overview

  • Inspect Your Health Data: Our application connects with the Apple Health app via the FHIR (Fast Healthcare Interoperability Resources) patient data API, allowing you to view your health data conveniently.

  • Summarize & Interpret Your Data: The app uses OpenAI’s sophisticated large language model (LLM) to interpret and summarize complex health records, presenting them in a user-friendly, understandable manner.

  • Learn More About Your Data: You can utilize the chat functionality for follow-up questions, enabling a deeper understanding of your health records.

Disclaimer

LLM on FHIR is an experimental iOS app. It is designed for general informational purposes, providing users a platform to interact with health records stored in Apple Health using OpenAI models.

  • Not a Substitute for Professional Advice: LLM on FHIR is not intended as a substitute for professional medical advice, diagnosis, or treatment.

  • Limitations of AI Models: Remember, AI models can sometimes make mistakes or generate misleading information. Always cross-check and verify the information provided.

  • Use at Your Own Risk: Any use of LLM on FHIR is at the user’s own risk. Always consult a qualified healthcare provider for personalized advice regarding your health and well-being.

  • Demonstration Only: This app is intended for demonstration only and should not be used to process any personal health information.

Remember that your health data will be sent to OpenAI for processing. Please inspect and carefully read the OpenAI API data usage policies and settings accordingly.

HealthKit Access

LLM on FHIR requires access to the FHIR health records stored in the Apple Health app. You have the control to select the different types of health records you wish to inspect in LLM on FHIR.

In case no health records are available, please follow the instructions to connect and retrieve your health records from your provider. If your health records are visible in the Apple Health app, please ensure that LLM on FHIR has access to your health records in the Apple Health App. You can find these settings in the privacy section of your profile in Apple Health.

Application Structure

The Spezi Template Application uses a modularized structure using the Spezi modules enabled by the Swift Package Manager.

The application uses the FHIR standard to provide a shared repository for data exchanged between different modules. You can learn more about the Spezi standards-based software architecture in the Spezi documentation.

Build and Run the Application

You can build and run the application using Xcode by opening up the LLMonFHIR.xcodeproj.

Contributors & License

This project is based on Spezi framework and builds on top of the Stanford Spezi Template Application provided using the MIT license. You can find a list of contributors in the CONTRIBUTORS.md file.

The LLM on FHIR project, Spezi Template Application, and the Spezi framework are licensed under the MIT license.

GitHub

View Github