Newsletters
New Idea for FDA’s Life Cycle Regulation of Open-Source LLMs
2024-12-03 12:00
My new idea for FDA’s life cycle regulation for the non-SaMD: Allowing voluntary submission of validation data of fine-tuned open-source LLMs to help doctors to choose LLMs for clinical research and applications. ELHS Institute starts to release vali...
GenAI Wins Nobel Prize, Yet LLMs Still Lack Clinical Evaluation
2024-11-02 00:00
Research on artificial neural networks has won the Nobel Prize, marking the first gift to the new era of GenAI. However, healthcare-focused GenAI LLMs still lack proper clinical evaluation, as highlighted by the FDA Commissioner. AJ and ChatGPT discu...
LLM GenAI Capable of Self-Taught Evaluation
2024-10-01 00:00
Meta has developed a Self-Taught Evaluator that can improve Llama’s performance without human annotations. AJ asks ChatGPT to explain how to conduct autonomous LLM development.
How to Clean Up the Mess in Clinical AI Testing?
2024-09-05 00:00
Clinical testing of GenAI is in disarray. Healthcare organizations, academics, and industry experts are coming together to create new solutions, whether centralized or distributed. ChatGPT understands the challenges, offers suggestions, and calls for...
Open-Source LLMs Ready for Prime Time to Power Care Delivery?
2024-08-05 00:00
Llama 3.1, the first open-source LLM performing at the level of ChatGPT-4, has just arrived. The road ahead for open-source LLMs powering generative AI in healthcare delivery is becoming clearer. Three key steps in this journey are highlighted: syste...
Machine Psychology
2024-06-29 12:00
Studying the psychology of LLMs has become a new field. The GPT-4 model performs well in theory of mind tests. Let GPT-4 explain the results itself.
Systematic Benchmarking LLMs and Continuous Monitoring of AI Performance
2024-05-30 12:00
In the new world of generative AI, the paradigm shift from seeking deterministic truth to probabilistic truth requires systematic benchmarking of LLM-based generative AI chatbots for all healthcare tasks, continuous validation and monitoring of AI mo...
Healthcare GenAI Agents are Coming
2024-04-29 00:00
The development of generative AI agents is now at the forefront of healthcare GenAI research. The term "AI agent" refers to a system or software that can operate autonomously or semi-autonomously to perform tasks or achieve goals in a given environm...
The Rise of GenAI-Augmented Generalists
2024-03-29 00:00
ELHS NEWSLETTER 2024-03-29: Previous AI generations, which depended heavily on structured data, showed limited impact in practical healthcare applications. With generative AI and large language models capable of processing unstructured data, we now h...
GenAI Powering the Democratization of AI and Medical Education in Systems-Based Practice
2024-02-29 00:00
ELHS NEWSLETTER 2024-02-29: Our letter to the editor has been published by Academic Medicine: “Impact of Democratizing Artificial Intelligence: Using ChatGPT in Medical Education and Training.” We emphasized that, given generative AI’s potential as b...