Health Insurance Appeals with Generative AI: From Lab to Production • Holden Karau • GOTO 2024
This presentation was recorded at GOTO Chicago 2024. #GOTOcon #GOTOchgo
https://gotochgo.com
Holden Karau - Co-Founder at Fight Health Insurance @HoldenKarau
RESOURCES
https://bsky.app/profile/holdenkarau.com
https://twitter.com/holdenkarau
https://github.com/holdenk
https://www.linkedin.com/in/holdenkarau
http://holdenkarau.com
Links
https://www.fighthealthinsurance.com
https://wpso.dmhc.ca.gov/imr
https://huggingface.co/TotallyLegitCo/appeal-alpaca
https://huggingface.co/TotallyLegitCo/fighthealthinsurance_model_v0.2
https://huggingface.co/TotallyLegitCo/fighthealthinsurance_model_v0.3
https://www.youtube.com/playlist?list=PLRLebp9QyZtYcK_X13lBS_HZjaXUDwyEt
ABSTRACT
This talk will cover how we created a system to generate health insurance appeals from denials. We'll start with a quick look at the different attempts at model fine-tuning (along with what eventually worked well for us), then look at the middleware, how we integrate in-house and external models, steps to protect privacy, and finally, some truly questionable frontend code (or truly great frontend code if we finish the rewrite in time—you never know).
If you love the American healthcare system as it stands today, this is probably not the talk for you. For those ambivalent about the healthcare system, that's totally fine; you can still see what it takes to bring an ML system from drinks at a bar all the way through to production. [...]
TIMECODES
00:00 Intro
00:25 Content warning
03:38 What's the problem?
06:13 How to use computers to fix the problem?
07:13 What's needed to tune a LLM?
10:36 Putting it together
11:38 Downsides
13:04 What models did we make?
14:21 Model fine tune config
15:40 Model serving
18:38 Frontend?
19:46 Demo
25:18 How to do better for the next model?
27:55 Links
28:40 Outro
Download slides and read the full abstract here:
https://gotochgo.com/2024/sessions/3371
RECOMMENDED BOOKS
Holden Karau • Distributed Computing 4 Kids • https://www.distributedcomputing4kids.com
Holden Karau • Scaling Python with Dask • https://www.oreilly.com/library/view/scaling-python-with/9781098119867
Holden Karau & Boris Lublinsky • Scaling Python with Ray • https://amzn.to/44GU6cC
Holden Karau & Rachel Warren • High Performance Spark • https://amzn.to/3v2eLbn
Holden Karau, Konwinski, Wendell & Zaharia • Learning Spark • https://amzn.to/397e2NE
Holden Karau & Krishna Sankar • Fast Data Processing with Spark 2nd Edition • https://amzn.to/3xKhXKu
Holden Karau • Fast Data Processing with Spark 1st Edition • https://amzn.to/3rHQgOu
https://bsky.app/profile/gotocon.com
https://twitter.com/GOTOcon
https://www.linkedin.com/company/goto-
https://www.instagram.com/goto_con
https://www.facebook.com/GOTOConferences
#GenerativeAI #LLMs #GenAI #HealthInsurance #HealthInsuranceAppeals #HoldenKarau
CHANNEL MEMBERSHIP BONUS
Join this channel to get early access to videos & other perks:
https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
Sign up for updates and specials at https://gotopia.tech/newsletter
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
https://www.youtube.com/user/GotoConferences/?sub_confirmation=1
This presentation was recorded at GOTO Chicago 2024. #GOTOcon #GOTOchgo
https://gotochgo.com
Holden Karau – Co-Founder at Fight Health Insurance @HoldenKarau
RESOURCES
https://bsky.app/profile/holdenkarau.com
https://twitter.com/holdenkarau
https://github.com/holdenk
https://www.linkedin.com/in/holdenkarau
http://holdenkarau.com
Links
https://www.fighthealthinsurance.com
https://wpso.dmhc.ca.gov/imr
https://huggingface.co/TotallyLegitCo/appeal-alpaca
https://huggingface.co/TotallyLegitCo/fighthealthinsurance_model_v0.2
https://huggingface.co/TotallyLegitCo/fighthealthinsurance_model_v0.3
https://www.youtube.com/playlist?list=PLRLebp9QyZtYcK_X13lBS_HZjaXUDwyEt
ABSTRACT
This talk will cover how we created a system to generate health insurance appeals from denials. We’ll start with a quick look at the different attempts at model fine-tuning (along with what eventually worked well for us), then look at the middleware, how we integrate in-house and external models, steps to protect privacy, and finally, some truly questionable frontend code (or truly great frontend code if we finish the rewrite in time—you never know).
If you love the American healthcare system as it stands today, this is probably not the talk for you. For those ambivalent about the healthcare system, that’s totally fine; you can still see what it takes to bring an ML system from drinks at a bar all the way through to production. […]
TIMECODES
00:00 Intro
00:25 Content warning
03:38 What’s the problem?
06:13 How to use computers to fix the problem?
07:13 What’s needed to tune a LLM?
10:36 Putting it together
11:38 Downsides
13:04 What models did we make?
14:21 Model fine tune config
15:40 Model serving
18:38 Frontend?
19:46 Demo
25:18 How to do better for the next model?
27:55 Links
28:40 Outro
Download slides and read the full abstract here:
https://gotochgo.com/2024/sessions/3371
RECOMMENDED BOOKS
Holden Karau • Distributed Computing 4 Kids • https://www.distributedcomputing4kids.com
Holden Karau • Scaling Python with Dask • https://www.oreilly.com/library/view/scaling-python-with/9781098119867
Holden Karau & Boris Lublinsky • Scaling Python with Ray • https://amzn.to/44GU6cC
Holden Karau & Rachel Warren • High Performance Spark • https://amzn.to/3v2eLbn
Holden Karau, Konwinski, Wendell & Zaharia • Learning Spark • https://amzn.to/397e2NE
Holden Karau & Krishna Sankar • Fast Data Processing with Spark 2nd Edition • https://amzn.to/3xKhXKu
Holden Karau • Fast Data Processing with Spark 1st Edition • https://amzn.to/3rHQgOu
https://bsky.app/profile/gotocon.com
https://twitter.com/GOTOcon
https://www.linkedin.com/company/goto-
https://www.instagram.com/goto_con
https://www.facebook.com/GOTOConferences
#GenerativeAI #LLMs #GenAI #HealthInsurance #HealthInsuranceAppeals #HoldenKarau
CHANNEL MEMBERSHIP BONUS
Join this channel to get early access to videos & other perks:
https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
Sign up for updates and specials at https://gotopia.tech/newsletter
SUBSCRIBE TO OUR CHANNEL – new videos posted almost daily.
https://www.youtube.com/user/GotoConferences/?sub_confirmation=1
![how i would learn cybersecurity in 2026 if i had to start over [$1,000 GIVEAWAY & BIG ANNOUNCEMENT]](https://i.ytimg.com/vi/RVPKW--dqhw/hqdefault.jpg "how i would learn cybersecurity in 2026 if i had to start over [$1,000 GIVEAWAY & BIG ANNOUNCEMENT]")
