Using 3 Modalities of Generative AI at the Same Time Without APIs

The nicest thing about being a developer is building stuff that is useful for yourself. I want to have instant feedback about my Japanese comprehension while reading manga, so I’m building an app that reads a manga page back to you in Japanese, using each character’s voice. Everything runs locally on my personal computer! The system mixes three different models and three modalities of data: A…