You got that right… it’s calling to gpt-4 turbo for personalized recommendations text. So it recommends movies, books, etc. One call to get recommendations than another call per rec to get personalized synopsis text. I tried making it 2 big calls but it was surprisingly slower. Lmk if thoughts
Fix the tech. Slow api calls are usually a result of slow running queries. Profile your app and look for n+1 queries
Thx for that I made it twice as fast tonight by optimizing 🙌🏼 plugging away
twice as fast is still pretty slow, what does it do? why is it so slow?
You got that right… it’s calling to gpt-4 turbo for personalized recommendations text. So it recommends movies, books, etc. One call to get recommendations than another call per rec to get personalized synopsis text. I tried making it 2 big calls but it was surprisingly slower. Lmk if thoughts
Making calls to GTP-4 will be pretty slow