GPT-4 Turbo Timing/Throughput on Evals:

GPT-4 Turbo Timing/Throughput on Evals: 100 Sample throughput tests Retrieval Evals: GPT-4: 113 Seconds GPT-4 Turbo: 61 Seconds GPT-3.5: 73 Seconds Q&A Evals- GPT-4: 124 Seconds GPT-4 Turbo: 66 Seconds GPT-3.5: 67 Seconds Comparable to 3.5 in terms of thoughput and twice as fast as GPT-4