Testing LLM reasoning abilities with SAT is not an original idea; there is a recent research that did a thorough testing with models such as GPT-4o and found that for hard enough problems, every model degrades to random guessing. But I couldn't find any research that used newer models like I used. It would be nice to see a more thorough testing done again with newer models.
刚到浙江工作，有人请习近平同志谈谈“施政纲领”，他笑着说：“我刚刚来，还没有发言权。到时候，我是要说的。”
。91视频对此有专业解读
Раскрыты подробности о договорных матчах в российском футболе18:01
Раскрыты подробности о договорных матчах в российском футболе18:01