General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks · HackerPapers discussions

General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks — mentioned by orangecat

Wed, 12 Aug 2026 17:57:51 GMT

Keep deluding yourself, unless you work for an LLM provider You're clearly operating in bad faith, but just for the record: the General365 problems are very difficult as you can see from the examples at https://arxiv.org/html/2604.11778v1#A1. It's actually impressive that Gemini 3 Pro got 62%, and the strongest OpenAI and Anthropic models they tried were GPT-5.1 and Sonnet 4.5.

Paper and discussion history. A mention is not an endorsement.

General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks — mentioned by tcp_handshaker

Wed, 12 Aug 2026 11:41:47 GMT

Its the tools. Sell those RSUs while they last. Most of these are 2026.... Frontier LLMs Still Struggle with Simple Reasoning Tasks - https://arxiv.org/abs/2507.07313 General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks - https://arxiv.org/abs/2604.11778 LLMEval-Logic: A Solver-Verified Chinese Benchmark for Logical Reasoning of LLMs with Adversarial Hardening - https://arxiv.org/abs/2605.19597 LogicGraph: Benchmarking Multi-Path Logical Reasoning via Neuro-Symbolic Generation and Verification - https://arxiv.org/abs/2602.21044…

Paper and discussion history. A mention is not an endorsement.

General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks — mentioned by tcp_handshaker

Wed, 12 Aug 2026 11:36:02 GMT

You can easily test this yourself with the SOTA models....or read the corroborating literature... "General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks" https://arxiv.org/abs/2604.11778 "...General365, a benchmark specifically designed to assess general reasoning in LLMs. By restricting background knowledge to a K-12 level, General365 explicitly decouples reasoning from specialized expertise. The benchmark comprises 365 seed problems and 1,095 variant problems across eight categories, ensuring both high difficulty and diversity. Evaluations…

Paper and discussion history. A mention is not an endorsement.

General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks — mentioned by tcp_handshaker

Wed, 12 Aug 2026 11:35:05 GMT

Keep deluding yourself, unless you work for an LLM provider... "Frontier LLMs Still Struggle with Simple Reasoning Tasks" https://arxiv.org/abs/2507.07313 "General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks" https://arxiv.org/abs/2604.11778 "...General365, a benchmark specifically designed to assess general reasoning in LLMs. By restricting background knowledge to a K-12 level, General365 explicitly decouples reasoning from specialized expertise. The benchmark comprises 365 seed problems and 1,095 variant problems across eight categories…

Paper and discussion history. A mention is not an endorsement.