Capabilities of GPT-4 on Medical Challenge Problems · HackerPapers discussions

Capabilities of GPT-4 on Medical Challenge Problems — mentioned by famouswaffles

Thu, 20 Apr 2023 19:08:52 GMT

Base GPT-4 was highly calibrated. read open ai's technical paper. also, this paper on gpt-4 performance of medical challenge problems confirmed the high calibration for medicine https://arxiv.org/abs/2303.13375

Paper and discussion history. A mention is not an endorsement.

Capabilities of GPT-4 on Medical Challenge Problems — mentioned by famouswaffles

Mon, 10 Apr 2023 01:04:08 GMT

Interesting tidbits - Not all these models are instruct aligned - Cohere's suite is free for personal use - anthropic uses reinforcement learning from ai feedback for instruct alignment, removing humans from the process almost entirely(humans still make the rules the language model checks the responses against). - open ai's models are pretty poorly calibrated compared to its peers. Calibration is how well the model's confidence solving a problem tracks with how it actually performs that problem. It seems to be a consequence of the way they are performing the instruct tuning (or maybe it's a…

Paper and discussion history. A mention is not an endorsement.

Capabilities of GPT-4 on Medical Challenge Problems — mentioned by fernly

Sun, 26 Mar 2023 23:23:25 GMT

In the full paper[1] read the examples of GPT-4's actual responses, e.g. Figs 3.1 and 7.1 and forward. Very, very impressive. [1] https://arxiv.org/pdf/2303.13375.pdf

Paper and discussion history. A mention is not an endorsement.

Capabilities of GPT-4 on Medical Challenge Problems — HN submission

Sun, 26 Mar 2023 21:23:02 GMT

Capabilities of GPT-4 on Medical Challenge Problems

147 points; 135 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Capabilities of GPT-4 on Medical Challenge Problems — HN submission

Fri, 24 Mar 2023 04:28:40 GMT

Capabilities of GPT-4 on Medical Challenge Problems

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.