MouseGPT: A Large-scale Vision-Language Model for Mouse Behavior Analysis — mentioned by hummuscience

Thu, 17 Apr 2025 13:51:41 GMT

The moment I started reading this, I got reminded of this recent study: https://arxiv.org/html/2503.10212v1 The scope is a bit different. The study uses an LLM to interpret pose estimation data and describe the behavior in each frame. The output is text which can be used to create embeddings of behavior. As someone who works in ethology, that's a clever (but maybe expensive) idea. I think the author could use something similar. With multi-person pose estimation models.

Paper and discussion history. A mention is not an endorsement.

MouseGPT: A Large-scale Vision-Language Model for Mouse Behavior Analysis · HackerPapers discussions

MouseGPT: A Large-scale Vision-Language Model for Mouse Behavior Analysis — mentioned by hummuscience