[HTML][HTML] Open-source tools for behavioral video analysis: Setup, methods, and best practices
Recently developed methods for video analysis, especially models for pose estimation and
behavior classification, are transforming behavioral quantification to be more precise …
behavior classification, are transforming behavioral quantification to be more precise …
[HTML][HTML] Keypoint-MoSeq: parsing behavior by linking point tracking to pose dynamics
Keypoint tracking algorithms can flexibly quantify animal movement from videos obtained in
a wide variety of settings. However, it remains unclear how to parse continuous keypoint …
a wide variety of settings. However, it remains unclear how to parse continuous keypoint …
[HTML][HTML] Identifying behavioral structure from deep variational embeddings of animal motion
K Luxem, P Mocellin, F Fuhrmann, J Kürsch… - Communications …, 2022 - nature.com
Quantification and detection of the hierarchical organization of behavior is a major challenge
in neuroscience. Recent advances in markerless pose estimation enable the visualization of …
in neuroscience. Recent advances in markerless pose estimation enable the visualization of …
Lightning Pose: improved animal pose estimation via semi-supervised learning, Bayesian ensembling and cloud-native open-source tools
Contemporary pose estimation methods enable precise measurements of behavior via
supervised deep learning with hand-labeled video frames. Although effective in many cases …
supervised deep learning with hand-labeled video frames. Although effective in many cases …
3d implicit transporter for temporally consistent keypoint discovery
Keypoint-based representation has proven advantageous in various visual and robotic
tasks. However, the existing 2D and 3D methods for detecting keypoints mainly rely on …
tasks. However, the existing 2D and 3D methods for detecting keypoints mainly rely on …
Unsupervised keypoints from pretrained diffusion models
Unsupervised learning of keypoints and landmarks has seen significant progress with the
help of modern neural network architectures but performance is yet to match the supervised …
help of modern neural network architectures but performance is yet to match the supervised …
3d human keypoints estimation from point clouds in the wild without human labels
Training a 3D human keypoint detector from point clouds in a supervised manner requires
large volumes of high quality labels. While it is relatively easy to capture large amounts of …
large volumes of high quality labels. While it is relatively easy to capture large amounts of …
BKinD-3D: self-supervised 3D keypoint discovery from multi-view videos
Quantifying motion in 3D is important for studying the behavior of humans and other
animals, but manual pose annotations are expensive and time-consuming to obtain. Self …
animals, but manual pose annotations are expensive and time-consuming to obtain. Self …
Autolink: Self-supervised learning of human skeletons and object outlines by linking keypoints
Structured representations such as keypoints are widely used in pose transfer, conditional
image generation, animation, and 3D reconstruction. However, their supervised learning …
image generation, animation, and 3D reconstruction. However, their supervised learning …
Relax, it doesn't matter how you get there: A new self-supervised approach for multi-timescale behavior analysis
Unconstrained and natural behavior consists of dynamics that are complex and
unpredictable, especially when trying to predict what will happen multiple steps into the …
unpredictable, especially when trying to predict what will happen multiple steps into the …