ad
ad

How to Animate in Blender - FREE Mocap Ai Tools!

Film & Animation

How to Animate in Blender - FREE Mocap AI Tools!

If you've ever wanted to try your hand at motion capture, you might have been put off by the steep prices and complex setups. Fortunately, investing a fortune in a high-tech onesie isn't necessary to begin experimenting with motion capture. All you really need is a camera, an actor, and AI. In this article, we'll explore some free video-to-mocap solutions that utilize AI and are compatible with Blender. By the end, you'll have several tools to help you get well acquainted with motion capture, setting you on your way to creating the next Planet of the Apes.

Getting Started with Mocap AI Tools

Roco Vision

Roco Vision is an online tool that allows you to upload a video and convert it into a 3D animation with the click of a button. Here's how to get started:

  1. Record Your Shot: Record a video of your actor or yourself performing a movement. Use a wide-angle shot to capture the full body, make your actor stand out from the background, and limit motion blur. It’s also helpful to start with a T-pose.
  2. Upload and Convert: Create a free Roco Vision account, upload your video, trim as necessary, and convert it into an animation.
  3. Download and Import: Download the resulting FBX file and import it into Blender.

For the best results, keep your feet stationary, ensuring stability in the conversion.

Deep Motion

Deep Motion works similarly to Roco Vision but handles more complex movements, making it a great option for dynamic actions.

  1. Record and Upload: Record your video, upload it to Deep Motion, and customize settings if needed.
  2. Download and Import: Once the animation is processed, download the FBX file and import it into Blender.

Deep Motion offers additional customization options which may improve your results depending on the complexity of your movements.

Plask 3D

Plask 3D differentiates itself by allowing you to apply animations directly to your own uploaded character.

  1. Create Account and Scene: Create a free Plask 3D account and start a new scene.
  2. Upload Footage and Character: Upload your video footage and your rigged character in a T-pose.
  3. Apply Animation: Drag your animation to the root bone of your character, let the AI process it, and export as an FBX file.

This flexibility allows for more personalized animations with characters you’ve designed or sourced externally.

Retargeting and Clean-up in Blender

If you're using Roco or Deep Motion, you might need to replace the default character. Here’s a brief guide on how to retarget the animations:

  1. T-Pose Resting Position: Ensure your model is in a T-pose. Duplicate the armature modifier and hide the duplicate. Apply the original modifier, unhide the duplicate, and set your pose as the rest pose.
  2. Roco Add-On: Install the Roco Blender add-on to automate retargeting. Use the source skeleton (FBX) and your character as the target. Adjust the bone list if needed and retarget the animation.

Cleaning Up Animation

While motion capture is a powerful tool, it often requires refinement:

  1. Smooth Twitching and Jittering: Use the Graph Editor to smooth out jittery animations by adjusting Gaussian smoothing for the keyframes.
  2. Nonlinear Animation: Use Blender’s Nonlinear Animation Editor to layer edits over the base animation, allowing you to keep the original while making precise adjustments.
  3. Foot Slippage: Edit your rig into an IK (Inverse Kinematics) rig to eliminate foot slippage. Use animation layers to ensure the feet stay in place.

By following these steps, you'll have three powerful AI tools at your disposal and the knowledge to tweak and refine your animations with Blender.

Keywords

  • Motion Capture
  • Blender
  • AI Tools
  • Animation
  • Roco Vision
  • Deep Motion
  • Plask 3D
  • FBX Import
  • Retargeting
  • Animation Cleanup
  • IK Rig
  • Nonlinear Animation Editor

FAQ

Q: What do I need to start with motion capture using AI tools? A: You need a camera, an actor, and access to AI tools like Roco Vision, Deep Motion, or Plask 3D.

Q: How do I record a video for motion capture? A: Use a wide-angle shot to capture the full body, ensure the actor stands out from the background, limit motion blur, and start with a T-pose.

Q: Which AI mocap tool is best for complex movements? A: Deep Motion handles more complex movements better compared to other free options.

Q: Can I use my own character with these tools? A: Yes, especially with Plask 3D which allows you to upload your own rigged character.

Q: How do I clean up jittery animations in Blender? A: Use the Graph Editor to apply Gaussian smoothing to the keyframes and use the Nonlinear Animation Editor for refined adjustments.

Q: How do I prevent foot slippage in my animations? A: Edit your rig into an IK rig and make necessary adjustments using animation layers to keep the feet stationary.

Understanding these tools and techniques will help you dive into the world of motion capture without a significant investment, providing a great entry point into more advanced animation projects.