GSOC Tomato Branch: Camera Tracking

This year’s Google Summer of Code brings some exciting new features.
One of them is Camera Tracking, which is currently being developed in the so called “Tomato Branch” by Sergey Sharybin and the guys from LIBMV, which provides the algorithms for the tracker. In this video tutorial you will get an introduction how to do supervised manual tracking and scene reconstruction of some HD video footage. But the development is so incredibly fast that by the time you see this tutorial there are probably already new features and it will be even easier to use the tracker.
If you want to make sure to keep up with development, it will be best to build the tomato branch yourself. See the links below for more information.
Or you use the easy way and download from www.graphicall.org.

Building Blender in OSX: http://www.blendercookie.com/2010/10/25/building-blender-in-osx/
Building Branches on OSX: http://www.vimeo.com/25567856
The latest tomato builds: http://graphicall.org/?keywords=tomato

Update: In the short time since the above tutorial was published there are already some good new features!

Leave Comment

Discussion

90 Responses to “GSOC Tomato Branch: Camera Tracking”
  1. Posts: 7
    John says:

    After setting up the markers and clicking “Solve Camera”, I’ve been running into issues where the camera just resets back to its original orientation during some frames, while it is positioned correctly in other frames. Tweaking the first and last keyframes seems to help, but is there a better way to guarantee a good solve?

    • Posts: 14
      sebastian_k says:

      I have the same problems as well from time to time. There are numerous factors that can have an effect on the solution: the right focal length, sensor size etc. But I would say the most important aspect is if the markers are on screen long enough. On footage with lots of movement the trackers can easily slide off or just leave the frame, and if there “life” is too short it can confuse the tracker. Often their bundles in 3d space are way off. Try to find and eliminate those and solve again. Sometimes that helps.

  2. Posts: 5
    andrashy says:

    I’m having trouble solving the track. After I solve, all the tracking bundles look like they’re in the right place and the camera movement matches the video, but my camera is always pointed in the wrong direction. Sometimes the bundles are behind it and sometimes the camera is rotated the wrong way. If the 3d camera were rotated a bit to the left then it would be perfect. What am I doing wrong?

  3. Posts: 2
    asd asddd says:

    I see there’s now a feature to automatically detect and add good track point candidates (“Detect features”).

  4. Posts: 1
    DK says:

    Thanks for the great tutorial! Is there any info out there of how to composite the 3D into the movie clip fro a beginner? Thanks again!

  5. Posts: 1
    Dooble studios says:

    Thanks Sebastian!

    At first the tracking wasn’t working. But finally after 5 times of re-doing it, It finally worked and im really pleased with the results :)

    Again thank you!

  6. Posts: 1
    Dorian says:

    Looks very cool, but i have a problem.
    I am doing it like you but in console it writes “No camera for frame 0″
    WTF? I dont know where is problem, i tried everything. Please help…

  7. Posts: 1
    angela says:

    I didn’t find movie clip editor.plss!help me I need ıt.where can I find ??

    • Posts: 3837

      Which version of Blender are you using? The Camera Tracker is only in development versions of Blender, currently, and so you will have to download one from Graphicall.org

      -Jonathan

      • Posts: 10
        Maia says:

        That pillar goes right in front of the cube! How would one go about making a mask so that you can simulate that happening when you render it out?

  8. Posts: 1
    manu says:

    A-M-A-Z-I-N-G! Thanks!

  9. Posts: 1
    ThaMajesticWun says:

    OMG THANK YOU! I have one problem though. When I render using Nodes, only the 3D objects render. But when I hit F12 with everything going through the File Output Node, it renders both the Footage and the Objects. I’m Doing Something Wrong. Please Help!

  10. Posts: 25
    Ben says:

    This doesn’t work for me… I do it exactly as he does it and my cube always slides around all over the floor… What’s weird is that it’s a good track and it lines up with a background image, but when rendered, it doesn’t line up. Help anyone?

  11. Posts: 109
    Gary Parkin says:

    Thanks Sebastian. This was pretty cool.
    In the update you constructed a fake floor and added a uvmap to it and a camera projection. I watched it 3 times trying to get it. Can you please elaborate on this?
    It looked really neat for rotoscoping, or occluding an object.

  12. Posts: 4

    is there any way to export either the tracking data or the camera movement out to, say, Adobe After Effects?

Leave a Comment

You must be logged in to post a comment.