Track and modify objects in videos with Sensarea for Windows
Sensarea is a specialized video editor for the Windows operating system that allows you to track and manipulate objects in videos.
This can be useful for video creators who want to hide objects in a video they have captured, blur text or faces, or manipulate objects in other ways.
The application needs to be installed and suggests c: root for that. If you don't want it there pick another directory before you proceed.
It is also recommending Microsoft Pack during installation as it is required for some configurations according to the prompt. If you want to be on the safe side, accept the prompt to install the components as well.
The editor itself is divided into four panes starting with the layer and time bar at the top, and the object editing and preview pane at the bottom of the window.
Videos are loaded via drag and drop or by using the file menu. The program supports a wide variety of formats including flv, avi, mp4, mov and mpg.
The selected video is parsed by the editor which may take a while depending on several factors including its length and format.
You may then play the video right away to watch it in the interface, or use tools provided by Sensarea to mark objects in the video.
Most tools provide you with the means to mark specific areas, for instance by drawing a rectangle around them, using a brush to mark them, marking contrasted regions or by using vectors.
Most tools come with customization options, for instance to change zoom levels or the size of the brush.
Once you have made a selection you may decide to track it across the video or part of it, or not at all. Once you select the multi-track option the editor will start to track the selected object across all frames (until you stop the process or the video ends).
It does a good but not perfect job at that, at least not in the videos that I tried it with. That's not a problem though as you may post-process the automatic detection for better results.
A switch to the effects tab in the object editing pane displays 17 different effects that you can apply to the selected area.
Apart from hiding and blurring the selection, you may also zoom in or out on it, apply a cartoon-style effect to it or add text to it.
Export options are provided in the file menu to save processed videos to the local system. The output format is always avi if you select export but it is alternatively possible to export the processed video as a swf file.
Sensarea supports images on top of that. You may load individual images or image sequences into the program to process them in similar fashion.
Advanced features such as layers are supported as well which you may find useful.
Closing Words
Sensarea is an easy to use video editor that handles most of the heavy-lifting for you when it comes to editing objects in videos or image sequences. Since it tracks selected objects in videos and image sequences automatically,
It is usually necessary to post-process the automatic object detection though to remove noise or adjust the effects on a frame by frame basis. While that takes time, it is still much faster than processing videos manually frame by frame.
Results are impressive (you find additional output examples on the author's homepage) and the only drawback is that avi is the only output format the program supports.
Excellent response.
Thank you.
I’m looking forward to trying it.
Nice breakdown (as always).
Thanks Martin.
I have to convert my camera’s videos from AVI (to whatever I want) anyway, so the output format of the program isn’t a major issue for me, although, I can see how that could be a bit of a drawback for others considering that they’d need to convert the AVI.
Will someone please offer a brief description of what Microsoft Pack is?
@Professor Bertolino
From > Sensarea: an authoring tool to create accurate clickable videos
(https://hal.archives-ouvertes.fr/file/index/docid/694459/filename/cbmi_2012_bertolino.pdf)
3.3. Data export and openness towards other segmentation tools
“…The masks that are produced are independent and can be ex-ported for any other application in three different formats.”
Is that functionality available in the current version?
If so, what are the format types?
Hello Ken,
Thanks for your feedback and interest.
I am aware that only one output format (AVI) is not enough. The thing is that with Sensarea, we want to focus on video processing (our specialty) while video coding is not a priority and not so simple for us. We already worked hard to be able to read most of the usual formats. In the future, we hope we can spend time to propose some more output formats.
About data export: yes, this functionality is available with 3 different outputs:
* SWF files (Menu File / Export SWF…) creates one file per layer and can be used with Flash. If you have a Flash player (I guess you do), clicking on a generated SWF file launches the corresponding video of your masks. These files can be exploited with Adobe Flash tools and the ActionScript language.
* Binary image sequence (Menu FIle / Export video, image sequence…) produces one image per frame/layer. You can choose the image format, though PNG should be the most appropriate. It can be useful if you have your own process that needs to know what is inside / outside the mask.
* XML files (Menu File / Export XML) makes one file for the whole video. This is a text file (you can edit it to check its content and understand its structure that is quite simple). Each layer and mask is described between tags. Note that each mask is coded as a polygon, i.e. a sequel of X and Y integer coordinates and is SVG compliant. Here is an example below that describes the mask of layer 1 and frame 0, with 10 vertices (a star). It is rather simple to code its own XML parser (with existing libraries) to recover the polygons for your particular process.
1
0
10
By the way, Microsoft Pack is a set of libraries (known as vcredist_x86) that may not already be on your computer and that will be required by Sensarea. I suggest you make the install without it first, and re-install with it if Sensara doesn’t start. Anyway, it’s a secure pack.
I hope this helps. Feel free to contact me for any question.
Pascal
Just to mention that my XML example above was not rendered properly (the 1 0 10 lines). Email me if you want the correct version.
Many thanks Martin for this review of our software Sensarea. It should help us to get some feedback about what people do with it and what is their wish list. Thanks again,
Pascal
looks interesting, i’m going to try it
it is a good software to make object editing in videos:Select objects, track them, apply them effects and more. i will prefer it to everyone.