Skip to content

Attempting to create a program capable of combining stereo video input , with motors and other sensors on a PC running linux , the target is embedded linux for use in a robot!

Notifications You must be signed in to change notification settings

AmmarkoV/RoboVision

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AmmarServer

RoboVision

A GPLv3 Computer Vision / Robotics Project that aims to provide a compact software stack for generic vision enabled robotics!

Documentation


To start , you can begin by reading my BSc thesis which while give you a detailed overview and the computer vision theory that it is based on in the Documentation directory.

https://github.com/AmmarkoV/RoboVision/blob/master/Documentation/GuarDDoG_RoboVision.pdf?raw=true ( or here http://ammar.gr/GuarDDoG_RoboVision.pdf ) ( or here http://users.otenet.gr/~ammarkov/files/GuarDDoG_RoboVision.pdf )

or the presentation slides

https://github.com/AmmarkoV/RoboVision/blob/master/Documentation/guard_dog_presentation.pdf?raw=true ( or here http://ammar.gr/guard_dog_presentation.pdf ) ( or here http://users.otenet.gr/~ammarkov/files/guard_dog_presentation.pdf )

My more recent work is increasingly human/object tracking relevant and you can see an updated list of publications here https://scholar.google.gr/citations?user=sDOdhtwAAAAJ&hl=en&oi=ao

Status


I have stopped active development on this project for several years now, since I am currently working in EU robotics projects ( http://hobbit.acin.tuwien.ac.at/ , http://www.ramcip-project.eu/ramcip/ and others )

This work is still premature but in the future maybe I will revisit it and continue to work on it. The testing platform for the software is my pet project named “GuardDoG” ( http://ammar.gr/gddg/ ) , a surveillance robot guard for homes and offices. Most of the layers of the project are abstract enough to be able to be used by different designs.

If you don't have the specific motors/ sensors etc , this repository will not be able to work out of the box, you can however use specific parts of it since isolated they might be useful.

Spin-offs


Parts of this original work have now been split in seperate "less monolithic" spin-off repositories , such as

https://github.com/AmmarkoV/RGBDAcquisition - A uniform library wrapper for input from libfreenect,OpenNI,OpenNI2,OpenGL simulations,V4L2 and other types of video and depth input.. This basically is a much better version of the "Video Input" module of this repository which is transparently compatible with a large variety of sensors including RGBD cameras.

https://github.com/AmmarkoV/AmmarServer - A lightweight http server for linux This can help in building a proper web interface ( instead of the simple one in RoboKernel/webinterface.c which relies in files shared between this and an Apache session )

https://github.com/AmmarkoV/OpenDroneA - A repository for the blueprint of a quadcopter drone A drone can be an alternative "body" for a robot vision system

https://github.com/AmmarkoV/AdvancedImageSearch - Command line tools that enable content-aware image browsing from the CLI

Implementation


RoboVision works ONLY on linux, and uses V4L2, wxWidgets, OpenGL, Festival, CMU Sphinx, OpenCV , Apache and other foss as extensions. I have made an effort to implement everything in a low enough level so that the console “daemon” mode will need only V4L2 support, and everything will be compiled together to reduce unneeded overheads. Lately I have added OpenCV as a library dependency to speed up development by using some thoroughly tested function calls and reducing the debugging surface. An effort has been also made to keep libraries clean of bloat and the whole project could easily be ported to another platform , but there is currently no benefit for the extra maintenance cost , so there are no ( and probably will never be :P ) plans for porting it to Windows or Mac.

Due to the complexity and combination of computer science fields involved ( Computer Vision , Natural Language Processing , Artificial Intelligence , Embedded Systems , Robotics [among the most important] ) the project has still not reached maturity and development is continued until an acceptable functionality level is reached..

Once you download the project ..

To automatically resolve the dependencies of the project run .Scripts/Setup/apt-get-guarddog-dependencies if you have a Debian/Ubuntu based distro ( package names may vary from version to version , but I try to update them to the last possible version ) , or using .Scripts/Setup/pacman-guarddog-dependencies for Arch and pacman based distros..

To compile it you will need to run the custom make bash script in the parent directory typing ./make from the shell while being on the root directory of the project ( NOT "make" BUT "./make" it is not a standard makefile but a bash script )

The IDE used for the development of the Project is Code::Blocks , and you can use the workspaces on the root directory that open the sub projects , in any case , once you download a fresh copy of the project be sure to run ./make first to compile any libraries that may be needed and are not part of the workspace

I Hope you'll find this project/repository useful ..!

About

Attempting to create a program capable of combining stereo video input , with motors and other sensors on a PC running linux , the target is embedded linux for use in a robot!

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published