BLOG > Nerf Sentry Gun…be afraid.

The nerf sentry gun was developed as a final project for Cornell University’s CS1114 Matlab Robotics class.  Jason Wright and I worked on the gun together, and were awarded “coolest final project”.

Check out the video of the gun in action, and see how we built it:

READ ON FOR PICTURES, SOURCE CODE, AND A COMPLETE FEATURE LIST

FEATURES

Authentication Mode
This tells the gun to actively prompt things that move in front of the camera for badges and then shoots them if they fail to present a badge. Anybody who enters has their image uploaded to the web (cs1114.jeremyblum.com) along with the date of entry, and whether or not they were approved to enter. This information is twittered as well (www.twitter.com/nerfsentrygun)

Freefire Mode
Tracks and shoots anything that moves.

Panic Mode
Plays a siren, turns on the gun, and rotates the gun semi-randomly.

Manual Mode
Allows you to control the gun manually.  Arrow keys rotate the gun and the space bar fires.

HOW IT WORKS

Matlab Image Tracking
A matlab program is responsible for performing all image tracking tasks.  A USB webcam and the image acquisition toolbox allow matlab to capture a video stream and analyze frames to ascertain velocity vectors.  Scale-Invariant Feature Transform (SIFT) image recognition software is used to identify a badge in authentication mode.  A custom matlab GUI is used to switch between modes, change color maps, and more.

National Instruments USB DAQ-6008
This digital I/O device was interfaced to matlab using the data acquisistion toolbox to allow for control of the trigger and gun.  Channel 0 outputs a 5V signal to a mosfet in the handle of the gun that activates the trigger.  Outputs 1 and 2 connect to a basic stamp motherboard for control of the rotation servo.  Matlab can be used to turn these outputs on or off at the appropriate times.

Basic Stamp 2 and Motherboard
A basic stamp was responsible for controlling the rotation servo.  Upon receiving an input signal from the DAQ, it will rotate the servo right or left (depending on which input was activated).  It also interfaces to two hooks that sit behind the gun and act as limit switches.  When the gun rotates all the way in one direction, a hook on the gun attached to a 5V rail makes contact with a hook connected to the basic stamp.  This sends a 5V signal to the stamp on this channel so the stamp knows to stop rotating the motor.

Trigger Circuitry
A trigger circuit was assembled in the handle of the gun, it runs in parallel with the existing trigger, so the gun can still be fired manually.  Sending this circuit a 5V signal from the DAQ tells it to close the motor circuit and fire the gun.  The schematic for this circuit is included in the download below.

Physical Setup
A futaba servo is attached to the bottom of the gun.  Modifying the original tripod mount allowed us to attach it fairly easily.  Unfortunately, this motor does not provide a huge amount of torque.  This is why the gun turns somewhat slowly.  To compensate slightly for this, we made the battery pack external to reduce weight on the motor.  This motor setup is attached to two metal napkin holders (totally not stolen from a dining hall) using gorilla glue.  The entire setup is on a cardboard sheet to maintain proper spacing.

SOURCE CODE AND SCHEMATICS

These materials are made available via a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.  Feel free to modify and improve upon this code as much as you like, but share your improvements and credit myself and Jason Wright as the original authors.  Please do not use this code for commercial purposes without first asking for our permission.
Creative Commons License
Download Nerf Sentry Gun Source Code and Schematics

PHOTO GALLERY

MATLAB FUNCTIONS UTILIZED

MATLAB SIFT Function by vlfeat.org
MATLAB twitter Function by Navan Ruthramoorthy
MATLAB passive FTP Function by Idin Motedayen

57 comments

  1. Hi,

    how do you do the position tracking in automatic mode?
    I.e. how do you aim at the intruder.

    Do you use SIRF features for this, too?

  2. Hell,that’s the best gun i’ve ever seen!How does the computor know if the badge is correct,i mean,a badge could be anything!

  3. An image of accepted badges is stored in the computer. A program called Scale-Invariant Feature Transform (SIFT), is used to determine if the badge presented matches the one stored in the computer.

  4. Hey guys,you hav done an excellent job,Of course i just wanna to run ur codes in my matlab stimulator but i couldn’t, can you help me guys

  5. Hey guys u hav done a great job, i hav downloaded ur source code, when i make it run in my computer it shows me some error,con u help me guys

  6. Would you find sending me instructions of how to set up the software and run it in matlab R2009a? Can you run it just in matlab to test it? I want to hook this up to a paintball gun with the same concept of yours.

  7. You’ll have to execute the files in the MATLAB environment. Makes sure you’ve downloaded the functions that I mentioned in my post. The comments in the M-files should explain what you need to know.

  8. I see in the first photo that the slide is in place on the gun. How did you manage to get the slide off? Did you have to cut it?

  9. It’s very difficult to get apart once you get it on the gun. We didn’t cur it, but we did use a combination of pliers, a screw drivers, and two people to pry the plastic cap off.

  10. cool if it had some sort of facial recognition thing so it would shoot only certain people
    especially in a nerf war

  11. I’m attempting a similar project and have a couple of questions for you.

    1) What type of servo did you use? How much torque did it require?

    3) Do you have any other photos showing how you mounted the servo for controlling the spin?

    Thanks!

  12. It’s a standard futaba servo. We actually should have used a higher torque motor. This one was underpowered.

    All the photos are here. We mounted it to the bottom of the tripod cylinder.

  13. bro, this servo controller is miscontinued, can u point us another servo controller that can work with this system, bro ?

  14. dude, this is awesome. You could use that for a nerf war, or you could hook it up to a real gun and fight in a real war.

  15. hey jason , i m working on your nerf sentry gun project as my final year project … i wanted some help from you .. plz reply me .
    thanks

  16. i have not really worked or studied image processing. so i was hoping if u could just tell me what exactly should be my point of interest while starting/studying DIP. im good with micro controllers so i am really wiling to go for this project. thanks

  17. Can you please tell me which servo motor you used? Will the Standard HITEC HS-311 will work in this project.

    1. I think it was a futaba continuous rotation servo… But any normal hobby servo will do. However, you may wish to consider using something with a bit more torque, or even using a stepper, since the servo we used was underpowered for this project.

  18. Pingback: Jasonline » Blog Archive » Nerf Sentry Gun
  19. Pingback: Nerf sentry gun with image recognition @ NerdNewz.Net
  20. Pingback: Nerf sentry gun with image recognition | News for Geek
  21. Pingback: Nerf Sentry Gun checks badges, shoots intruders | Technology Gadgets Review
  22. Pingback: Nerf Sentry Gun checks badges, shoots intruders | GeekStream Gadgets
  23. Pingback: Interesante proyecto de robótica - Mundo Informática
  24. Pingback: Nerf Sentry Gun (spring 2009) « Jason Wright

Leave a Reply

Your email address will not be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: