Pixy Open Source Camera Recognizes Objects by Color: Smart Sight

Computers and sensors are quickly decreasing in cost and size, making it easier than ever before to build smart gadgets or robots. From accelerometers to thermal sensors, electronics nowadays can detect and record a variety of events and objects in their surroundings. Here’s one more sensor to add to your robot overlord-in-training. It’s called Pixy, a camera that identifies objects through color.

pixy camera vision sensor by charmed labs and cmu

Pixy was made by Charmed Labs and embedded systems experts from Carnegie Mellon University. It’s actually the team’s fifth version of a smart and low-cost vision sensor, which they previously called the CMUcam. What separates the Pixy from other image sensors is that it only sends a small amount of data and it has its own microprocessor. These traits make it possible to integrate the Pixy even to microcontrollers like the Arduino.

pixy camera vision sensor by charmed labs and cmu 2

Pixy identifies objects using “a hue-based color filtering algorithm”, which supposedly makes it consistent under different lighting conditions. It can also identify hundreds of objects at once. The image below is a screenshot of PixyMon, an open source debugging program for Pixy.

pixy camera vision sensor by charmed labs and cmu 3

As you’ll see in the video below, Pixy can also track moving objects. That’s because it updates once every 20ms, fast enough to keep up with an object moving at 30mph. You can then gather Pixy’s data through UART serial, SPI, I2C, digital out, or analog out.

Pixy can be taught to “remember” up to seven different objects, but you can expand its memory by using color codes. Color codes are simply stickers or strips of paper with two or more different colors. Color codes increase Pixy’s color-coded encyclopedia from seven to several thousands.

pixy camera vision sensor by charmed labs and cmu 4

Pledge at least $59 (USD) on Kickstarter to get a Pixy and an Arduino cable as a reward.

What will you build with Pixy? A security camera that texts you when your cat goes out? A color-seeking water bomb? A clown-loving machine? A drone that follows you around? A box of crayons that can tell you what color you picked? A weapon that works only on people wearing red? A LEGO sorter that can tell you which pieces are missing from your collection? A camera that automatically takes pictures of the sunset? A wearable assistant for colorblind people? A ticker that counts which Premier League referee hands out the most yellow cards? A useless machine that won’t turn itself off if you’re wearing the right color? Are the things I’m saying even possible?

Robot Foosball Player Developed

Man vs Machine is always a theme that will continue playing out for quite some time to come, no doubt about that. After all, we have seen how humans have more or less competed against computers in the game of chess, but when it comes to something more physical than cerebral, robots have a problem here since they have to deal with coordination and computation, where the former requires a whole lot of work. Students from the École Polytechnique Fédérale de Lausanne in Switzerland have come up with a robot table-football (aka foosball) player which is capable of kicking the ball faster compared to most humans’ reaction times, but will they be as accurate as a human?

I am quite sure that in due time, the robot would have been “injected” with improvements to its artificial intelligence to be a formidable opponent, in addition to getting upgrades to its accuracy and ability to strategize. This particular robot foosball player is capable of kicking the ball across the table and into the goal, normally before most folks are able to set up their defense. A couple of computers will power its levers, sending the ball at a speed of six meters (20 feet) a second, and a camera is essential to make sure that this robot has got the tabs on the game at all times.

  • Follow: Robots, foosball,
  • Robot Foosball Player Developed original content from Ubergizmo.

        



    Linda The Security Robot

    Right now, you can say that 100% of the bodyguards that heads of state as well as celebrities and anyone who deem themselves to be important enough to be protected, tend to be human, as I have yet to see an alien lifeform play the role of a bodyguard. The thing is, a future where a robot would take the place of a human bodyguard does sound rather unnerving, and you might actually be witness to the start of the robotic apocalypse today – via Linda, the robot security guard.

    Before you think that “Linda” is a female version of the T-800, it is actually a robot who would come in handy when it concerns security as well as elderly care home resources. Linda does not come cheap, however, where it costs a whopping £25,000 robot that resembles a human-sized chess pawn, and since robots do not get tired, nor do they have a union to fight for better working conditions and a pay raise, Linda does seem to be the ideal “person” to have around an elderly nursing home, as humans sometimes are too fatigued to realize that one of the home’s residents there need urgent medical attention. Would you like to see a “male” version of Linda being manufactured as well?

  • Follow: Robots, ,
  • Linda The Security Robot original content from Ubergizmo.

        



    DARPA Robotics Challenge Atlas Robot unboxed by MIT

    If you thought the unboxing of the DROID Ultra was amazing, you’ll need to sit down to watch the unboxing of the Atlas robot provided by DARPA to MIT. This robot is a humanoid piece of machinery made to work on developing next-generation solutions to dangerous situations where a human-sized being is needed, but it’d […]

    Little Robots Turn Marker Squiggles Into Sound

    Little Robots Turn Marker Squiggles Into Sound

    All the little droids zipping around the Star Wars universe seemed sort of frantically aimless. Where were they going? These little robots look similar but their mission is clear. Follow the black circuits and turn untold scribbling into music.

    Read more…


        



    Braava 320 And Braava 380t Floor Mopping Robots Launched

    Braava 320 And Braava 380t Floor Mopping Robots Launched

    iRobot announced today that it has achieved a significant milestone of selling more than 10 million units around the globe. The company already offers a broad portfolio of robots that do cleaning jobs and much more. Today, the company announced two models of the Braava Floor Mopping Robot, Braava 320 and Braava 380t. These robots have been designed to systematically and efficiently dry or damp mop hard floors, keeping them free of dust and other debris.

    Both Braava robots are capable of cleaning virtually all hard-surface floors, including vinyl, hardwood and laminate. They use disposable or reusable cleaning cloths which can be easily attached or removed. The robots start simply with the push of a button and once they’re done, they return to the point from where they started. There are two cleaning modes. In Dry Mop mode the robots will sweep back and forth in straight lines using dry cleaning cloths to scoop up dirt and dust whereas in Damp Mop mode they use a special back and forth mopping action with damp cleaning cloths to lift any dirt and grime off the floors. The expanded features of Braava 380t include a Pro-Clean system that dispenses liquid during the cleaning cycle and a bigger battery. Braava floor mopping robots are now available from iRobot’s website, pricing starts at $199.

  • Follow: Robots, Braava 320, Braava 380t, ,
  • Braava 320 And Braava 380t Floor Mopping Robots Launched original content from Ubergizmo.

        



    WittyWorX And Their IXI-Play Green Robot Owl

    A new Silicon Valley startup known as WittyWorX has come up with an interesting new robot – not one for the military, and neither is it meant for some sort of heavy duty task, but rather, the IXI-Play is a green robot owl that was specially developed in order to interact with your little ones. In fact, it has been described to feature a “rich set of sensors and expression capabilities to support the playful interaction” with your kids. Sporting lifelike body movement and posture, animated eyes and sounds, the IXI-Play happens to be a decent performer when it comes to expressing its “emotions” during game play, assuming that robots are capable of “emotions” through its various algorithms in the first place. Kids have been touted to recognize and enjoy such interaction, which makes the IXI-Play feel as though it is a real life buddy that offers playful interaction. An early introduction to Furby, perhaps?

    What are some of the little toy robots that you think your kids would love you for it should you have gotten it for them in the days (or months) ahead? Will a Furby be able to make the cut this year, or are they already targeting the possibility of dad or mom bringing home a PS4 or Xbox One?

  • Follow: Robots, ixiplay,
  • WittyWorX And Their IXI-Play Green Robot Owl original content from Ubergizmo.

        



    Legobot Is A DIY 3D Printer

    There is nothing quite like a DIY project to keep you occupied, especially when you have plenty of technical know how brimming in your head, and want to “free” all of that in a project that you have an interest in. I do not know of many people who are able to turn down a shot at Lego building, and if you have always wanted to own a 3D printer of your own, why not build one using Lego bricks? That is what engineering student Matthew Kreuger came up with, where you require an old camcorder, a hot glue gun and a few hundred bricks of Legos, you are more or less good to go. The full instructions can be found on popular maker site Instructables.com if you are interested.

    Kreuger did mention that this particular DIY 3D printer happens to reside more in the realm of prototype territory compared to being a finished article, but it is capable of churning out 3D objects that have been modeled with LEGO’s Digital Designer software in hot glue. A LEGO NXT brick will be used as the “brain” of the printer, as that is where it operates the printer from, via its trio of output ports that will be used to attach motors, with a quartet of input ports that will see sensors attached to it. Nothing like a little creativity and circumstance (lack of money in this case for the masses) to see an affordable solution, eh?

  • Follow: Robots, , ,
  • Legobot Is A DIY 3D Printer original content from Ubergizmo.

        



    Vertwalker The Robotic Artist

    Most of us would think of robots to be unthinking individuals that run on logical programming (which is input by a human, of course), and artificial intelligence alone can only go so far. In fact, I don’t think that the day will come when an artificial intelligence system becomes self-aware and sentient, and even if that happens, will it actually claim that humanity is a threat unto itself, and it would want to “correct” the situation and enslave all of us humans, just like how the movies have always depicted? The e-David robot as well as RoboThespian have been seen to be a patron of the arts somewhat in the past, and this time around, we have the Vertwalker, autonomous wall-crawling robot which also doubles up as an artist.

    It has been shaped in the form of the Roomba somewhat, although the main purpose of its existence is not to clean up after your mess, but rather, to create “artwork” (now, art is a very subjective topic, don’t you think so?). Make sure that the Vertwalker’s arm is equipped with the right kind of artistic tool, and it is good to go. This is the third-generation prototype, and we await with bated breath for the first robotic art superstar still.

  • Follow: Robots, vertwalker,
  • Vertwalker The Robotic Artist original content from Ubergizmo.

        



    JPL’s RoboSimian flexes its robot muscles, haunts your nightmares (video)

    JPL's RoboSimian flexes its robot muscles, haunts your nightmares

    Not content on landing several rovers on the surface of Mars, NASA’s JPL team’s been working on more earthly projects. RoboSimian is an ape-like robot designed for search-and-rescue missions that’s expected to compete in the DARPA Robotics Challenge. It features four multi-jointed limbs with unique hands and no defined front or back — allowing it to always face the right way. Thanks to its primate-like movement and posture, the robot will be able to navigate over difficult terrain, climb ladders and even drive vehicles (one of the DRC’s requirements). While the project itself isn’t new, JPL recently published an interesting video that shows RoboSimian gripping tools, lifting its own weight and balancing delicate objects. This means, of course, that robot monkeys will soon join spiders, cats and dogs in your dystopian nightmares. Video after the break.

    Filed under:

    Comments

    Source: JPL