Gaze Technology

Discussion and feedback on Construct 2

Post » Fri Mar 09, 2012 10:24 am

Just for the information, the Tobbii is recording the glint of an IR light on the retina. So no arousal information from pupil dilatation.
Another information : you can't infer what people are doing just by looking at their mouse trail patterns (because in the end, it's just that). You need to correlate that with what's onscreen at the moment they were looking.
And no computer, available at the right price for the public, can record a fullscreen video (let say something starting from 1440x900) while generating the graphics at the same time, without stuttering (think about fullframe acquisition, storing in RAM, realtime compression and disk access time, while generating graphics...)
And, just for the record, I worked with those, so I don't say they are not useful : for disabled people, hemiplegia/tetraplegia, it's a wonderful tool. It's the difference between locked in your body, and interacting at least with a computer to say and do things to the world...
B
33
S
9
G
6
Posts: 709
Reputation: 6,704

Post » Fri Mar 09, 2012 2:41 pm

@Pode, your no fun. I did not read about the glint. That is interesting... Identification from the eye is currently being used by the Government. All they need is a picture of it. Every person's Iris is different, like a fingerprint.   If they are using a couple of IR cameras, the likelihood of using it against you are slim, but honestly, if the government wanted to, and you have any kind of camera hooked up to your machine, they could do what we were suggesting already.    But for this to be true, they would have to have a picture of your eye already on file.   

Boy, how we did digress on this thread...

My original point is, I want to use eye tracking technology in my games. I hope it comes to pass!

@Pode, "I worked with those". Have you used eye tracking technology?

B
192
S
6
G
7
Posts: 213
Reputation: 10,178

Post » Fri Mar 09, 2012 4:09 pm

@Zetar : but, I'm fun ! (At least, ask those on the IRC chan, I always have something to discover regarding babies, with my daughter )
Yes I worked with one of those devices, but not a Tobii specifically.

About the glint/identification, they aren't the same.

The glint, used in eyetracking, is from an infrared LED shined through the cornea, bouncing back on the retina, and coming back through the cornea, leaving 4 "dots" (because of the two refractions of the cornea). That lightning blob pattern is then tracked by the eyetracker.
It only works if the head isn't moving, obviously. If the head is free to move, you also need to know the head displacement regarding the camera (a plane of displacement, in fact, parallel to the camera, and three axis of rotation, for the head on the neck).
It's still possible to track that : you need a wide lens camera, working in visible light (a regular webcam, in fact ) to track the head movements. You can use models like Active Appearance Models, or Dementhon's POSIT (because the head is an undeformable solid regarding the problem interesting us here) to follow the head.
When I worked with that 5 years ago in my lab, and using OpenCV (Matlab is slow as a turtle for that), it wasn't possible to do that realtime.
I remember the setup : a USB webcam (the ToUcam II at that time the only one able to do 60 fps), and a second one with the IR filter removed.
In the end, we could only do the tracking on videos, because no computer could do realtime what we wanted to do : two webcam streaming at 60 fps, you need to do the AAM on one of the image, blob tracking on the other and mouse pointer interpolation (because remember that the head isn't moving all the time, and the eye, even moving, wasn't covering the whole image, so we needed to create a relationship between a displacement on a 320x240 or 640x480 image from the eye and the whole screen image, at 1650 or something - each 1 pixel evaluation error from the webcam cost us a x3 error on the cursor position ! And since the eye is jittering all the time, because of the saccades, you can imagine the performances where terrible !
Furthermore, the USB2 protocol is maxed out by images at 640x480, at 60 fps - remember that you have the overhead of the protocol on top of that, and DMA was good enough to do that for two cam in parallel...)

With Tobii, all that is done on the chip, so it can be done fast. But they are two problems, in the end : first, we don't really know what are the health effects of shining IR lights 8 hours a day or more on the retina of a geek (my wife is an optometrist, and she did biblio work on that). Second, they are 3 interactions with the mouse pointer : move, designate, interact. You can do the move part with the eyetracker, you can designate by leaving the cursor on the target, but how do you interact (ie. send a command to the computer) ? You need another channel (and no, the eyebrow isn't going to make it, even by frowning, or flapping the eyelid. Too cumbersome. At the end of the day, you are going to die with two heavy, muscular eyelids ).

To make an efficient iris-recognition, you need to do an high-res picture of the iris, warp the image from polar coordinates to cartesian (to make the comparison possible against a database). That's why it only works with really good cam (CSI only works on TV, you know. And by the way, who in Hollywood thinks you can go on crime scene in a suit, and that a blonde legist can search evidences on a body with their hair unnattached - DNA everywhere, anyone ? )
B
33
S
9
G
6
Posts: 709
Reputation: 6,704

Post » Fri Mar 09, 2012 4:38 pm

"At the end of the day, you are going to die with two heavy, muscular eyelids"   

LOL - Very Interesting @Pode!
B
192
S
6
G
7
Posts: 213
Reputation: 10,178

Post » Sat Jul 20, 2013 10:34 pm

I appreciate this is an old post, but the only one I could see on creating an eye tracking object plugin. @Pode, although you are correct about the limited computer interaction with eye trackers, for some people their eyes are all they have. We work with persons whose only controllable body part are their eyes and the eye trackers open up a world of opportunities for them. Often this can be enhanced using adapated switches in conjunction with the eye tracking to provide some extra functionality.

I was wondering if you are aware if anyone had progressed on this issue. We have two Tobii PCEye trackers and are starting to develop games for both educational and entertainment for our eye tracking clients. Although they are playable using the Tobii Mouse Emulation mode, and using the mouse object, it would improve the experience if the games could be eye enabled, using an eye tracking object in an effort to avoid erroneous interactions that can arise from using the older Mouse Emulation instead of the new Tobii Gaze Selection.

Hope to hear from you.
B
12
S
4
Posts: 67
Reputation: 1,235

Post » Sun Jul 21, 2013 2:02 pm

Heh.. co-op would make me laugh so much.
B
19
S
7
G
4
Posts: 322
Reputation: 4,481

Previous

Return to Construct 2 General

Who is online

Users browsing this forum: Gianmichele, WhosWho and 5 guests