gbadev.org forum archive

This is a read-only mirror of the content originally found on forum.gbadev.org (now offline), salvaged from Wayback machine copies. A new forum can be found here.

DS development > DS Head Tracking theory

#150402 - LocalToast - Sun Feb 03, 2008 9:57 pm

So it's become quite popular recently, head tracking. Basically, you get an infrared source (usually two infrared LEDs, attached to the side of glasses) to go on your head, and an infrared camera (Wiimote best example) to detect the two dots. Then, it recognizes the dots and uses the movement of your head (which changes the appearance of the dots in size, etc) to move the stuff onscreen around, making it look, well, "real". Google Wii Head Tracking for a more thorough explanation.

Anyways, a PS3 developer recently invented his own way of Head Tracking using the PSEye (little camera peripheral), infrared "glasses", and an exposed developed film filter to go over the lense. (Basically making an infrared camera). This got me thinking.

You're all aware of the DS Face Training game released about half a year ago in Japan, right? It has a Slot-2 camera that detects many features of your face and facial movements. Well, wouldn't it be great if we could somehow utilize this and be able to make head-tracking/motion recognition on the DS? Add that with the already available touchscreen, and there's a whole other dimension of creativity.

I have the Face Training game + Camera (imported), and the face-recognition works really well. If only we could figure out how to use this, and possibly use an infrared filter.

Discuss. ;)

#150406 - spinal_cord - Sun Feb 03, 2008 10:18 pm

You would have to hold the DS perfectly still, you cant play many games on a handheld without moving it. What use would it be anyway? I can see the point on a huge tv, improving the 3d experience, but on a 3 inch screen, it seems a bit daft.
_________________
I'm not a boring person, it's just that boring things keep happening to me.
Homepage

#150423 - jleemero - Mon Feb 04, 2008 5:41 am

I can see this being used, but still very limited.

Games like "Phoenix Wright, Ace Attorney" come to mind.

Move the DS to look behind things, you know what I mean?

Still, very limited...

I agree that on a TV or something like that, it's certainly usable.

#150435 - Creebo - Mon Feb 04, 2008 2:45 pm

Hmm this would be great for a wifi webcam/voicechat app. You could use your Mii save and it would position your Mii head and rotation according to what the DS detected. And whenever you talked the mouth moved according to your speech. Just an idea.

#150459 - naleksiev - Mon Feb 04, 2008 9:16 pm

I have an idea for different implementation on DS.

instead of tracking the game more officiant for DS will be tracking of the orientation of DS. Using the motion sensor you can detect if DS is rotated from it's default position. This method had limitation that you can't get closer or get far away from the screen. But you will be able to look behind objects.

#150469 - LocalToast - Mon Feb 04, 2008 11:41 pm

Yeah, just a suggestion. I mean, it would probably take a lot of time to program the "shape" recognition (i.e., two dots) but after that point it couldn't be too hard to work with it.

I was thinking something like an organizer (sort of like DSO) that provided alternate angles, but like naleksiev said, the Motion Pak could probably do this just as well (if not better).

Seems more like a hobby or something to do in spare time to me. Oh well. :)

#150948 - Snowy? - Fri Feb 15, 2008 7:06 pm

I say build it, even for fun :)
It might make a nice addition to FPS shooters, not many people may be able to use it though on account of the hardware availability.

Shame the DS does not bend completely over as if you had a front and back facting camera you could then flip the DS over to see the backside of something.

#153448 - MystBoy - Sun Mar 30, 2008 9:43 pm

you mustnt hold your ds still^^ in kombination of the motion card and awful loads of coding it may be possible but i think it will never come to this ;)

#153471 - M3d10n - Mon Mar 31, 2008 2:34 pm

Does the Face Training camera have facial recognition hardware in it, or it's done entirely by the game? If it does have built-in hardware, you could use it to detect the user's eyes and use the information to scroll the camera.

Also, you wouldn't need to hold the DS in a firm position. On a handheld screen this could work even better than on a big, fixed screen, because the user can move the screen around and the camera would move in the opposite direction, fixing the view based on the user's eyes. This makes the screen work as a movable "window" to a 3D scenery.

#153480 - nanou - Mon Mar 31, 2008 6:18 pm

M3d10n wrote:
Does the Face Training camera have facial recognition hardware in it, or it's done entirely by the game? If it does have built-in hardware, you could use it to detect the user's eyes and use the information to scroll the camera.

Also, you wouldn't need to hold the DS in a firm position. On a handheld screen this could work even better than on a big, fixed screen, because the user can move the screen around and the camera would move in the opposite direction, fixing the view based on the user's eyes. This makes the screen work as a movable "window" to a 3D scenery.


I wasn't going to post it, but those are my thoughts on this topic exactly.
_________________
- nanou

#153992 - Darkflame - Wed Apr 09, 2008 1:17 am

Second. This sort of idea overlaps a bit with AR work.
Much the same requirements.
_________________
Darkflames Reviews --
Make your own at;
Rateoholic:Reviews for anything, by anyone.