Input devices

There is either input or output. The output being VR would be nice but is hard. The input we can focus on.

Input as

• Keyboard: already very easy, huge amount of different inputs, everyone has.
• Controller: huge potential, less inputs but can be more fluid, more than just keys, joysticks and toggles can be very useful. A lot of people have controllers, Quest has controllers! I think those have joysticks.
• Hands: everyone has them. Can be very intuitive and natural. (See The body as input.)
• Voice: can be good in a system that is great at structuring from noise.

Output as

• A small screen like a phone
• A laptop
• A TV
• VR/AR
• Voice

How much hardware

I am thinking about the iPod, and game controllers, could it be better now?

Consider them either input devices or an interface.

If we have decent AR, we don't need the interfaces.

So it's a question of input devices.

Would a camera be enough for most people? Why carry more? (See Just use a webcam.)

• EMG wristband
• Tongue clicker thing
• Input jewellery:
  • EMG stickers, capture muscle gestures.
  • Rings, with wires to bracelets. Or a cuff.

See Typing with six gestures.

The controller

The controller is a great use case, it is better than the keyboard for navigating but not word input. It feels way more natural.

I wonder what else could be good? One handed controllers? Maybe look for early PlayStation design concepts for them!

Can we now experiment with setting the constraint of no keyboard, exploring / navigating ideas with just the controller?

The end of keyboards

You see, I quite like my mechanical keyboard, I have sunk much time, effort, and money into its creation and refinement. However I think it will be a dated piece of technology that my kids will mock me over in 20 years time.

Currently in order to put your thoughts into a machine, one has to have some kind of interface that they can use motor skills to interact with in order to output characters of the preferred language.

Those observant will have noticed more and more platforms incorporating voice typing, which I would argue is a slight step forward in the way we transcribe human thought.

Which begs the question, what is next?

We are trundling closer and closer towards superintelligence but I haven't heard much chatter about how we will talk to it.

How natural will a BCI feel as input? Will you get booted up with full understanding of your ability?