What is this?

I think the easiest win of all is having an ultrafast segment highlighting model running constantly in AR. You should be able to select an object, and it show progressive detail on it, and allow you to run commands upon it. A "what is this" for any object you see.

• "What kind of tree is that?"
• "Reskin" retexture, or change some part of its styling like Ad-Blocking, this could include blurring.
• Remove completely!
• "Highlight", send to friend?
• Some kind of "save" where you can copy/paste a 3D render of that object later! Select it and save it to your favorite objects and you can later place a piece of art you saw on the wall in your living room. (Ideally you have abundant storage where it saves every object you select anyway. The ideal future is one where searching back to find things you saw is frictionless (makes sense here if glasses are recording everything), a kind of object view history. Eye tracking would be crazy too, a log of every object and face you looked at in the last 30 days.)
  • The autist's dream of seeing a 3D mockup of any piece of machinery and being able to take it apart in a hologram. Figure out how it works.

Selecting

Point at an object, have SAM object section run. While the finger is still pointed, move the thumb to change the selection around what is already selected, this could be a zoom in/out type of extra knob. Move the finger around laterally and the thumb is kind of like a finger gun to change the depth.

Maybe point, open hand, swipe hand over to cycle, pinch to select.

Maybe I hijack the Vision Pro demo where they had book segment selection and then I mod/add more to this myself.

See Will we gesture at all?.

Companies

Or also these are all related to the consumer experience, how will it impact companies?

• Employees can see approximately how long a line of customers will take to clear, what their pace is etc.
• Benefits short term probably with white collar work data collection, but most of that can be done via computer screen capture instead.

These all feel sort of weak/not factoring in superintelligence enough, how much weirder can things get?

See Faces.