Apple’s latest patent reveals Pencil that might let you write or draw in air or on any surface, not just iPads

Apple’s working on a new kind of stylus, and it might change how you write or draw. Details inside.

Apple’s latest patent hints at a future where the Apple Pencil might finally break free from the screen. Instead of being tied to an iPad or a tablet surface, this next-gen stylus could let you sketch in mid-air or on just about any surface you find - your desk, a notebook, even a wall. The idea is simple but ambitious - make the Apple Pencil as versatile as a real pen but smarter.

Apple’s new patent points to a stylus that works beyond the screen, hinting at a new way to draw and write. (Unsplash)

By Bharat Sharma

It's an exciting time to be in love in with tech - whether it is AI solutions, the pace of gadget development, and other related technologies. As a tech journalist, I believe it has the potential to solve all of world's problems if used holistically, and my job is make to it more relatable and understandable.

Read moreRead less

Drawing without a screen

The patent, first reported by Patently Apple, describes a stylus packed with optical sensors that can track its movement, tilt and position in three-dimensional space. These sensors are similar to what you’d find in an optical mouse, picking up subtle shifts in light as you move the stylus above or across a surface. Apple’s documentation suggests the Pencil could register your strokes even when it’s hovering up to ten centimetres above a table or a piece of paper. That means you could draw or write in thin air and the Pencil would still know exactly what you’re trying to create.

It doesn’t stop there. One version of the stylus swaps the usual tip for a trackball but instead of relying on old-school mechanical tracking, Apple’s approach uses internal optical sensors to read the ball’s motion. This could help avoid issues like scratching the tip or picking up dirt and it should work on a variety of surfaces, no matter how shiny or rough. The patent also claims this setup can improve signal accuracy, making it easier to capture your movements cleanly, whether you’re doodling on a wooden desk or scribbling on a whiteboard.

Beyond drawing: What else could this pencil do?

Apple’s patent goes further, imagining a stylus that combines these optical sensors with other tech like force detectors, inertial measurement units and even machine vision. In practice, this could mean the Pencil supports air gestures, better handwriting recognition or even 3D object creation. The company’s illustrations show the stylus being used with a range of devices, from iPads and MacBooks to iPhones and the Vision Pro headset. That opens the door to new ways of interacting with Apple’s growing family of spatial computing products.

There’s also mention of combining the stylus with software that could interpret air gestures or track complex shapes, turning the Pencil into a tool for artists, designers and anyone who wants to capture ideas on the go. Apple’s idea is to make the stylus as flexible as possible, whether you’re sketching a diagram in mid-air or jotting down notes on the back of a napkin.

Of course, this is just a patent for now. Apple files plenty of ideas that never see the light of day. There’s no guarantee this version of the Apple Pencil will launch any time soon or at all. But the patent does show that Apple is still thinking creatively about how to make the stylus more useful with the intention to go with drawing.