Work
Client products, my own apps, open source projects, and research. All shipped and all on Apple platforms.
01
Client work
CLIENTMadespace: AI Interior DesignPhotograph a room, reskin it with generative AI, and buy the real products that match the look.generative AIcloud pipelineproduct matchingApp Store ↗︎CLIENTiScapeMulti-user AR landscape design. Featured by Apple at WWDC, covered by HBO and Axios.ARKit 2shared ARAR world mapsApp Store ↗︎Demo ↗︎
CLIENT · MOZILLA · OPEN SOURCEWebXR Viewer for MozillaThe first WebXR browser for iOS. Migrated to Swift and doubled the framerate with Metal. Fine-grained AR permissions put privacy first.WebXRMetalARKit 2App Store ↗︎GitHub ↗︎
CLIENT · ACQUIRED BY SHOPIFYPrimerVisualize your home with new wallpaper and wall treatments. Animated AR tooltips onboard users visually.ARKit 3Core Animationperson segmentation
CLIENT · MASK MARKETMask MeDesign, visualize, and purchase custom face masks in real time with AR.
CLIENT · NUDGETVAR basketball minigameMultiplayer AR basketball: A life-size hoop, made-shot detection, and scores synced live between players.
02
My apps
MY PRODUCTminimapSee through walls: A live, realtime 3D map of your home and the people inside it.ARKitRoomPlanCore MLApp Store ↗︎Post ↗︎GREW FROM Minimap – Level 1 Prototype · Minimap – Level 2 Prototype
MY PRODUCTMirageReskin your room in mixed reality. Your living room forecast calls for rain.visionOS 2room trackingshader graphApp Store ↗︎Post ↗︎
MY PRODUCTTwin3D scan your stuff. Remix it. Create digital twins for visionOS passthrough.Object Capturephotogrammetryshader graphApp Store ↗︎Post ↗︎
MY PRODUCTCyberWaveVisualize your music in AR with LiDAR. Play a track and change your surroundings in real time.RELATED Reality Synthesizer
MY PRODUCTRock Paper CheckmateAR auto-chess against the computer. Moves decided by rock, paper, scissors – read by a custom-trained hand-gesture model.
MY PRODUCTJanksyTap any rectangle the camera sees and give it the Banksy treatment. Live.
MY PRODUCTFloatRemix photos and videos in AR. Caption the real world. No 3D models required.
03
Open source
OPEN SOURCEPersonaCamFloats your visionOS Persona in the corner of your view. This provides a facecam for recording Apple Vision Pro demos in two lines of Swift.
OPEN SOURCEvisionOS 2 Object TrackingAn open source starting point for visionOS 2 object tracking, paired with hand tracking for proximity interactions.visionOS 2object trackinghand trackingGitHub ↗︎Post ↗︎
OPEN SOURCEReality SynthesizerMIDI notes from a paired synthesizer visualized in AR through Metal shaders and LiDAR.RELATED CyberWave
OPEN SOURCEAR GuitarBody tracking where the left hand picks the chord and the right hand plays it.
OPEN SOURCEARKit 2 Image TrackingHarry-Potter-style moving pictures, living posters, and paper-thin displays. A starting point for image tracking.RELATED Lord of the Rings paper map
04
Research and prototypes
INTERNAL RESEARCHDiminished RealityRepaints walls and surfaces in the Vision Pro camera view using the Main Camera Access Enterprise API.
INTERNAL RESEARCHPaper map synced to the Lord of the Rings moviesA paper Middle-earth map recognized by Vision Pro tracks each member of The Fellowship as the story unfolds.image trackingparticle emittersPost ↗︎RELATED ARKit 2 Image Tracking
INTERNAL RESEARCHMinimap – Level 2 PrototypeTwo iPhones and one live map. Segments a person from video and updates their 3D position in real time.SHIPPED AS minimap
INTERNAL RESEARCHReal World Ad BlockerTracked image anchors replace real billboards with content you choose.
INTERNAL RESEARCHMinimap – Level 1 PrototypeSee through walls by mapping a room with RoomPlan and painting object textures with ARKit and RealityKit.SHIPPED AS minimap
Work with me
Got it!I’ll reply soon.
BOOK A CALL
Twenty minutes, no deck required.
Bring the problem. I’ll tell you whether it’s buildable today, what it would take, and whether I’m the right person for it.
Book a call →[email protected]© 2023 – 2049 1984