RSSAmplifier

Blog

sheltron

Recent content on sheltron

nshelton.github.ioRSS feed ↗52 posts

Latest posts

Minotaur Plotter

A C++17 desktop application processing plots and driving my Axidraw A3

Snap Inc / Spectacles

Gaussian Splatting rendering optimization for mobile AR hardware.

Illuminant Surgical

Real-time surgical projection mapping and 3D fiducial tracking for image-guided surgery.

Disney Imagineering R&D

Projection mapping, computer vision, 3D reconstruction, and real-time tracking for Walt Disney Imagineering R&D.

Neonz AR

AR NFT Viewer 
 In 2021, Sutu launched one of the first generative NFT series on the tezos blockshain, a 10,000 profile pic series called Neonz . This was deveoped by the folks at Eyejack , I got on board to help them with some cool AR rendering effects. 
 I worked on a couple of components of the SUTUVERSE 
 
 
 Face filter - https://www.neonz.xyz/neonz-facez 
 
 
…

Polycam

Computer vision R&D and iOS shader development for a popular 3D scanning app.

CSMA302 Advanced Programming

My First Course 
 In Fall 2021 I taught a class at Woodbury University in Burbank on some Advanced Programming techniques in Unity. This was in the Architecture School, aimed at non-computer Science majors who had already taken two semesters of Unity / gameplay programming. This was the first class I taught like this, and I learned a lot… I made all the curriculum from scratch, and…

Life After BOB

Real Time Unity short Film 
 What if an AI could do the job of living your life better than you? 
 Neural engineer Dr. Wong has installed an experimental AI named BOB (“Bag of Beliefs”) into the nervous system of his 10-year-old daughter Chalice. Designed to guide Chalice through the challenges of growing up in a volatile world, BOB confronts more and more of the conflicts in Chalice’s…

TopoChico

Realtime Kinect visualizer experiments 
 Hooked up a Kinect Azure to Unity’s VFX Graph to explore some live realtime visuals for Lyell Roeder ( Alt Fi ) and Troy Everett - a Live improv ambient set 
 video 

 
 
 
 
 stills 
 


 
 
 
 
 
 




 
 
 
 
 
…

Nexus Studios

Houdini-to-Unity volumetric asset pipeline and VFX Graph integration.

The Weeknd

Live interactive broadcast on TikTok 
 We went all out to stream a virtual interactive Weeknd concert to TikTok . The Wave tapped into the real time chat API to allow interactive voting moments. Unlike all the other waves though, The Weeknd is too cool to actually wear a mocap suit, so we got an actor to be him, raising some strange quesitons about the future of virtual performance and…

John Legend

John Legend live charity show 

 
 
 
 
 After a brief coronavirus-induced break at Wave, we rented out a studio to set up a Yamaha electric grand piano and get the man JOHN LEGEND HIMSELF into the xsens suit to do a live performance. 
 We raised almost $10k for FREEAMERICA 
 
 behind the scenes 
 


 
 
 
 
…

ERA visualizer

Fractal Path Tracer

I decided to take my fractal rendering to the NEXT LEVEL by implementing a simple compute shader path tracer in unity. 
 Code Mostly Lifted from Three Eyed Games tutorial 
 Source Code on github 
 Temporal Reprojection 
 But then I decided to reproject frames from the past into the current buffer to improve convergence, and make it pretty much realtime. Will add some more about…

Rap Word Cloud

An Optimisaiton Journey. Client : Rap Research Lab 
 
 Rendering 5000 TextMeshPro meshes in 1ms for an interactive VR word cloud 
 I started with a naive 5000 TextMeshPro gameobjects, which could take 30ms CPU and GPU, and made a new system that took 1ms CPU and GPU and still looked dope. 
 Functionality 
 Interactive 3D visualization of words used in a corpus of rap lyrics…

Growth Algorithms

Along with fractals, I also got really into growth algorithms, especially making them run in realtime.
It seems like a perfect intersection of design and art with computer science and math. 
 Here are various realtime versions of some interesting growth algorithms I have seen over the years. 
 
 Mesh based 
 Mesh Splitting / Spring and attractive forces
 
…

Lindsey Stirling


 
 
 
 
 


 
 
 
 
 
 




 
 
 
 
 
 
 
 Testing the suit! It didn’t work very well with the arms 
 


 
 
 
 
 
 




 
 
 
 
 
 
 
 IK constraints to make hands match violin (because all the…

REZZ

Beyond the Senses EP release

T-Pain

T-Pain’s School of Business feature at The Wave

The Light - Kizuna AI / W&W

At the Wave VR we made a Music video for Internationally renown producers DJs W&W for their musical collaboration with japanese vtuber Kizuna Ai . 

 
 
 
 
 We had to make this in like a week or two, so we
Here’s some Unity Workflow Documentation: 
 Art Team 
 Aaron Lemke, Dare Matheson and Daniel Sierra built this out of mostly…

FractalFlames

Fractal Flames

Magfest VJ

Super MagFest 2019 DJ battle

OP-Z

Unity Visuals pack for OP-Z multimedia synthesizer

Imogen Heap

VR Volumetric Music Video Experience for Imogen Heap

See Without Eyes

Interactive VR Music video Experience

Ready Player One

Making of TheWaveVR’s Distracted Globe

Ṛta

Free VR Fractal Visualizer & Manipulation Software for Vive 

 
 
 
 
 Ṛta is the principle of natural order which regulates and coordinates the operation of the universe and everything within it. In the hymns of the Vedas, Ṛta is described as that which is ultimately responsible for the proper functioning of the natural, moral and sacrificial orders.…

3D Flying Lotus Visuals

3D Visuals content for Flying Lotus and Strangeloop Studios

AKTUAL

ASH KOOSHA show in TheWaveVR

GRIMECRAFT viz

VR Visuals in TheWaveVR

3D Web Fest

Live performance at 3D web fest

N-FOLD

Hyper-Dimensional Odyssey

FORM 0.0 beta

Free VR Fractal Visualizer & Manipulation Software for Vive

TunnelTek


 
 


 daily shader thing

artandvr

Art and VR at HACK TEMPLE and The New Parish with Gaslamp Killer

Laser Cuts

some laser cuts made at the Tech Shop in Austin
Many designs from & inspired by George Hart 


 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
…

Paintings

Some paintings I did in high school & college

Sketchbook

My sketchbook from 2009 


 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
…

Sketchbook 2

My sketchbook from 2013 


 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
 

 
…

occipital bridge

Mobile mixed reality graphics

COLORS

Audio-reactive LED wall Installation with Alex Stickels. Shown at ‘The Art of Dying’ at The Laundry SF

LEVELS

webgl audio-reactive iterative function system

iOS mandelbox raymarcher

Mobile fractal visualizer

LiDAR Processing

surface reconstruction from point clouds

LiDAR Processing pt.2

more experiments in point cloud reconstruction

this._node

Interactive Facebook Graph Visualization

capyac

Live performance of Audio-Reactive Shaders

Atlanta

geospatial vertex shader

tweet

visual tweet and population density visualization

Synesthesia

realtime reactive VJ software 
 
 Gravity Current’s Synesthesia 
 In June 2015 I worked with Gravity Current on their new Synesthesia software for live reactive visuals. For this project I created two “Scenes” that played at a couple of shows in Austin: 
 Looper’s night @ Strange Brew 
 Featured my reaction diffusion system ported to C++ OpenGL with a…