Category: Spatial Computing

if it has to do with meat and data sharing a 3d space, this is where it’s discussed.

Windowpane – Through the Device

The biggest irritation I’ve found with the Magic Leap so far (there are others, but they’re not as big) is the state of video capture.

  • The capture camera and the render camera are offset from each other, so nothing lines up in a recorded video
  • The FOV is not good.  If you want something captured, it needs to be pretty much dead center of your view.
  • Getting media off the device is OK, on par with pulling movies from iPhone onto a PC, and the Device Bridge app in the Lab makes it easy.

I won’t pretend to understand the … Read the rest

Milestone: MagicWax MVP

So a thing happened over the weekend. My scheme to mash up spatial computing and DJing became real. Here’s a clip:

So what’s happening here is this: The earlier Raspberry Pi with AudioInjector HAT now has a twin, with a cloned SD card of the first one.

There is a Pyle 444 preamp on each one:

This is necessary to unwrap the RIAA curve from the turntable signal and turn it into line level, which is what the Audioinjector HAT needs. In order to cure the abysmal latency brought on by the import process over X11, a single-deck instance of … Read the rest

Xwax display over X11 is pricey.

A major performance issue solved: when xwax is displaying in a remote X11 window, the rate of importing tracks is absolutely abysmal. Xwax enables importing of tracks to the player with a shell script called “import.” It’s basically a big case statement enabling the import of different file types based on their extension, and to use the preferred import executable on a particular file type.

Examples given are mpg123 and ffmpeg, and the fallback importer is ffmpeg, so each file type has a command line extension that looks something like this one tweaked for Ogg Vorbis files.

exec ffmpeg -loglevel Read the rest

Magic Leap, OSC, XWax. Working.

In the last six weeks or so since I posted anything about this, I blew up two computers, revived one computer, and learned a hell of a lot about C programs, Unreal Engine 4, networking, and remote development.

The principle described in the previous post is sound:  Spatialize the digital DJ experience by integrating the data with the physicality of the turntables.  Yeah, ok, but isn’t that what Traktor and Serato do?  Sort of.  You’re still checking your mail on a screen.   Not that my current iteration is any less awkward, but the basic idea is there.

This is what … Read the rest

Portals and Planes

Got to grips with the Magic Kit.  Magic Leap was kind enough to set up some very thorough tutorials with a lot of helpers to let you do baby steps on accessing, using, and showing the capabilities of the device, so I cribbed a bunch of stuff related to plane detection, gestures, and interactivity.  

This has mostly been a bit of a wander.  Initially I wanted to port a janky Hololens demo to Magic Leap, but I soon realized that a straight port wasn’t going to happen without some basic understanding of how things work.  I wanted to understand and … Read the rest

Taking the Leap

Today is going to be an interesting day.  I have in my possession at work, a Magic Leap ML1.  I’m going to attempt to port an old Hololens demo and make it worthy of the term “spatial computing.” 

Spatial computing is different from mere Augmented Reality, in that the 3D environment is integral to the computing experience.  Lots of interesting design paradigms flow from this, the idea that computing activities are localized to areas of relevance.

For the most part though, this post is about testing the new blog setup in a way that’s relevant and worthy of keeping … Read the rest

« Previous Page