10 Questions with Noah A S

noah2

Every group of friends has one person who holds the others together. In the world of Magic Leap, this person is Noah Aubrey Schiffman.

When the HoloLens first came out, the HoloLens team tried to create their own community website and forums. But people felt more comfortable hanging out in the HoloDevelopers Slack group that Jesse McCulloch created (and now Jesse works at Microsoft). When the Magic Leap came out at the end of 2018, a friend and I started a Slack group for it while others created a Discord channel to gather the community.

However, it was the twitter thread and #leapnation tag that Noah created which eventually became the gathering spot for MR developers, hobbyists and fans.

Why? you might ask. I think communities develop around people whose sincere enthusiasm reflects and reveals the common purpose inside the rest of us. In the world of magic leap, this hearth keeper is Noah, unofficial community ambassador to the magicverse, first of his name. Long may he reign.


What movie has left the most lasting impression on you?

Terminator II: Judgement Day (with the fear of Skynet) Or The Matrix (the idea of living in a simulation)

What is the earliest video game you remember playing?

It might have been something on an old-style Mac. Probably the game Sockworks which is for young toddlers.

Who is the person who has most influenced the way you think?

Probably my mother or a few of my friends.

When was the last time you changed your mind about something?

I do it a lot.. so I guess it was this week.

What’s a skill people assume you have but that you are terrible at?

ah a skill I don’t have that people assume I have.. Development, in something. It could be javascript I’ve not made much anything yet.

What inspires you to learn?

More learning, I guess, Isn’t it a cycle?

What do you need to believe in order to get through the day?

I don’t really need to believe very much I’m good when it comes to coping? Is this the question?

What’s a view that you hold but can’t defend?

It’s when I know something is coming or on the way but I signed an NDA so I cannot talk about it.

What will the future killer Mixed Reality app do?

– Something social! *Or* It will give you news! (doesn’t twitter do both?)

What book have you recommended the most?

Snow Crash.

10 Questions With Charles Poole

charles_poole

Charles Poole, the owner of IS Studios,  is currently one of the most experienced mixed reality developers in the business. Like many of the other people well known for their development chops on the HoloLens and Magic Leap One, he fell into it accidentally. Through a combination of determination and blind luck, as well as the ability to pick up a new UX paradigm that requires technical acumen with both .NET and Unity, he is currently one of those rare people with 3+ years of hands-on MR design, development and project management experience. You’ll have to ask him yourself for the full story, but it basically comes down – as with so many others – to getting his hands on a very expensive device and learning to make it hum (ideally  using spatial audio).

Charles is soft spoken and kind. One of the very interesting things about his background is that he is a mathematician – and so in that small subclass of software developers who actually knows math! There’s nothing nicer in the world of programming than having a friend you can hit up when you are having problems with an algorithm or with your matrix math.


What movie has left the most lasting impression on you?

Hackers, I think watching Hackers in 95/96 shaped my childhood and later choices when it came to education and what I spent my time on.

What is the earliest video game you remember playing?

Super Mario Brothers on the NES, or Sky Kid, also on NES. I remember playing it for hours just to get to the 3rd or 4th level, then watching my father get a lot further.

Who is the person who has most influenced the way you think?

Maybe Buckminster Fuller, Neal Stephenson maybe Michael Crichton. I read a lot as a child, I feel as though all the views I was exposed to through fiction and non-fiction had a big influence in how I see the world and approach problems. In general the problems seem really big, cause a lot of drama, are entertaining to read and experience, then the solution just happens to come together from a character that has the experience to pull a solution out of their ass.

When was the last time you changed your mind about something?

A big one recently, and kind of mild, was using Photon for the multiplayer aspects of my work. I was against Photon for a long time, I wanted to be in control of every aspect of what I was building. So I’d do things like make a custom socket server, write the server in Dark rift, use WebRTC. One of the most important things about freelancing is using every tool you have to accelerate development, while keeping it altogether. We had to make a decision recently about a multiplayer backend that could scale to thousands of users, but still be self hosted, and the time-frame was extremely compressed, so I revisited Photon, specifically PUN2 which had been released since the last time I had used PUN, and it felt like it had come a long way in the time since I had used it last.

Simpler and more personal – My daughter’s kindergarten teacher had been pushing for her to repeat kindergarten. I was staunchly against it, she was getting top marks, won the science fair over 5th graders, and with something she had actually done and came up with on her own, we only bought the materials. But she just wasn’t emotionally ready for the pace to get quicker in first grade, and her teacher made her excited about helping out for another year. So, we agreed to have her repeat kindergarten, because she loves to learn, and we didn’t want to make school into something she hated.

What’s a skill people assume you have but that you are terrible at?

Managing my time, I’m terrible at managing my time, I tend to get sucked into a project and neglect everything else. I would work every day from 9am – 9pm or later. I had to step back and put a rigid stop time on my day so I would spend time with my kids and not just work through their whole childhood.

What inspires you to learn?

I want to do everything myself, and push myself outside my developer comfort zone everyday. I’ll say ‘yes’ to things just for the challenge of figuring it out.

What do you need to believe in order to get through the day?

That things can only get better. I started off this dev journey making a thousand bucks a month, living in a tiny apartment with my wife and two kids. Every day, week, month feels like things have gotten better for us, at some point I want to turn around and help make other people’s lives better too.

What’s a view that you hold but can’t defend?

That anything is possible with enough hard work. I have an applied math background, and have seen sparks of insight and intuition I know I’d never have, but I still feel like I’d get there eventually if I put enough hours into it.

What will the future killer Mixed Reality app do?

Something agent based, an intelligent agent that acts as your exocortex. AI/ML is the future of Human Computer Interaction, the killer app won’t feel like an app, it will just be part of your life.

What book have you recommended the most?

Rainbow’s End by Vernor Vinge, it’s shaping up to be the most prescient book I’ve read. It was written in 2006 but the trends he wrote about are what we’re starting to see today, the nascent AR technology.

12 Questions With Simon “Darkside” Jackson

simon_d_jackson

Simon is one of the main contributors to the Microsoft MRTK framework for HoloLens and also to the XRTK framework for cross-platform mixed reality development. He is the author of several technical books on Unity. He is keeper of the flame on the Unity-UI Extensions source code.

Simon basically really intimidates me. He knows the Microsoft coding stack as well as the Unity stack, which makes him formidable. He’s currently working on extending the XRTK framework to support the Oculus Quest, which means if you have built your HoloLens or Magic Leap app on the XRTK, your app will automagically also run on the Quest thanks to Simon. That’s some seriously cool stuff.

He also happens to be a very nice person who is genuinely concerned about the well being of the people around him – which I found out the easy way over many online and in-person interactions. I’m not totally sure why he promotes himself as of the Darkside since he is clearly more of a Gray Jedi – but that’s not one of the 10 questions, so we may never know. Without further ado, here are Simon’s answers to the 10 Questions:


What movie has left the most lasting impression on you?

The Matrix, it shows us how to stand tall, to face adversity with strength and uncover meaning in this world we call life.”

What is the earliest video game you remember playing?

“Given I have to recognise I’m getting old, my earliest game I recall was Pong on the Atari 2600.  First game console our family owned.  First games would be the penny shuffle machines in the arcades of old .”

Who is the person who has most influenced the way you think?

“William Shatner, for showing us how to boldly go and give us a glimpse of the world I’d like to see us aspire to.”

When was the last time you changed your mind about something?

“Whenever the wife decides  something and I have no other option but to agree.”

What’s a skill people assume you have but that you are terrible at?

“Recruiters are constantly sending me offers for jobs developing in JavaScript or Java, which I’ve avoided for most of my developer life.”

What inspires you to learn?

“My life’s goal is to always learn something new each and every day, to grow and develop.  If we no longer aspire to develop ourselves we cease to be.”

What do you need to believe in order to get through the day?

“I have to believe the coffee will not run out, else the world becomes a much more vicious place.  I also hope to defeat ignorance, but ignorance always finds new ways to baffle me.”

What’s a view that you hold but can’t defend?

“I have long held the belief that humankind will eventually realise its insignificance and start to work towards the betterment of ourselves and the planet we live on.  However, I’m proven wrong each and every day (for now).  Basically, I want the world of Star Trek, not the world of Star Wars.”

What will the future killer Mixed Reality app do?

“Once mixed reality technology finally becomes affordable enough and cool enough to wear all day long, I believe the killer experience will be something that integrates with our everyday.  An app/experience that will enrich the world around us, show us new sights and experiences, and offer us new ways to interact.  Be it a simple experience that adds wonder to a shopping centre experience, or uses geo location whilst visiting historic sights and completely immerse us whilst learning (in stead of just reading signs as we do now).”

What book have you recommended the most?

Snowcrash by Neal Stephenson, it opens up so many new possibilities and levitates towards the dangers of being “plugged in” too much.  Giving us a sense of wonder and danger in equal measure, leading us to live in a world augmented by technology but not driven by it.”

And then Simon volunteered two more unsolicited  questions:

Favourite quote?

“The definition of insanity is doing the same thing over and over again and expecting a different result.
—  Albert Einstein (as well as others).”

Most used phrase?

“Because… unity.”

10 Questions with Suzanne Borders

suzanneborders_mm

Suzanne is the CEO of BadVR – which IMO wins the prize for best company name and probably could easily make a top 10 list for band names, also. Suzanne’s company works with the fascinating world of data visualizations in VR and MR. She is also the recipient of one of the coveted 2019 Magic Leap grants and is a member of Magic Leap’s Independent Creator Program. I met her briefly at an MR event in Mountain View, CA in early 2019 and besides being an amazing advocate for the importance of true 3D data visualizations in spatial experiences, has successfully shown everyone how to be a leader and promoter of mixed reality in the XR world.

What movie has left the most lasting impression on you?

This one is tough! I’m a huge film buff and there have been so many movies that have deeply impacted me and altered my understanding of the universe.

That being said, I think the most impactful film I’ve ever watched is “The Holy Mountain” by Alejandro Jodorowsky. It’s such an explosion of creativity, a surrealistic fever dream that functions on so many levels as a commentary on the human desire to seek truth and enlightenment. Jodorowsky is unlike any other filmmaker out there, a true magician that makes film into high art without losing the ability to make impactful statements about the universal human condition. Any of his films could really be considered my favorite but “The Holy Mountain’ in particular speaks to me the most because it best captures the hero’s journey; our collective desire to seek something greater from life than what we’re given. A lot of surrealistic film is just weird for the sake of being weird and therefore loses impact because it doesn’t use the symbolism of surrealism to make any sort of deeper statement. Jodorowsky is a surrealist in the best sense of the term – all his bizarre unexpected images convey meaning and activate archetypical feelings, drives, and desires in his audience. He’s a master of the subconscious and knows how to access and wield communicative power in this area. Because of this, he’s my creative hero and I look to his work often for inspiration, especially when attempting to craft products that have the ability to touch user’s subconscious. I think this is key when unlocking broad market appeal for products or film or art in general. To really touch and impact a wide audience the experience, the artist or creator must touch on, and involve, a universal archetype. Jodorowsky’s films taught me this lesson and showed me how to execute on it. I want to give a big shout-out and thank you to my filmmaker friend Ryan, who introduced me to them. He, in many ways, has fundamentally changed how I approach any creative challenge by showing me Jodo’s work. 

Beyond “The Holy Mountain,” I’m a big fan of “Belladonna of Sadness” (you will not find a more beautifully animated film ever), “Apocalypse Now” (Brando as Kurtz and his monologue at the end talking about the clarity of evil is a perennial favorite; combining Conrad’s “The Heart of Darkness” with the Vietnam war was a stroke of pure genius), “Funeral Parade of Roses” (a Japanese film that sets the ancient story of Oedipus into the transgender alternative subculture in 1960s Japan; I love it for its ability to utilize archetypical images and stories in an unexpected and creative way), “Hiroshima Mon Amour” (any media by Marguerite Duras is an automatic favorite), and “Last Tango in Paris” (I adore Brando, he’s an absolute legend, and this film touches on so many truths of the human existence, our longing for connection, the power of anonymity, my own personal life makes this film more powerful to me than it will to many, but none the less I adore it). And of course, the visual style and occult symbolism of Dario Argento’s films is a forever favorite (“Suspiria” being the pinnacle of Argento’s work IMO).

Lastly, Fellini’s “8 1/2” was the first film I watched as a child that really unlocked for me the power of cinema and storytelling. Prior to watching it, I had dismissed film as some inferior commercial medium. I saw it as cheap mindless entertainment for the masses without substance or meaning. For me at that time, my understanding of film was limited to boring and poorly made summer blockbusters. I remember clearly popping in the 8 1/2 VHS tape at age 17 without any expectation, just another mindless story to pass the long summer hours of adolescence. But the story that jumped out from the screen – starting with Fellini’s infamous opening dream sequence – absolutely captivated me. I found myself profoundly touched at the end of the film, crying even, and realized that I had been changed forever for having watched it. The message of the film – our flawed desire for human connection and all the broken and dysfunctional ways we pursue it – resonated with me at such a level that I have, decades later, never forgotten that moment. From that point on, I considered film and storytelling a high art that held the potential to change the world. Of course, not all film or stories rise to this potential and I’ve continued to be disappointed by mainstream commercial film in such a major way that I don’t even engage with it anymore. But 8 1/2 made me realize the potential of film as a medium for spiritual transformation. It showed me the power of storytelling had to bring humanity together and demonstrated the medium’s ability to hold up to the audience a mirror of themselves, helping them pursue a deeper understanding of both themselves the world around them.

Obviously, I adore film. It is one of my biggest sources of creative inspiration for all my technical work. I love immersive tech because one builds experiences, not screens. MR holds the same potential to affect deep spiritual change and transformation in users and that interests me immensely.

What is the earliest video game you remember playing?

LOOM! I remember playing it on the first computer my father bought for our family, when I was 6 or 7 years old. I remember spending hours and hours sitting in front of the computer playing, captivated by the beautiful game art. LucasFilm games are the best, but in particular Loom really did it for me. I loved (and still love) that the primary way Bobbin Threadbare (main character) interacted with his world was through music and sound. Such an original and creative idea!

Plus, you could cast spells to literally rip apart the fabric of existence, calling forth the lord of the dead, ripping open cemeteries to speak to the souls of the deceased. You could exist beyond space and time and your character could visit this beautiful lake floating in the void, populated by swans who spoke to you in parables of truth. As a goth kid and a lover of poetry, this was beyond transformative for me. I wanted to live in Loom! Additionally, the game came with this amazing backstory about a world full of guilds and weavers of destiny. I used to listen to the backstory tape, complete with a dramatic reenactment, and pretend I was Bobbin Threadbare. Loom will forever be my favorite game of all time.

Myst is a very close second!

Who is the person who has most influenced the way you think?

This is a difficult one – there have been so many amazing mentors in my life and each one of them has taught me something important, about myself, about my experience of the world.

As mentioned, Jodorowsky has been a major influence on me and all that I create. I’ve followed him around the world and I’ve actually met him in real life. I was fortunate enough to have him read my tarot in Paris and that reading truly changed my life. I won’t go into details because it was a deeply personal reading, but it transformed me without doubt. I also was lucky enough to meet him again at the Egyptian Theater in Los Angeles and at this event he dropped many nuggets of wisdom as well. 

I’ve also learned a lot from the coterie or filmmaker friends that I’ve developed here in Los Angeles. The one in particular who introduce me to Jodorowsky has taught me a lot about the creative journey. He’s taught me how to dive into my creative subconscious to identify those valuable universal, broadly resonate true ideas. I’ve always been fascinated with the ability to broadly affect so many different types of people with one single idea and I wanted to translate that to my products. When you talk to someone who wrote or directed a hugely successful film, you find they have this ability to take a concept and distill it down into its most basic form. However, instead of that process being reductive or simplistic, you find that this distillation strengthens the idea and makes it more crystalline and clear and most importantly, universally accessible. The ability to take complex, nuanced, ideas and make them resonate with the broadest audience possible is one that I value highly. I’m very glad to have had a group of people who’ve helped teach me this skill. Regardless of the difference in our industries.

When was the last time you changed your mind about something?

Whew boy, I change my mind all the time, constantly, on a second to second basis! I’m always ingesting data about my world, through experiences, books, travel, websites, music, films, poems, and products. Even subconsciously, my mind is always picking up on new data about my world, which then changes my understanding of the universe. Plus, I believe everything constantly changes, so I have to keep pace with this change and adjust my thoughts and theories to mesh with the latest information.

A system that runs off absolutes and stasis is brittle and bound for failure. Only by being nimble and changeable can any system truly be strong and resilient. As such, I agree very much with Nassim Nicholas Taleb and his concept of anti-fragility. Anti-fragility involves growth through stress and I’d like to think all of my internal world models fall into this category by being responsive in real time to new data that stresses their limits, structures, and boundaries. 

What’s a skill people assume you have but that you are terrible at?

Everyone assumes I’m skilled at math because my company works with data. But I’m actually numerically dyslexic (yes, it’s a real thing) and numbers have always been a real struggle for me. That’s one of the many inspirations for BadVR – my desire to work with data but my lack of technical skill with which to do so. I am in many ways the non-technical person for whom my product is built; I am my user. This gives me the power and the passion to build and also gives me the empathy needed to deliver an effective product that makes data accessible to everyone.

Of course, being acutely aware of this shortcoming I’ve assembled a team of very highly talented mathematical geniuses that augment my own weaknesses. So, to allay any question about my company’s ability to deliver a highly technical product, I want to underscore the idea that my company is not solely comprised of me. The heart and soul of BadVR is our team, and they are deeply capable in all the ways that I am not. That variety of skills and talent is what makes us powerful. We all balance each other’s weaknesses and strengths and, in doing so, create something better than any of us could ever achieve independently. 

What inspires you to learn?

I don’t need inspiration for this! I’m endlessly curious about everything, all the time. I never learned to stopped asking “why?” Learning is my default state of being. Anytime I see anything, or experience anything, it inspires me to ask more questions, to dig deeper, to understand further. My google search history is full of things like “how did dinosaurs procreate? What is dirt? Why is dark meat dark?” I just wonder and google and learn all the time. Every experience is an impetus for learning; a reason to dive into the whys, hows, and whats of yet another line of inquiry.

What do you need to believe in order to get through the day?

I have to believe that life doesn’t end with death. That I will again see the people I love who I’ve lost. If there isn’t an afterlife or there isn’t an alternate timeline we’re we meet again, I can’t continue. I’ve lost too many loved ones to be able to function without the belief that I will see them again. It goes without saying then that I believe in reincarnation, in the broadest sense. I strongly believe that the people we love never leave us and that in some way we end up back together. It’s not an evidence-based belief – besides anecdotal evidence anyways – but I must believe it. I do believe it. I will always believe it. Other, the loneliness is crushing, overwhelming; the feeling akin to being forever a planetary stranger at the very end of the world.

What’s a view that you hold but can’t defend?

I have plenty of beliefs that don’t have scientific, evidence-based support. I can always defend every belief I have if you allow anecdotal evidence or emotional appeals. Some examples include my belief in the tarot, in astrology, in dream work, psychic powers, aliens, the collective subconscious, Bigfoot, the Missouri Skunk Ape, and ghosts. I’d be more than happy to argue their existence on an emotional and anecdotal level with anyone. But science of course doesn’t support or embrace such parapsychology and cryptozoology. This doesn’t stop me from believing, though. Many of the most important questions in life cannot be answered by science. I think the scientific method is important for lesser questions but for the big questions of life like “Why are we here? What is our purpose? What is the meaning of life?” — science fails. I’m more interested in the answers offered by faith and spirituality than I am in the answers offered by science, for these sorts of questions. In the face of the eternal, science can seem so small and pedantic. But of course, for the mundane it is very important.

What will the future killer Mixed Reality app do?

Visualize data and allow for immersive analysis! Data is the killer app for mixed reality. I firmly believe that, and I fully believe my company, BadVR, will be the industry standard tool for working with data immersively. I may be biased as BadVR is my company, but hey that’s what I believe! Our unique approach, mixing art with logic, the abstract with the concrete, is exactly the way this product needs to be approached. In the future, everyone will be able to easily see and interact with incredibly large, abstract and geospatial datasets with ease. We will think of data as an oracle; a source of truth. It’s important that everyone be able to access such a powerful product, which is a major focus of BadVR – universal accessibility.

What book have you recommended the most?

The Panic Fables” by Alejandro Jodorowsky. A book of spiritual comics that delivers small truths via 1-page comics. It’s an easy entry point into the Jodo-sphere!

Narcopolis” by Jeet Thayil. One of my all-time favorite passages can be found in this novel. It’s about a large cast of characters who frequent an opium den in Bombay (before it became Mumbai). Thayil is one of the few writers who can write prose that reads like poetry. I am a forever a huge fan!

The Hour of the Star” by Clarice Lispector. She deconstructs language and storytelling to deliver a narrative about a poor Brazilian girl and her search for meaning and transcendence in a world that doesn’t want or even see her. It is a visceral gut-punch of truth. Anything by Lispector is wonderful, but this story in particular is my favorite.

I will leave you with a quote from Lispector:

“I do not know much. But there are certain advantages in not knowing. Like virgin territory, the mind is free of preconceptions. Everything I do not know forms the greater part of me. And with this I understand everything. The things I do not know constitute my truth.”

10 Questions with Phoenix Perry

phoenix

Certain people are bellwethers for creative technology and you want to check in on what they are up to every 3 to 6 months to find out where the zeitgeist of the coding world is headed. I’m thinking of people like Kyle McDonald, James George and Phoenix Perry – folks who, per Jean Cocteau’s maxim, manage to stay on the avant-garde even when everyone else has caught up to what had been the avant-garde half a year earlier.

Phoenix is currently teaching physical computing in London. She has spoken and led workshops at most of the leading conferences devoted to emerging technology. You can (and should) keep up  with her adventures on her website, phoenixperry.com, and on twitter.

What movie has left the most lasting impression on you?
2046.

What is the earliest video game you remember playing?
Pong.

Who is the person who has most influenced the way you think?
The women of Code Liberation. Over the duration of the organization have radically shifted how I think and who I am. Mentoring younger women in tech has changed who I am. The conversations we have are inspired and open up my mind to a deeper,  more compassionate way to live.

When was the last time you changed your mind about something?
This week. The river is different every time you step into it.

What’s a programming skill people assume you have but that you are terrible at?
I think it’s more a skill level. People assume I’m some super expert but the truth is I’m often relearning my skill set constantly because it’s so broad. For example, every single time I look at javascript, it’s brand new all over. I’ll go delve in an area deeply and the other spaces will move forward and I’m a novice all over again.

What inspires you to learn?
Humility at how little I know.

What do you need to believe in order to get through the day?
I need to believe the people around me value my work and contributions.

What’s a view that you hold but can’t defend?
I hate Opera. Have no real reason why other than it sounds so annoying to my ears. 
What will the future killer Mixed Reality app do?

One that allows me to interact with one experience fluidly across contexts.

What book have you recommended the most?
Memories, Dreams and Reflections by Carl Jung

10 Questions with Roland Smeenk

smeenk

Roland Smeenk belongs to a species of coders variously known as creative technologists, new media developers, creative designers, etc. As with human civilization, there came a time when coders were expected to settle down in one place and learn to cultivate their code repositories while also effectively implementing division of labor and managerial techniques in order to get us where we are today.

But there are always the hunter-gatherers like Roland who insist on traveling unworn paths, who resist division of labor and want to learn everything for themselves. They stand athwart history, it is true, but they are also the innovators who determine what history will become.

shader

Roland wrote and published the HoloLens Shader Pack to the Unity Asset Store. This lets you have a range of configurable scanning effects like the ones you’ve probably seen in Microsoft’s official HoloLens demo reels – plus a lot more. It’s one of the earliest HoloLens related tools in the Asset Store and an essential component for anyone working on professional MR applications.

 

What movie has left the most lasting impression on you?
Minority Report, because it envisioned future digital interfaces that are already technically feasible these days. From a human factors standpoint most of them are not what you would want in a system that requires efficient manipulation of data. However from an esthetics standpoint they provide a great inspiration for making interactive installations.

What is the earliest video game you remember playing?
I remember playing Pong on my uncle’s television back in the seventies, but that was only one afternoon. It lasted until the eighties before my father bought an Apple IIe personal computer. I played only a few games on that system with it’s monochrome screen. One game that impressed me was “Dung Beetles”, because of the audio sample “We’ve gotcha” that was coming from a speaker that normally only produced simple beeps.

Who is the person who has most influenced the way you think?
I believe there’s a mix of people and experiences that influence your way of thinking in different areas. So what comes to mind are my parents, wife, friends, former colleagues, people I follow online and authors of books I read, all in different areas.

When was the last time you changed your mind about something?
Three questions ago.

What’s a programming skill people assume you have but that you are terrible at?
I don’t know what people are assuming about my programming skills. They are probably better than my mechanical engineering skills that I earned my master’s degree for many moons ago.

What inspires you to learn?
There’s a lot of ground to be explored in mixing the digital and the real world in interesting new ways. And this goes well beyond the use of HoloLens. For interactive experiences it often starts by drawing inspiration from sci-fi movies, music videos, games, artworks and new technology, but I also like a good story as a starting point. This eventually leads to what I need to learn. Lately these are often areas where no software is involved.

What do you need to believe in order to get through the day?
That the things I create will touch people in a positive way.

What’s a view that you hold but can’t defend?
That there is no life after death. At least this reminds me to live life to the fullest.

What will the future killer Mixed Reality app do?
There will not be one killer app, but instead it will be a ubiquitous ecosystem that understands us and helps us do all kinds of everyday tasks. This will give us more free time to spend with family and friends and frees our minds for other things.

What book have you recommended the most?
The design of everyday things by Donald Norman.

10 Questions with Sky Zhou

sky

Sky Zhou is a HoloLens developer who has spent the past year exploring some of the most difficult MR development problems such as storing and retrieving spatial maps and the ins-and-outs of the locatable camera coordinate system. He recently tested out his Room Scanner with help from members of the HoloDevelopers slack group. You can signup to try the public beta now.

If his name sounds familiar, you may be remembering his earlier work on a Pokemon fighting app for the HoloLens.

 

What movie has left the most lasting impression on you?
I have two, The Matrix and Inception; both pose philosophical questions about the nature of existence and reality.

In addition, I like The Matrix for its vision of the future, in terms of the possibility of simulating a world with computer programs and its depiction of the power and danger of AI. I like Inception for its crafty metaphoric story about story telling itself as an art form. HoloLens brought us a giant step closer to the visions of simulated 3D world and alternate realities like dreams. Mixed reality will be a great art form for storytelling.

What is the earliest video game you remember playing?
I didn’t have much play time on video games when I was little. I can remember glympses of super mario, street fighters, and ninja turtles. However, I remember very well the first computer game I played. It was an RPG based on the Romance of Three Kingdoms. I enjoyed the game and the story so much. I wish I can build something like that in mixed reality with HoloLens.

Who is the person who has most influenced the way you think?
Laozi, an ancient Chinese philosopher from 600 BC. It’s hard to explain all his deep thinking here and my interpretation might be flawed. However, if I have to narrow down the idea: things are observed and defined by us, and they can be observed and defined in many other ways. Therefore, nothing has to be absolute and we need not attach ourselves to extremes defined by us. Once you see that, you can always reach a balance, a compromise, or a feasible solution.  It really helps me keep an open mind to this world. The concept of mixed reality could help us understand this fine point. Many different observations and representations can be made in the same physical space, depending on what apps you are running and seeing through the HoloLens, so we can all agree that we don’t always get the same perspective and the same information, and therefore we end up forming different conclusions and decisions.

When was the last time you changed your mind about something?
In general, I change my mind based on additional information and evidence. For example, I used to think Microsoft was a lazy non-innovative company that puts no effort into making another great product and is just milking profit from its Windows and Office software. However, the first public demo of HoloLens in January 2015 blew my mind and completely changed how I see Microsoft.

What’s a programming skill people assume you have but that you are terrible at?
People assume I have some fixed programming skills in some languages, but what I really have is the ability to solve problems, by doing research and experimenting. In this regard, I owe many thanks to the awesome developer community around HoloLens and windows mixed reality.

What inspires you to learn?
1. Problems! I love to apply knowledge to solve problems. It pushes me to learn new things and often lead to even more new knowledge. For example, the frame rate was poor on my first demo of photo-textured room scanning on HoloLens. In order to improve performance on this app, I learned how to use compute shaders.

2. Community. With a great community around HoloLens, you feel you are not alone in this crazy endeavor, and there are people who value what you do. Other developers’ awesome demos also inspire me to do more myself. The feedback I get is the most valuable for alerting me to problems and pushing me to make my apps better. For example, when I saw 3 comments about poor frame rate on my Youtube channel, I knew I had to figure out a way to address it.

What do you need to believe in order to get through the day?
There is another problem to solve and a new thing to learn! Plus my HoloLens is still working!

What’s a view that you hold but can’t defend?
I hold a view that Microsoft got it right this time, with their innovative approach to mixed reality. I can see consumer and business adoption at a massive scale because this technology truly brings amazing utility never seen before, once certain limitations are worked out (such as price, field of view, weight, full gesture recognition, etc.). Windows Mixed Reality is like an extension of Windows with all the familiarities from the existing flat desktop, but in 3D space. This familiarity in non-gaming uses of PCs makes it much more attractive to consumers and businesses.

What will the future killer Mixed Reality app do?
It depends on what pain it kills. Different people experience different pains. For example, a common pain is a long commute time. One possible solution is that company offices can be significantly reduced in size and most people work from home or anywhere they choose. Many large companies are currently heading in this direction already. Besides using mixed reality tools for creative 3D art work, an immersive virtual home office could improve focus, and shared experiences with the holo-presence of colleagues could improve teamwork and collaborations. Thus, the effectiveness and efficiency of working from home can be improved.

The ultimate dream of mixed reality is that you have 3D digital information and holograms overlay on top of a real physical environment no matter where you go and users can interact with them in shared experiences. Think of Pokémon Go plus Google street view, but with useful and relevant information wherever and whenever you need them. This requires much finer mapping—finer than Google street view currently provides—to your desk, your fridge, your car, and even yourself. This idea is not original to me: Ori Inbar wrote a great article recently about it and termed it “the AR Cloud.” When that happens, in essence we will have also created a massive interactive virtual world like the Matrix.

What book have you recommended the most?
Angels and Demons, by Dan Brown; Zen and the Art of Motorcycle Maintenance, by Robert M. Pirsig.

10 Questions with Stephen Hodgson

hodgson

Stephen is an immersive experiences developer at Valorem. He is also a moderator and the most prolific contributor to the HoloToolkit (now the Mixed Reality Toolkit). If there has been a change to the toolkit over the past year that improved your developer experience, Stephen probably made it. Moreover, he does this in his free time.

shodgson

I spent an evening online with him about two weeks ago fixing an issue with automatic builds for Visual Studio 2017 and spent much of that time wondering how one person could maintain so much knowledge about such a large and complex code base. He is the centurion at the gate, finding satisfaction when our Mixed Reality projects go well and happy when he can provide tools to make our development easier. The next time you successfully deliver a project, please consider sending Stephen a thank you.

 

What movie has left the most lasting impression on you?
Arrival was pretty interesting. I really find time travel and their paradoxes quite fascinating. The looping nature of the alien language and the connection to the movies main theme really helped drive the action. I also loved how the movie started at both the beginning and end. I enjoy many movies that range across different genres, from sci-fi to action.

What is the earliest video game you remember playing?
Chrono Cross by Square Enix is definitely the one I remember most vividly, but I’m pretty sure the first video game I ever played was the original Mario game on the Nintendo.

Who is the person who has most influenced the way you think?
This one is pretty difficult to answer. I’m not sure if any one person had a huge impact on why I think the way I do. I’ve always been off in my own thoughts thinking about how light, electromagnetism, and matter work together—oh and also the paradoxes of time travel, haha.

When was the last time you changed your mind about something?
I feel like I change my mind a lot. Generally, I like to approach things from many different angles and evaluate them to see whichever option is the best, and even then I’m likely to make an adjustment down the line. When it matters, I try to corner myself into making a decision that I can’t back out of.

What’s a programming skill people assume you have but that you are terrible at?
Professionally I like to stay pretty honest about my abilities and accept work that fits my skill level while still challenging me to grow. I definitely feel like I need to get stronger in networking and understanding the lower level languages a bit more, although the need for memory management is no longer a requirement, it’s nice to know exactly why a function or class works the way it does.

What inspires you to learn?
Leaning is a part of life, and is essential to survival. On that note, I’ve always liked the notion that the only way to learn is to make mistakes. I’ve always found it frustrating when people can’t admit they’re wrong about something, because they are admitting they don’t make mistakes, which in turn leads me to believe that they’re incapable of learning new ideas.

What do you need to believe in order to get through the day?
Tomorrow never comes. I usually don’t think about the end of the day until it arrives, and by then I’m already planning tomorrow.

What’s a view that you hold but can’t defend?
Not sure how to answer this one. I usually don’t hold a view that can’t stand on its own.

What will the future killer Mixed Reality app do?
The whole idea of mixed reality apps is to bring the virtual into the real world. There’s been a big push recently about how the internet will dramatically change after the association with a physical space and it’s virtual space—like a webpage or other virtual element—can be brought together to create a meaningful productive space.

What book have you recommended the most?
I haven’t read an actual book in quite a while, but growing up I was definitely a bookworm. Now I read code all day. If I had to recommend reading, it’s the new APIs and change logs from Unity, Windows 10 SDK, and the Mixed Reality Toolkit for Unity.

10 Questions with Nate Turley

nate

Nate is a multimedia engineer currently freelancing in New York City. He is also a good friend going back to our time together at Razorfish Emerging Experiences where we worked side-by-side pushing the envelope on interactive installation projects with Surface tables, IoT, Kinect, tablets, phones, VR, and several devices we hacked together ourselves.

Over a year ago, while most people playing with HoloLens were still finding their way around the Unity IDE, Nate was exploring how to build artistic effects for the HoloLens using DirectX and seeing how hard he could push the HoloLens GPU. Since then, he’s been working on various HoloLens and HTC Vive projects to earn his bread while pursuing his ultimate goal of creating cool interactive experiences involving music, lighting, technology, dance and people. He’s someone I’ve always admired as much for the clarity of his artistic vision as for his technical prowess.

 

What movie has left the most lasting impression on you?
I’ve never been able to sit still long enough to gain a real appreciation for movies. I only watch movies on airplanes these days. Fight Club had a pretty big impact on me, though. I first saw it at a very impressionable age and there always seems to be relevant scenes popping into my head.

What is the earliest video game you remember playing?
It’s hard for me to place… I grew up with an engineer for a Dad and surrounded by techy folks. I remember playing tennis on VirtualBoy. We had some early atari system as well. I also had a Macintosh SE as my first computer (older than me) that I used to play this weird 2.5D pong game called Shufflepuck Café.

Who is the person who has most influenced the way you think?
I’m influenced by many people in my life. I believe you should try to glean something from everyone you admire and respect. I’ve had many great mentors along the way (including James).

My parents, of course, taught me a ton about how to live and reach my goals. My Dad taught me everything I know about computers. When I was young we’d go on long drives together and he’d be telling me about how CPU caches work. It was wild. My Mom has been an artist for many years and she’s always encouraged me to keep my artistic side alive.

For one I’ve never met, I’d pick Aldous Huxley. I discovered his writing at a time when I needed some direction in my life pretty badly. He has a way of capturing the intangible nature of the human experience with words better than any other writer I know, and it’s helped shape the way I consider my place in the world more than anyone else.

When was the last time you changed your mind about something?
I’m a Gemini, I do it constantly.  Recently I changed my opinion of mobile AR. I thought it didn’t have much of a future. Gotta give it up to Apple and all the cool things people are making with ARKit. Pretty excited now.

What’s a skill people assume you have but that you are terrible at?
I’m not very good at math, and I don’t really enjoy it. I failed Calculus II. Almost twice. I like making stuff with math though. Right now I’m working with chaotic systems to create natural movement and that is fun, but the analytical stuff isn’t for me.

What inspires you to learn?
I think it’s really essential to what it means to be human. Plus I get bored easily. I always need to feel like I’m pushing some edge in one aspect or another. I feel very blessed that I’ve essentially made a career out of learning new things.

What do you need to believe in order to get through the day?
This too shall pass.

What’s a view that you hold but can’t defend?
Brunch culture was systemically created as a means of controlling the populace.

What will the future killer Mixed Reality app do?
It will make talking about reality in terms of virtual, mixed. Our language will gradually phase out making any distinction between real and virtual. It’s funny how much time people spend debating what is AR/MR/VR. We need to move beyond that kind of thinking.

What book have you recommended the most?
I recommend different books to different people. I don’t think I have a one size fits all answer, so I’m going for the audience here.

I’ve gotta say Neuromancer. It’s a must read for anyone in this field. Gibson literally wrote the book on our present and future in regards to the internet, mixed reality, and artificial intelligence. Oh, and he did it on a typewriter in the 80s.

10 Questions with Kevin Collins

kevin

Kevin is a Director at Microsoft who builds proofs of concepts for their most innovative technologies such as the HoloLens. He guided the HoloLens / Lowe’s collaboration which provides a much copied template for retail solutions using AR.

For those of you familiar with Bill Buxton’s book Sketching User Experiences – especially the sections about the design of the Active Desk – there is an easy analogy to draw here. Kevin’s role is to sketch and prototype the future before the future arrives.

 

What movie has left the most lasting impression on you?
The Matrix.

What is the earliest video game you remember playing?
Asteroids.

Who is the person who has most influenced the way you think?
My father.

When was the last time you changed your mind about something?
Last week.

What’s a skill people assume you have but that you are terrible at?
How about dislike doing?  Project management.

What inspires you to learn?
The challenge.

What do you need to believe in order to get through the day?
#HowNotIf .

What’s a view that you hold but can’t defend?
Christianity.

What will the future killer Mixed Reality app do?
Personal assistant – everything you need without having to find it.

What book have you recommended the most?
The Shack / If you don’t know where you are going you will wind up someplace else.