How I Lost 139 Pounds Following Animal Crossing Workout Routine

While the worldwide pandemic has been hard from many angles, one of the hardest has been being forced to sit around slothfully at home. The pounds seemed to just accrue of their own accord. And then I found Animal Crossing: New Horizons.

IMG_0249

My children had been talking about it incessantly but it had mostly been background noise for me as I was pre-occupied with the health of friends and family and the future of work in a changed economic hellscape. Then in a bout of late-night insomnia I hooked up their switch to the living room TV and started playing. Before I knew it I was obsessed. A couple months later, I found I had lost 139 pounds. Here’s how:

1) The first thing is you have to find ways to stay active while you are playing Animal Crossing. One good way is to heavily use the A button when you are walking around in-game. The A button generally makes you sneak, but if you swiftly release it, it makes you swing your net. Spam the A button so while you are walking, you are also constantly swinging your net and building up those biceps and triceps.

2) Another important thing to do is to shake every tree vigorously, especially on mystery islands. You will burn a lot of calories by shaking trees. Additionally, shaking trees will occasionally cause a wasp nest to drop from the tree. You can then spam your A button to whip out your net and get some extra reps for your biceps and triceps.

IMG_0251

3) The A button isn’t just for nets. By pressing the A button repeatedly, you can speed past those crafting animations. In addition, pressing B will let you zoom past conversations with the creatures in Animal Crossing. Basically, if you have no idea what is going on because you keep skipping past things with your A and B buttons, it means you are getting a good workout. No pain, no gain.

4) Break tools. Tools break easily in Animal Crossing so break as many as you can. This will afford you the opportunity to craft more tools and spam that A button.

5) Don’t spend all your time collecting turnips for the stalk  market. Time travel is a better way to make quick money anyways. Instead, you should be spending most of your time collecting rocks and wood. Why? Because you can then use these rocks and wood to craft tools which you can then break while spamming the A button to speed through animations.

IMG_0250

6) Combine these game playing strategies with a sensible diet and take reasonable breaks from the game. I typically start the morning with a breakfast bar, with nuts but no dairy components, and preferably hazelnut but dark chocolate will work in a pinch. Then I play Animal Crossing for about six hours. I take a sensible break in the afternoon during which I run eight miles through the deer crossing that starts in my backyard. When I get back, I don’t bathe because I find that the smell of my own sweat helps me stay sharp, and I play for another eight hours and finish the day with a simple meal involving a single non-GMO turnip flavored with half a teaspoon of margarine, accompanied by a simple glass of tap water dosed with Ex-Lax. Rinse, repeat.

I can’t guarantee that you’ll achieve the same results. I’m legally obligated to say that. But you might, if you fully commit yourself  to the Animal Crossing Workout. What have you got to lose?

Tech means never having to say you’re sorry

spatial

There have been a series of amazing turns of event in the mixed reality world lately. The big headliners for me are:

1) Magic Leap laid off about a thousand employees due to diminishing funds but then was able to get a lifeline of $350 million, which will save the jobs of the remaining 300-400 engineers. The creative teams and sales teams appear to have been gutted in the first round of layoffs, unfortunately.

2) Microsoft HoloLens announced general availability of the HoloLens 2 on the Microsoft Store starting in July. Also availability in more countries starting in the fall.

3) The Unity XR SDK is getting closer to shipping, or has already shipped but is only working well with some platforms for now? Obviously some things need to be ironed out, but this appears to be the future of cross-platform AR development.

4) Spatial.io, the cross-platform XR collaboration platform, has made its product free.

Along with these there have been a series of refreshingly honest video interviews with some of the central people in the current evolution of mixed reality that help to frame our understanding of what has been going on at Microsoft and at Magic Leap over the past five years.

The XR Talk podcast is always great (thanks Roland for introducing me to it). This meandering interview with Graeme Devine, post-Leap, is particularly fascinating. There’s a great story of how he delivered the blade Orcrist (or was it Glamdring?) to Neal Stephenson in order to tempt him to come work with Magic Leap.

This week also saw the hosting of MR Dev Days conference on altspaceVR, which was a fascinating and wonderfully international experience.  Big thanks to Jesse McCulloch and everyone else responsible for throwing it together. The highlight of the show was a very frank conversation between Rene Schulte and Alex Kipman which I can’t recommend enough.

kipman

During the fireside chat (and the keynote the previous day) Kipman acknowledged the drawn out distribution of the HoloLens 2 and thanked developers for their patience. He also discussed the bucket problem (I think that’s what it’s called?) in which losing a a bucket of credibility requires a lot of buckets to regain that same level of credibility (pretty sure I messed up that metaphor).

We’ve seen a lot of that in the MR world this month. The financial problems at Magic Leap will have put a lot of people off. The fact that all the laid off employees have refrained from criticizing the company in the aftermath has been  surprising and probably speaks well for the company culture.

Meanwhile in the HoloLens world, public and private message boards indicate a lot of frustration with the product team. Original messaging suggested the devices would be out in early 2019, but over a year later, individual devs still have problems getting devices.

Looked at objectively, it’s pretty clear that if the HoloLens team could have gotten more devices to indie devs they would have and that the delays were not intentional. But knowing that also doesn’t necessarily make the bad feelings go away, given the difference between knowing and feeling, and this  in turn may have a depressing effect on any excitement around the wider release in July and then in the fall.

For what it’s worth, I think an apology goes a long way, and a heartfelt, personalized acknowledgment of the people who might feel slighted will go the greatest way. The difficulty here is that in a corporate culture like Microsoft’s, acknowledgement of mistakes is as alien to the normal way of doing things as – well, to be honest – as it is in the Trump administration. The culture of the Trump administration, after all, comes out of common practice in the modern corporation.

This isn’t always the case, though, and I have two pieces of evidence. Microsoft is very good at giving out chachkas, and even sent out an impressive gift pack for their online Build conference. The two best things I ever got from Microsoft, though, were personalized notes.

The first is a note from the Ben Lower / Heather Mitchell days of the Kinect program. Somebody wrote this out by hand, providing both an acknowledgment of who I am and what I had done (and to be honest, I was surprised they even knew who I was at the time):

WIN_20200523_18_10_50_Pro

The next is a card from the early days of the HoloLens program (Venessa Arnauld / Aileen Mcgraw).

WIN_20200523_18_10_27_Pro

These are my two most prized possessions from Microsoft over the past decade. Friends and associates have similar mementos they memorialize at home. The lesson from these two examples, for me, is that in tech you don’t always have to say you are sorry. It is often good enough, and probably more meaningful,  to acknowledge the legitimate concerns, understandable feelings,  and obvious humanity of the people who make you successful.

That’s a lot of personalized messages, but also the sort of thing that can easily repair broken or damaged relationships with your developer community.

TCSG Leadership Conference and Deepfakes

I’d like to thank the Technical College System of Georgia for inviting me to deliver the talk “Who’s Afraid of Deepfakes” at their 2019 Leadership conference in Savannah, GA. It is a great pleasure to be able to deliver this material to people who are not already familiar with it. It was also a privilege to speak after Jason Poovey of Georgia Tech, who provided a fascinating overview of the current state of AI research and his vision for bringing business, math and technology together.

I also want to thank Adie Shimandle, Billie Izard and Steven Ferguson for organizing the talks. Thank you Elizabeth Strickler, Director, Media Entrepreneurship and Innovation at GSU, for introducing me to Adie.

Imposter Syndrome Reconsidered

thomas

The term “imposter syndrome” is a meme that has captured the imagination of the technology sector – and for good reason; we are insecure people. The term may have made its way into the tech world in an illegitimate manner, however. This illegitimate use of the term is what I want to explore in this post, coupled with the rather obvious conclusion that “insecurity” is the better term in the vast majority of cases, despite its relative un-sexiness.

“Imposter syndrome” was first clinically described in 1978 in my adopted home city Atlanta, Georgia by Pauline Rose Clance and Suzanne Ament Imes in their paper The Impostor Phenomenon in High Achieving Women: Dynamics and Therapeutic Intervention. There are several salient features in the way it was originally understood which distinguish it from the way imposter syndrome is used today by software engineers.

9to5

First, the diagnosis was originally meant to describe the unique situation of professional women in a predominantly male-dominated professional world. In the 70’s we didn’t ask if men felt like phony’s, too. That would have been missing the point.

Second, the phenomenon covered successful women in particular – that is, women whose accomplishments were publicly recognized and not merely a matter of self-esteem. Today when we talk about  imposter syndrome, by contrast (for instance in Scott Hanselman’s famous post I’m a Phony), the point is always that unaccomplished people should not feel like imposters because even successful people like X, Y and Z feel this way. In the original article, obviously, the term could only be applied to X, Y and Z. Other people, male or female, who felt unearned confidence without visible accomplishments, simply were imposters.

chauncy

Third, imposter syndrome was a phenomenon tied to early family dynamics and requiring therapy to overcome. Today, no one says if you have imposter syndrome you should look for professional help to deal with it. Instead, recognizing the condition is meant to be in itself an instantaneous form of self-therapy, because if everyone has imposter syndrome then no one has imposter syndrome.

In 2019 imposter syndrome has moved well beyond its original carefully circumscribed bounds, to the point that 70% of professionals acknowledge feeling like imposters from time to time (this is an often cited statistic I have been completely unable to source). If this large number is meant to make us feel better about our own insecurities, it should nevertheless concern us that the people who run our banks, fill out our taxes, prescribe our medications, perform surgery on us, cook our food, fix our cars and run our government aren’t always sure they know what they are doing. I would question whether this is actually a good thing.

doingitwrong

Imposter syndrome has found a home in technical communities. There are several obvious reasons for this. The sort of people who go into tech tend to be beset by social anxiety. At the same time, the most common communication strategy used in technology is bombastic and overconfident – sometimes described as bro culture. These two things together will cause a frequent sense of inadequacy in the face of often meaningless processes like behavioral interviews, fadish architectural trends and cargo-cult adherence to agile processes. And if agile isn’t working for you, then you are doing it wrong, so you should feel inadequate about that, too.

elizabethholmes

At the same time, the software industry is a young industry with characteristics that make it susceptible to real imposters. It is a complex profession lacking recognized standards of education or certification. After all, even hair dressers have to be licensed. The guy who writes your banking software, on the other hand, doesn’t. For a set of peculiar linguistic social and linguistic reasons, however, we have no easy way for technologists and business people to talk to each other and judge the relative merits of different approaches to writing software. This leaves the unlicensed software developers in a position of needing to police themselves, with mixed success. In philosophy, this is generally known as the crisis of legitimation.

Another problem is that software is very important in our current world. A lot of time and money is determined by whether we make good or poor software solution decisions. In the case of medical software, lives are literally at stake.

fairies

A third characteristic compounded by the crisis of legitimation and the high stakes involved is a tendency to love shiny new technology. Whenever things don’t go well with a project, we gravitate toward unknown and untested new platforms, frameworks and processes to fix our problems. This creates an inverted success strategy where the technology industry prefers mysterious, poorly understood solutions over acquired experience.

All of this leads to lots of tech people normalizing the process of talking about things they do not know anything about. Whereas in established professions, people know not to speak when they have that vertiginous sense that they are out of your depth, in technology, if no one contradicts us we accept this as license to continue bullshitting. Fake it till you make it.

patterson-gibly

Because other people’s money and potentially lives are on the line, however, we should recognize that this is dangerous behavior.

Moreover, the notion that everyone has imposter syndrome fails to recognize that in previous generations, that sense of being out of one’s depth is how professionals discovered their weaknesses in order to move from journeymen to experts in their craft.

In fact, there is a whole genre of literature known as Bildungsroman dedicated to exploring this basic aspect of the transition to adulthood. Novels as diverse as Twain’s Huckleberry Finn, Dickens’s Great Expectations, Jane Austen’s Emma and Hurston’s Their Eyes Were Watching God and Salinger’s Catcher in the Rye cover this difficult journey from naivete and unearned confidence to nuanced understanding and expertise. The most common hallmark of his genre is the recognition that error, misspeaking and insecurity are milestones in our path towards self-mastery. Being insecure is a good thing, not a bad thing, because it drives us to be better.

_108622702_surgeonsphoto

Insecurity is normal and good. This feature of the human condition tends to be masked and smoothed over by terms like imposter syndrome which helps us to ignore these moments of doubt, which is a shame.

For this reason, I prefer that people just say they feel unconfident about an idea or approach. When someone tells me this, I can help them evaluate their idea and potentially refine it so we both learn something.

trump

When someone tells me they have imposter syndrome I don’t really know what I’m supposed to do. They obviously want me to say that everyone has imposter syndrome and so they should believe in themselves. But when the stakes are as high as they are in software engineering, this feels like a cop out. 

If you are feeling like an imposter in tech, maybe that’s something worth exploring more deeply.

Zao’s Next Gen DeepFakes

The Zao app, by Changsha Shenduronghe Network Technology Co Ltd, was released on the Chinese iTunes store a week ago and was popularized in a tweet by Allan Xia.

It is not currently available through iTunes in the U.S. but with a bit of hard work I was finally able to install a copy. I was concerned that the capabilities of the app might be exaggerated but it actually exceeded my expectations. As a novelty app, it is fascinating. As an indicator of the current state and future of deepfakes, it is a moment of titanic proportions.

As of a year ago, when the machine learning tool Fake App was released, a decent deepfake took tens of hours and some fairly powerful hardware to generate. The idea of being able to create one in less than 30 seconds on a standard smartphone seemed a remote possibility at the time. Even impossible.

The Zao app also does some nice things I’ve never gotten to work well with deepfakes/faceswap or deepfacelab – for instance like handling facial hair.

… or even no hair. (This is also a freaky way  to see what you’ll look like in 15-20 years.)

What is particularly striking is the way it handles movement and multiple face angles as with this scene from Trainspotting and a young Obi Wan Kenobi. In the very first scene, it even skips over several faces and just automatically targets the particular one you specify. (In other snippets that include multiple characters, the Zao app allows you to choose which face you want to swap out.)

All this indicates that the underlying algos are quite different from the autoencoder based ones from last year. I have some ideas about how they have managed to generate deepfakes so quickly and with a much smaller set of data.

Back in the day, deepfakes required a sample of 500 source faces and 500 target faces to train the model. In general, the source images were rando and pulled out of internet posted videos. For the Zao app, there is a ten second process in which selfies are taken of you in a few different poses: mouth closed, mouth open, raised head, head to the left and blinking. By ensuring that the source images are the “correct” source images rather than random ones, they are able to make that side of the equation much more efficient.

While there is a nice selection of “target” videos and gifs for face swapping, its is still a limited number (I’d guess about 200). Additionally, there is no way to upload your own videos (as far as I could tell with the app running on one phone and Bing translator running on a second phone in the other – the app is almost entirely in simplified Chinese). The limited number of short target videos may simply be part of a curation process to make sure that the face angles are optimized for this process, mostly facing forward and with good lighting. I suspect, though, that the quantity is limited because the makers of the Zao app have also spent a good amount of time feature mapping the faces in order to facilitate the process. It’s a clever sleight of hand, combined with amazing technology, used to create a social app people are afraid of.

The deeper story is that deepfakes are here to stay and they have gotten really, really good over the past year. And deepfakes are like a box of chocolates. You can try to hide them because they are potentially bad for you. Or you can try to understand it better in order to 1) educate others about the capabilities of deepfakes and 2) find ways to spot them either through heuristics or CV algorithms.

Consider what happened with Photoshopping. We all know how powerful this technology is and how easy it is, these days, to fake an image. But we don’t worry about it today because we all know it can be done. It is not a mysterious process anymore.

Making people more aware of this tech, even popularizing it as a way of normalizing and then trivializing it, may be the best way to head off a deepfake October surprise in the 2020 U.S. elections. Because make no mistake: we will all be seeing a lot of deepfakes in October, 2020.

10 Questions with Noah A S

noah2

Every group of friends has one person who holds the others together. In the world of Magic Leap, this person is Noah Aubrey Schiffman.

When the HoloLens first came out, the HoloLens team tried to create their own community website and forums. But people felt more comfortable hanging out in the HoloDevelopers Slack group that Jesse McCulloch created (and now Jesse works at Microsoft). When the Magic Leap came out at the end of 2018, a friend and I started a Slack group for it while others created a Discord channel to gather the community.

However, it was the twitter thread and #leapnation tag that Noah created which eventually became the gathering spot for MR developers, hobbyists and fans.

Why? you might ask. I think communities develop around people whose sincere enthusiasm reflects and reveals the common purpose inside the rest of us. In the world of magic leap, this hearth keeper is Noah, unofficial community ambassador to the magicverse, first of his name. Long may he reign.


What movie has left the most lasting impression on you?

Terminator II: Judgement Day (with the fear of Skynet) Or The Matrix (the idea of living in a simulation)

What is the earliest video game you remember playing?

It might have been something on an old-style Mac. Probably the game Sockworks which is for young toddlers.

Who is the person who has most influenced the way you think?

Probably my mother or a few of my friends.

When was the last time you changed your mind about something?

I do it a lot.. so I guess it was this week.

What’s a skill people assume you have but that you are terrible at?

ah a skill I don’t have that people assume I have.. Development, in something. It could be javascript I’ve not made much anything yet.

What inspires you to learn?

More learning, I guess, Isn’t it a cycle?

What do you need to believe in order to get through the day?

I don’t really need to believe very much I’m good when it comes to coping? Is this the question?

What’s a view that you hold but can’t defend?

It’s when I know something is coming or on the way but I signed an NDA so I cannot talk about it.

What will the future killer Mixed Reality app do?

– Something social! *Or* It will give you news! (doesn’t twitter do both?)

What book have you recommended the most?

Snow Crash.

10 Questions With Charles Poole

charles_poole

Charles Poole, the owner of IS Studios,  is currently one of the most experienced mixed reality developers in the business. Like many of the other people well known for their development chops on the HoloLens and Magic Leap One, he fell into it accidentally. Through a combination of determination and blind luck, as well as the ability to pick up a new UX paradigm that requires technical acumen with both .NET and Unity, he is currently one of those rare people with 3+ years of hands-on MR design, development and project management experience. You’ll have to ask him yourself for the full story, but it basically comes down – as with so many others – to getting his hands on a very expensive device and learning to make it hum (ideally  using spatial audio).

Charles is soft spoken and kind. One of the very interesting things about his background is that he is a mathematician – and so in that small subclass of software developers who actually knows math! There’s nothing nicer in the world of programming than having a friend you can hit up when you are having problems with an algorithm or with your matrix math.


What movie has left the most lasting impression on you?

Hackers, I think watching Hackers in 95/96 shaped my childhood and later choices when it came to education and what I spent my time on.

What is the earliest video game you remember playing?

Super Mario Brothers on the NES, or Sky Kid, also on NES. I remember playing it for hours just to get to the 3rd or 4th level, then watching my father get a lot further.

Who is the person who has most influenced the way you think?

Maybe Buckminster Fuller, Neal Stephenson maybe Michael Crichton. I read a lot as a child, I feel as though all the views I was exposed to through fiction and non-fiction had a big influence in how I see the world and approach problems. In general the problems seem really big, cause a lot of drama, are entertaining to read and experience, then the solution just happens to come together from a character that has the experience to pull a solution out of their ass.

When was the last time you changed your mind about something?

A big one recently, and kind of mild, was using Photon for the multiplayer aspects of my work. I was against Photon for a long time, I wanted to be in control of every aspect of what I was building. So I’d do things like make a custom socket server, write the server in Dark rift, use WebRTC. One of the most important things about freelancing is using every tool you have to accelerate development, while keeping it altogether. We had to make a decision recently about a multiplayer backend that could scale to thousands of users, but still be self hosted, and the time-frame was extremely compressed, so I revisited Photon, specifically PUN2 which had been released since the last time I had used PUN, and it felt like it had come a long way in the time since I had used it last.

Simpler and more personal – My daughter’s kindergarten teacher had been pushing for her to repeat kindergarten. I was staunchly against it, she was getting top marks, won the science fair over 5th graders, and with something she had actually done and came up with on her own, we only bought the materials. But she just wasn’t emotionally ready for the pace to get quicker in first grade, and her teacher made her excited about helping out for another year. So, we agreed to have her repeat kindergarten, because she loves to learn, and we didn’t want to make school into something she hated.

What’s a skill people assume you have but that you are terrible at?

Managing my time, I’m terrible at managing my time, I tend to get sucked into a project and neglect everything else. I would work every day from 9am – 9pm or later. I had to step back and put a rigid stop time on my day so I would spend time with my kids and not just work through their whole childhood.

What inspires you to learn?

I want to do everything myself, and push myself outside my developer comfort zone everyday. I’ll say ‘yes’ to things just for the challenge of figuring it out.

What do you need to believe in order to get through the day?

That things can only get better. I started off this dev journey making a thousand bucks a month, living in a tiny apartment with my wife and two kids. Every day, week, month feels like things have gotten better for us, at some point I want to turn around and help make other people’s lives better too.

What’s a view that you hold but can’t defend?

That anything is possible with enough hard work. I have an applied math background, and have seen sparks of insight and intuition I know I’d never have, but I still feel like I’d get there eventually if I put enough hours into it.

What will the future killer Mixed Reality app do?

Something agent based, an intelligent agent that acts as your exocortex. AI/ML is the future of Human Computer Interaction, the killer app won’t feel like an app, it will just be part of your life.

What book have you recommended the most?

Rainbow’s End by Vernor Vinge, it’s shaping up to be the most prescient book I’ve read. It was written in 2006 but the trends he wrote about are what we’re starting to see today, the nascent AR technology.

12 Questions With Simon “Darkside” Jackson

simon_d_jackson

Simon is one of the main contributors to the Microsoft MRTK framework for HoloLens and also to the XRTK framework for cross-platform mixed reality development. He is the author of several technical books on Unity. He is keeper of the flame on the Unity-UI Extensions source code.

Simon basically really intimidates me. He knows the Microsoft coding stack as well as the Unity stack, which makes him formidable. He’s currently working on extending the XRTK framework to support the Oculus Quest, which means if you have built your HoloLens or Magic Leap app on the XRTK, your app will automagically also run on the Quest thanks to Simon. That’s some seriously cool stuff.

He also happens to be a very nice person who is genuinely concerned about the well being of the people around him – which I found out the easy way over many online and in-person interactions. I’m not totally sure why he promotes himself as of the Darkside since he is clearly more of a Gray Jedi – but that’s not one of the 10 questions, so we may never know. Without further ado, here are Simon’s answers to the 10 Questions:


What movie has left the most lasting impression on you?

The Matrix, it shows us how to stand tall, to face adversity with strength and uncover meaning in this world we call life.”

What is the earliest video game you remember playing?

“Given I have to recognise I’m getting old, my earliest game I recall was Pong on the Atari 2600.  First game console our family owned.  First games would be the penny shuffle machines in the arcades of old .”

Who is the person who has most influenced the way you think?

“William Shatner, for showing us how to boldly go and give us a glimpse of the world I’d like to see us aspire to.”

When was the last time you changed your mind about something?

“Whenever the wife decides  something and I have no other option but to agree.”

What’s a skill people assume you have but that you are terrible at?

“Recruiters are constantly sending me offers for jobs developing in JavaScript or Java, which I’ve avoided for most of my developer life.”

What inspires you to learn?

“My life’s goal is to always learn something new each and every day, to grow and develop.  If we no longer aspire to develop ourselves we cease to be.”

What do you need to believe in order to get through the day?

“I have to believe the coffee will not run out, else the world becomes a much more vicious place.  I also hope to defeat ignorance, but ignorance always finds new ways to baffle me.”

What’s a view that you hold but can’t defend?

“I have long held the belief that humankind will eventually realise its insignificance and start to work towards the betterment of ourselves and the planet we live on.  However, I’m proven wrong each and every day (for now).  Basically, I want the world of Star Trek, not the world of Star Wars.”

What will the future killer Mixed Reality app do?

“Once mixed reality technology finally becomes affordable enough and cool enough to wear all day long, I believe the killer experience will be something that integrates with our everyday.  An app/experience that will enrich the world around us, show us new sights and experiences, and offer us new ways to interact.  Be it a simple experience that adds wonder to a shopping centre experience, or uses geo location whilst visiting historic sights and completely immerse us whilst learning (in stead of just reading signs as we do now).”

What book have you recommended the most?

Snowcrash by Neal Stephenson, it opens up so many new possibilities and levitates towards the dangers of being “plugged in” too much.  Giving us a sense of wonder and danger in equal measure, leading us to live in a world augmented by technology but not driven by it.”

And then Simon volunteered two more unsolicited  questions:

Favourite quote?

“The definition of insanity is doing the same thing over and over again and expecting a different result.
—  Albert Einstein (as well as others).”

Most used phrase?

“Because… unity.”