Immersive Entertainment for Hospitalized Kids
  • Client: AT&T Foundry Palo Alto
  • When: 2017
  • Team: Product Manager, Virtual Reality Development Engineering team (Quantum Interface), and Non-profit with connections to musician and hospital (Melodic Caring Project)
  • My Role: Product Manager
Overview

As an Innovation Lead at the AT&T Foundry, I work on applying emerging technologies to make the world a better place. In 2017, I led a technology for good project to create immersive entertainment experiences for children in hospitals as a form of distraction therapy, through collaboration with Quantum Interface (technology startup) and the Melodic Caring Project (nonprofit).

AT&T is transforming into both an Entertainment and Telecommunications company. Projects such as this highlight the need for a strong 5G use case where there is a need for high throughput and bandwidth to support a quality experience for users. By applying emerging technologies to real-life problems, we are able to solve business needs, uncover new markets, and help change lives.

Immersive Entertainment for Hospitalized Kids: Amos Lee Concert in Virtual Reality on Google Daydream VR Goggles UX Mockup

Immersive Entertainment for Hospitalized Kids Poster

Background

In 2016, I initiated and spearheaded our exploration of the Augmented and Virtual Reality market to propose strategic business plays for AT&T and Ericsson. As I engaged with our ecosystem, I discovered two amazing companies, each experts in their own field — one a technology company specializing in virtual reality and custom interfaces (Quantum Interface) and the other a nonprofit that streams concerts to children in hospitals (Melodic Caring Project).

It occurred to me that if I connected Quantum Interface’s next generation, interactive interface for 3D experiences together with a 360 virtual reality video of Melodic Caring Project’s live streaming of personalized concerts to hospitalized kids, we could create something truly memorable. So, we did just that.

Live Streaming

After introducing everyone, the project took off immediately! Quantum Interface brought in SubVRsive to make the Virtual Reality capture a reality, and Melodic Caring Project brought in singer-songwriter Amos Lee and team as the content creators at the core of this experience. Together, the team used the magic of 360 live streaming to transport hospitalized children to an Amos Lee concert experience that they could share with their loved ones as they received encouragement from near and far!

Our partners were pivotal in making our live stream a success. Fresh off this achievement, we quickly moved onto the next step — building an interactive, immersive experience.

“Watching the concert as a VR show completely swept Maya away. She was feeling badly from recent chemo and having the glasses and the 360 experience took her away from the yuck that she had been feeling.”

– Maya’s father (Maya is in the photo below)

VR Virtual Reality 360 Video Amos Lee Concert Experience for Maya

Hands-free, Interactive Experience

After the live stream, our team created a post-produced 360 experience with an interactive layer on top of this recorded concert. Children are not only able to be immersed in the concert, but also can interact with the environment and control playback using only small head movements, all completely hands-free! This is huge for patients who may not just be confined to their care facilities, but may also be bedridden or tethered to medical equipment with limited mobility.

We have been fortunate enough to share our interactive experience with countless viewers both inside and outside of hospitals, and the response has been overwhelmingly positive.

Instructions for Immersive Entertainment for Hospitalized Kids
AT&T Shape Conference attendees enjoying the Immersive Entertainment for Hospitalized Kids

Quantifying the Impact

We started by collecting anecdotal evidence that we are helping patients escape from the discomfort of their hospital rooms. Now, we are quantifying the impact our immersive entertainment experience is providing as distraction therapy through clinical trials.

With the use of quantifiable biometric sensors and qualitative surveys, we are able to correlate the two to assess how effective this experience is as distraction therapy and what factors are necessary to build an effective distraction therapy experience.

Streaming a Catalog of Content

As we widen our audience reach, we are also expanding the catalog of content accessible within our video player. Using AWS, we are building a repository of content pieces that a user can draw upon. Patients are able to navigate hands-free through a library of options to suit their needs, whether it be a desire for an outdoor adventure to a relaxing meditation by the fire.

Amos Lee Concert being recorded backstage in 360 degrees for Immersive Entertainment for Hospitalized Kids
Amos Lee on stage during the concert for Immersive Entertainment for Hospitalized Kids

Press Release

Austin – March 7, 2017 – Philadelphia-based singer-songwriter Amos Lee played a sold-out concert at the world-renowned Austin City Limits Moody Theater on Saturday, February 25, 2017. This time, Amos’ sold-out show didn’t just reach the crowds of the Moody Theater. With the support of partners including Quantum Interface, SubVRsive and the Ericsson team at the AT&T Foundry, the Melodic Caring Project, a nonprofit that bridges the gap between music, technology, and patients battling serious illness by live streaming personalized concerts to kids and teens in the hospital, live streamed its first-ever multi-camera, virtual reality 360 video show directly to kids’ hospital/home care rooms.

Since Melodic Caring Project’s founders, Levi and Stephanie Ware, began this journey seven years ago, the nonprofit has broadcast approximately 400 concerts to nearly 5,000 children all over the world and has partnered with some of the world’s biggest artists, including The Black Eyed Peas, Jason Mraz, Andra Day, Alabama Shakes, Rachel Platten, Daughtry and The Head and the Heart. The nonprofit gives the performing artists a list of kids (aka rockSTARS) who will be watching the night of their show. Then, during the shows, the artists call each rockSTAR out by name, offering support and words of encouragement.

The project all started at the AT&T Foundry, a place where corporations, technologists, start-ups and content creators come together to incubate ideas and test concepts. With a mission to take the viewing experience to the next level, a three-way collaboration was created between The Melodic Caring Project (MCP), Quantum Interface and AT&T Foundry/Ericsson. Quantum Interface and MCP crafted a vision to live stream a concert in fully immersive 360 Video and, by drawing in other parties from their networks, were able to make that vision a reality. With the support of Ericsson and thanks in large part to AT&T Foundry’s network of partnerships and the leadership vision that pioneered this collaboration along with Amos Lee’s desire to get involved, that vision came to life in Austin’s famous Moody Theater.

On the night of the show, SubVRsive, which handled the end-to-end production and distribution of the stream, placed cameras in two spots on stage and streamed the entire concert straight to the VR headsets of the evening’s rockSTARS. As the kids watched the concert, they were able to stand on stage with Amos Lee and the band, look out into an audience full of supportive faces, and leave the sights and sounds of the hospital behind to truly feel present at the show. Saturday’s concert in Austin was the first Melodic Caring Project concert that used state-of-the-art VR technology to give kids an opportunity to virtually be on stage with Amos and his band.

“One of the rockSTARS watching the show in Austin was a girl named Maya,” said Evan Blackstone, VP of Melodic Caring. “Maya had previously taken to Amos after watching one of his concerts and afterward, Amos paid her a hospital visit in Seattle. On Saturday, Maya lay on her couch in her hospital room, yet was front row at the show getting the full live experience of hanging out with her buddy Amos. He spoke directly to her and the other rockSTARS throughout the night and, although he was miles away, they were all able to be right there at the show, no longer in the isolation of their hospital rooms.”

“It’s been said that virtual reality is the ultimate empathy machine because it allows users to not just look through a frame, but step into it,” said Austin Mace, CCO of SubVRsive. “Being able to let these kids step through the frame and be on stage with Amos was a really powerful thing and we’re grateful to have had the opportunity to leverage 360 live streaming for such a great cause.”

The final stage of this project will be to combine the video with a virtual interactive layer, which Quantum Interface will be contributing. In this way, the amazing 360 video will become an interactive experience, so the children will not only be able to be immersed in the concert, but interact with encouraging messages, the environment, and other virtual content using only gaze, completely hands-free. This is a significant and first in world experience that will bring the 360 experience to life even more.

“Music is a celebration of life. Musicians have such a unique, magical ability that deeply moves people. We live in a time and place that needs this energy more than ever. Especially the kids that Melodic Caring Project works closely with. Levi, Stephanie [Ware] and crew are world class. We look forward to supporting their process and helping them tell that story”.

– Amos Lee

Learn More

Check out AT&T’s featured article on the project. AT&T’s LinkedIn post. AT&T’s Tweet. AT&T’s Innovator Series post.

Check us out on the Ericsson Tech For Good Blog.

Read SubVRsive’s perspective on our project.

Read our partner Melodic Caring Project’s perspective on our project.

We are also receiving international coverage.

Check out one of our demos at the following locations: AT&T Foundry in Palo Alto, AT&T Foundry in Houston, Ericsson Experience Center in Santa Clara, Ericsson Experience Center in Plano, Ericsson Experience Center in Sweden, AT&T Forum in D.C., Quantum Interface in Austin, and Melodic Caring Project in Seattle.

AT&T Design Thinking Workshops
  • Client: AT&T Foundry Palo Alto, Ericsson, AT&T Technology Development, and AT&T’s Girls in Future Technologies (GIFT) Day
  • Team: Design Thinking Coaches and Design Thinkers
  • My Roles: Lead Design Thinking Coach
Overview

In 2015, I was hired to lead design at the AT&T Foundry Innovation Center, and in that role, led projects, trained team members, and even worked on an initiative to bring design thinking tens of thousands of AT&T employees.

Of my time at the Foundry, some of my proudest achievements aren’t my achievements at all. They’re the achievements the team members I trained and mentored.

I delivered design workshops and coached more junior designers to do the same, both inside and outside the company.

During my time at the Foundry, I was frequently consulted on how to apply design thinking to products, teams, processes, and business models.

Training and Coaching Designers

I trained my teammates in design thinking organically through collaborative projects and more formally through coaching and workshops. In turn, my colleagues are now applying design thinking to their work. As they pursued User Experience design and research projects, I supported and guided them as a coach and consultant.

With the confidence they gained through the training and coaching, some are now leading workshops of their own.

Design Thinking Workshops

Design Thinking Workshop at AT&T Girls in Future Technologies Day

In 2016, one of the teammates I had trained earlier in the year joined me in conducting interactive design thinking workshops for middle school and high school women interested in technology. Read more about our contribution here: AT&T hosts Girls in Future Technologies (GIFT) Day.

We continued that momentum and ran another workshop for the AT&T Technology Development team. Soon after, she began hosting her first workshops on her own.

Applying Design Thinking

With her new skills, one Foundry designer led a joint design thinking project for AT&T and Ericsson. I coached her as we developed a ten week plan to apply design methodology to AT&T’s Mobile and Voice team’s search for new business growth opportunities.

We began the project with market and user research to dive into the problem space and identify a key theme to explore further.

Then, we worked with an external design thinking consultancy to conduct a workshop for Ericsson and AT&T Mobile and Voice team members.

In the third phase of the project, we applied the design process to the business unit’s previously identified theme. The team began by empathizing with users and ended with prototyping and testing with users.

The insights and tested prototypes led to direct product roadmap changes for new use cases and features. In the long term, we infused leaders in the AT&T Mobile and Voice team with the tools and mindset to operate outside of their current structure and processes so they can be as agile as their competition.

The Impact

My design thinking training and coaching increased the amount of design occurring at the Foundry. Through training, we grew new Design Thinkers amongst our greater team. With coaching, we honed skills and amplified our ability to apply design thinking to more projects.

Our workshops were so successful that we were annually invited to train internal teams and GIFT students. There were so many requests that we began being more selective with our workshops so that we could focus on our design projects.

My design team repetitively identified and solved difficult problems in short periods of time. When one of my interns dug into the needs of Uverse and DirecTV technicians—research that lasted no more than three weeks—he uncovered so many high impact opportunities that the responsible Senior Vice President allocated millions of dollars to address these findings.

Hololens Augmented Reality Pre-Production Visualization Tool for Filmmakers
  • Client: Fox Studios
  • When: 2016
  • Team: Product Manager, User Experience Designer and Researcher, Technical Manager, 3 Augmented Reality Software Developers, Film Maker
  • My Role: Product Manager
Overview

While at the AT&T Foundry, I led an Augmented Reality project to create a pre-visualization tool for filmmakers, specifically camera crews and directors in collaboration with Quantum Interface, Economist Media Lab, and teammates at Ericsson Research. Together, our team conducted user research, designed, and implemented a complete voice and natural gesture controlled Hololens solution to a prevalent need for film crews within three days at the Fox Studios Hackathon in June 2016.

Background

In June 2016, we were invited by the Fox Innovation Lab to build an augmented reality concept to improve the entertainment production process using the Microsoft HoloLens. In response, we created Spike, a tool that helps filmmakers streamline their pre- and post-production processes by tagging sets with virtual camera marker “spikes” and visualizing adjustments to camera settings. This same concept can be applied to other virtual objects in other contexts as described in the presentation video below.

The Presentation

The Concept Video

Impact

As the first Foundry AR/VR project, this success demonstrated the value of this technology solving real use cases beyond the gaming industry. It has since sparked interest in looking deeper into Augmented and Virtual Reality with further explorations into other industries and spurred discussions across the company.

Learn More

Quantum Interface’s video of our proof of concept showcasing their innovative interface technology.

Legacy Network Machine Decommissioning Tool
  • Client: AT&T Network Capacity Engineers
  • When: 2016
  • Team: User Experience Designer and Researcher, 2 Data Scientists, and Front-End Engineer
  • My Role: Lead User Experience Designer and Researcher
Overview

Just like many other large, established companies, AT&T finds itself in an interesting situation of needing to deal with a world of dramatically increasing scale and complexity. For decades, experienced company veterans have been able to address these challenges manually with the knowledge, skills, and intuition they have built over a career in their roles.

However, we are now reaching a scale where this is no longer feasible, and we are facing a host of problems that cannot be manually addressed. By building intelligent systems, we bring radical efficiency changes to how AT&T operates. These are orders of magnitude improvements, where something that may have taken months manually, may now take only an hour.

Along with my user experience research and design skills, my team built one such intelligent system to manage this complexity for network capacity engineers as they decommission legacy machines on the network. Our tool was extremely well received by our colleagues in the field and is currently being used in decommissioning to save unnecessary hours of labor and costs.

Legacy Network Machine Decommissioning Tool UX Mockup on single screen
Legacy Network Machine Decommissioning Tool UX Mockup on three screens

The Opportunity

AT&T’s legacy telephone wire system is made of automated, interconnected switches on a nationwide scale and has been around for decades. Maintaining this vast network requires a significant amount of money spent towards power. Naturally, AT&T is interested in finding equipment that can be decommissioned or replaced with newer, more efficient equipment in an effort to reduce this large footprint, all with an active, live network that must remain fully reliable through this process.

Currently, decommissioning a machine requires weeks or months of tedious, manual planning by highly experienced and trained engineers, each with their own personalized workflow.

The Solution

We created an assistive tool for network capacity engineers to reduce this time to hours by recommending better alternatives to free them for their other responsibilities. Our tool helps discover and recommend plans for removing equipment from the network.

Our project focused on two primary objectives:

1. Evaluating network equipment to establish a priority order for decommissioning.
2. Creating and recommending a valid circuit reassignment plan for operators to take into consideration.

Design Process

While my colleagues were developing the machine learning aspects to this project, I conducted user interviews to better understand the needs of a network capacity engineer to inform our product decisions.

As themes in their workflows arose, I developed quick mockups to encapsulate the needs I was hearing.

Azorian_Mockup3
Azorian_Mockup1
Azorian_Mockup2

I continued to iterate on them as our understanding of the user needs evolved.

Hand drawn pen and paper mockup of AT&T Legacy Network Machine Decommissioning Tool

As we were on a short timeline, my colleague quickly began implementing a working web-interface prototype as per my designs to connect the command line into a more user-friendly experience. Within a few days, we had a fully functioning version of the tool that we could share with our users.

Through usability testing with network capacity engineers, we identified tens of changes to our working prototype and continued to iterate.

Today, this internal tool is used by network capacity engineers across the company and is radically changing the way AT&T works. This product was so successful in creating an efficiency disruption within the company that more work of this nature is being requested by internal teams. I found this highly impactful project extremely gratifying. With just a few months of applied work, we were able to disrupt an internal process to save costs and significantly change how the company and employees operate day to day.

AT&T Foundry Innovation Strategy
  • Client: AT&T Foundry Palo Alto
  • When: 2015-2017
  • Team: Team of Product Managers, Business Analysts, Data Scientists, Software Engineers, User Experience Designers and Researchers, Marketers
  • My Roles: Head of User Experience Design and Research, Business Development and Partnerships Lead, Business Innovation Strategist, Innovation Lead, and Product Manager
Overview

I joined the Ericsson team at the AT&T Foundry in Fall 2015, and my experience has been extremely diverse and fulfilling. My work spans a number of disciplines and industries as we work to create innovative solutions to challenging problems.

The AT&T Foundries are a network of six innovation centers across the world–Palo Alto, Atlanta, Houston, Plano (2), and Israel, each sponsored by a different company or internal organization. In Palo Alto, we are sponsored by Ericsson and jointly innovate with team members from both AT&T and Ericsson. As a member of the Ericsson team at the AT&T Foundry, I serve as a bridge between the two companies.

The Foundries were originally created several years ago as an open, collaborative environment to inspire and promote the rapid invention and innovation of strategic ideas from concept to commercialization. Foundry team members drive their own projects and champion them to stakeholders, much like entrepreneurs and intrapreneurs. Projects emerge from personal passions, business unit needs, external partnership opportunities, and our employee crowdsourcing platform.

As one of the top internal brands to AT&T, we are highly regarded internally as the reliable source of all types of innovation, with a special focus on efficiency and disruptive innovations.

AT&T Foundry Innovation Center Overview

Design Leadership

I was hired to lead design at the Foundry, and since then I’ve led numerous design projects, trained up team members, and worked on initiatives to bring design thinking to all of AT&T. I am frequently consulted on how to apply design to products, teams, processes, and business models. My work ranges from exploratory research to ideation to prototyping and implementation.

Projects

For instance, since 2016, I have collaborated with my teammate on the design portion of building a highly trafficked, enterprise product to provide a complete, seamless, self-service experience to incubate and validate any virtual network function against AT&T’s Domain 2.0 Architecture as part of the release of ECOMP (Enhanced Control, Orchestration, Management and Policy). Check out some press on this project and how we are in the process of open sourcing it in 2017:

Has AT&T ICE’ed VNF Onboarding?
AT&T ICEs Vendors of Virtual Network Functions

In 2015, I immersed myself with our key enterprise customers to understand their needs and expectations around our new Network on Demand product. My research uncovered key product strategies and features that our team was able to champion both companies.

In 2016, I led design for yet another engaging, enterprise design project, though for an internal tool this time. Our efficiency innovation reduced the time for network capacity engineers to plan out how to decommission legacy network machines from several weeks to hours.

Leadership

Over the years as the head of design at the Foundry, I have trained my teammates in design thinking through collaborative projects, coaching, mentorship, and workshops. In turn, my colleagues are now applying design thinking to their work and even leading training sessions of their own.

One such instance occurred in 2016 when my colleague and I conducted interactive design thinking workshops for middle school and high school women interested in technology. Read more about our contribution here: AT&T hosts Girls in Future Technologies (GIFT) Day

My design team has found success identifying and solving difficult problems they could never have imagined in short periods of time through my guidance. One team member dove into understanding the needs of Uverse and DirecTV installation and maintenance technicians for several weeks. His research uncovered so many high impact opportunities that when we presented our work to the Senior Vice President responsible for these teams, the SVP allocated millions of dollars in resources to addressing these findings immediately.

Business Strategy and Partnerships in Emerging Technologies

While at the Foundry, I have had the pleasure to engage with hundreds of startups working in emerging technologies. In early 2016, I became especially curious to learn more about augmented and virtual reality and identified it as a high potential path to new revenue streams.

With my market research, I educated, championed, and began the dialogue within AT&T to apply these emerging technologies to our business strategy. As concrete demonstrations of strategic AR/VR plays, I sought out and developed strong partnerships with leaders in the industry to create cutting-edge projects.

In one such project, my partners and I created an augmented reality, spatial tagging tool for camera teams and film production crews using the Hololens in collaboration with FOX Studios.

In another, my partners and I developed hands-free, interactive, virtual reality entertainment experiences for hospitalized children and tested immersive entertainment as a form of distraction therapy.

Marketing

Along with our numerous technology and design projects, marketing, partnerships, and thought leadership are similarly top of mind. I have contributed on visual design, information architecture, content strategy, startup partners, and developing marketing and brand collateral for several key initiatives, some of which are elaborated below.

Specifically, six times a year, we host the Futurecast Series, where we invite an honored guest to participate in a deconstructed panel where the curated audience is invited to participate in the conversation between the guest and moderator. Before the discussion, we also invite relevant startups to demo their latest and greatest to attendees. All our past and future events can be found on our website.

In 2016, we also began the Futurist Reports. In this series, we dig into technologies and trends while highlighting key insights that are reshaping entire industries and our world-at-large. Each report includes an industry-wide view from a diverse array of leading experts and features select startups at the forefront of technology. We delve into broader business implications of these technologies and explore indicators such as collaborations, investments, market demands, and technology advancements. Check out our latest reports on the Future of Drones and the Future of Entertainment.

Leeo Product Strategy
  • Client: Leeo
  • When: 2014
  • Team: Leeo C-level, Product Management, Marketing, IP, and Engineering teams, External Design Agency (Ammunition), External Web Development Agency (Noble Studios)
  • My Roles: Product Manager, Business Development and Partnerships Lead
Overview

In early 2014, I joined a small smart home startup called Leeo as a Product Manager leading our expansion into Enterprise Internet of Things (IOT). As the rest of our team worked on building and launching our first product, the Leeo Smart Alert Nightlight, a consumer, plug-and-play remote Smoke and Carbon Monoxide alarm monitor, I worked as a team with our co-founders to translate our company vision into our product suite, business, IP, and partnership strategy. In addition, I product managed our launch website, where I led the feature definition, information architecture, user experience design, content strategy, and vendor development and design partners.

My time at Leeo was a huge personal growth experience. Before Leeo, I had primarily worked as an Engineer and Designer. However, at Leeo, I played significant roles in Business Development, Partnerships, New Product Exploration, Product Marketing, and Strategy. I joined looking to work on high-level problems and expand my skills and experience. I am fortunate to say that got exactly that, beyond what I had even imagined.

Leeo Launch Website on a tablet

Research, Partnerships, and Strategy

As the sole employee out of our small team of twenty responsible for expanding from consumer to enterprise, I set the path for how to approach our growth. I began with a market survey of enterprise IOT and discussing our company vision with the Founders. Once I had a solid foundation of our goals, the market landscape in several enterprise IOT industries, and our existing partnership base, I selected a few high potential industries and dove into qualitative user research.

I interviewed 100+ individuals in the course of a few months to learn about various industries, different roles, and what their needs were in the IOT space. With our executive team’s wide-ranging contacts in Real Estate, we especially dove into all forms of that industry from Hospitality to Multifamily Residential Housing. This research spurred countless conversations with our leadership to determine company strategy for the coming months and years, resulting in numerous patents (see below).

What started as exploratory user research transformed into so much more as well. We began to form strong partnerships with individuals and companies who wanted not only to help us with our research but also to collaborate on projects with and even invest in us. For instance, after our meeting with one utility company about product collaborations, they invested and joined our board. Thus began my first experience leading Business Development and Partner Relationship Management, reporting directly to the Founding team.

Leadership

As the value of my work shined, I was soon able to grow my team. I hired and managed a colleague, and together we accomplished deeper market landscape analysis and research. Our work served instrumental in securing investors down the line when asked for our due diligence.

As the only team member who had ever shipped a consumer electronic product before, I was also often tapped to give advice on hardware product design. It was an honor to leverage my strong hardware engineering experience to be a resource to the team as they navigated contract manufacturers in Asia and industrial designers in San Francisco.

Product and Marketing

Three months before we publically launched our first product, we were in need of a Web Product Manager who could reliably deliver in a short period of time. I took this opportunity to step up to product manage our launch website.

I led our teams through the feature definition, information architecture, user experience design, content strategy, and vendor development and design partners to ensure that we had a fully functional, responsive, product launch marketing page, e-commerce store, blog, support forum, and community forum to showcase our company and product in time for our mid October launch date.

This was yet another new growth opportunity for me. So far at Leeo, I had already had a significant impact in my roles in Business Development, Partnerships, and New Product Exploration. Now, I was offered another chance to play a leading role, this time in Software Product Management and Marketing, and I owned it. Our entire launch was seamless and it was rewarding to see how my work directly led to sales.

Leeo Launch Website Desktop view on a Monitor

Patents

WO 2016040378 A3: Environmental monitoring devices and methods
US 20160071196 A1: Systems and methods for transferring data and revenue
US 20160072891 A1: Sensor-data sub-contracting during environmental monitoring
WO 2016007680 A1: Fault diagnosis based on connection monitoring
US 20160071219 A1: Dynamic insurance based on environmental monitoring
US 20160070614 A1: Identifying fault conditions in combinations of components
US 20160071184 A1: Service-improvements based on input-output analysis
US 20160071183 A1: Environmental monitoring device with event-driven service
US 20160071148 A1: Alert-driven dynamic sensor-data sub-contracting
US 20160070276 A1: Ecosystem with dynamically aggregated combinations of components
US 20160070920 A1: Constrained environmental monitoring based on data privileges

WO 2016032465 A1: Intuitive thermal user interface
US 9092060 B1: Intuitive thermal user interface
US 9304590 B2: Intuitive thermal user interface

WO 2016018269 A1: Electronic device having a programmed electrical characteristic
US 20160034010 A1: Electronic device having a programmed electrical characteristic

US 8967855 B1: Electronic device for determining external temperature
WO 2016028295 A1: Electronic device for determining external temperature

WO 2016032457 A1: Fluid-flow monitor
US 20160061640 A1: Fluid-flow monitor
US 20170038233 A1: Fluid-flow monitor

US 9213327 B1: Selective electrical coupling based on environmental conditions
US 9372477 B2: Selective electrical coupling based on environmental conditions
US 20150268205 A1: Selective electrical coupling based on environmental conditions
US 9170625 B1: Selective electrical coupling based on environmental conditions
WO 2016010529 A1: Selective electrical coupling based on environmental conditions
US 9116137 B1: Selective electrical coupling based on environmental conditions
US 20160018799 A1: Selective electrical coupling based on environmental conditions

Barnes & Noble Nook Media Tablets
  • Client: Barnes & Noble Nook Media
  • When: 2011-2014
  • Team: 3 Mechanical Product Design Engineers, Electrical Engineer, and external Contract Manufacturing team
  • My Role: Product Design Engineer
Overview

I joined Barnes and Noble’s Nook Media team in Fall 2011. Though the company headquarters are in New York, Nook headquarters were in Palo Alto. Nook functioned much like a startup within the larger company, where we had the advantages of agility and resources.

Products

During my two and a half years at BN, I worked on the design of about ten tablets and accessories. Some were products I joined during the later stages of the development process and most were early concepts that we took through various stages of the development cycle.

Nook HD+ (shipped)
Nook HD (shipped)

Barnes & Noble Nook Media Tablets: Nook HD+ and Nook HD

Product Design

As a Nook Product Designer, I was offered the opportunity to dive even deeper into Hardware Product Design through the mentorship of my team. Over the years, I worked on almost every subsystem in a tablet, including custom batteries, cosmetic housing and structural parts, displays and touch screens, audio systems, antennae, buttons, connectors, PCB and flexes, media and camera systems, and high-level system architecture.

In teams of three, we not only designed the overall system architecture and the detailed mechanical part design, but we also collaborated with internal Engineering, Marketing, and Operation teams and external ODMs, consultants, partners, vendors, and suppliers.

Design Strategy and Research

During my final months at BN, our team did a massive re-evaluation of our roadmap. We worked side by side with multiple design consultancies to brainstorm and strategize what direction we ought to take our products. Over the course of a few months, we used our user previous research data to settle on some unique experiences that would be enabled by innovative product form factors and materials. It was very exciting to push the bounds of what we think of as a typical reader and to not only make one unique experience but to also design a whole family of products that interplayed with each other.

Patents

While at BN, we invented a number of unique assembly techniques for consumer electronic device product design.

US 20140201997 A1: Method for split wire routing in a cavity for a device
US 20140204547 A1: Apparatus for split wire routing in a bracket for a device
US 20140201996 A1: Techniques for split wire routing for a bracket in a device

US 20140026411 A1: Techniques for efficient wire routing in a device
US 20140027166 A1: Techniques for efficient wire routing in electronic devices
US 20140029218 A1: Apparatus for efficient wire routing in a device

HP Palm Smartphones
  • Client: Hewlett Packard Palm
  • When: 2010-2011
  • Team: 4 Mechanical Product Design Engineers, Electrical Engineer, and external Contract Manufacturing team
  • My Role: Product Design Engineer
Overview

Hewlett Packard acquired Palm soon after I joined in the summer of 2010. During my time at HP Palm, I was a member of the team that shipped the Palm Pre 2 and Palm Pre 3 phones. I learned and experienced a lot in my first year out of Stanford!

Products

During my year and a half at Palm, I worked on the design of about ten smartphones. Some were products I jumped onto during the later stages of the development process and most were early concepts that we took through various stages of the development cycle.

Palm Pre 2 (shipped)
Palm Pre 3 (shipped)
Windsor Not (never released)

HP Palm Smartphones: Palm Pre 2 and Palm Pre 3

Product Design

As a HP Palm Product Designer, I put my Product Design and Mechatronics degrees to good use. With teams of three to four Product Designers, we designed and developed entire smartphones from concept to shipping. Along with designing the overall system architecture and the detailed mechanical part design, I coordinated with and negotiated between various internal Palm Engineering, Marketing, and Industrial Design teams and external ODMs, vendors, and suppliers. During the product development process, I regularly analyzed and developed solutions for reliability and manufacturing failures.

Design Strategy and Research

While working on product development, I explored and prototyped concepts for future devices and physical interactions and experiences. I used market research and competitive analysis to inform my initial design directions. For instance, I primarily focused on what a dual screen experience might be as well as what a biometric (fingerprint sensor) experience could look like.

During this research, I realized that there was a huge need in the market for a candy-bar smartphone with a streamlined OS and what better system than webOS. In our downtime, my colleague and I began designing the concept for a new keyboardless phone. We pitched it to our team lead, manager, and within weeks our grassroots design gained traction from all over the company. Soon, our design was not only a product on the roadmap, but also the flagship product that had drummed up support, excitement, and hope from throughout the organization. We proceeded to develop our design through nearly the final stages of development. Though our product was canceled, I am extremely proud to have been a part of that experience.

SFCU Video Contest Winner
  • Client: Stanford Federal Credit Union (SFCU)
  • When: 2009
  • Team: 2 Filmmakers
  • My Role: Filmmaker
The Challenge

Create a 60-second video to creatively answer the question: “If every penny counts, tell us how.”

We Won!

SFCU_Winners

Within three days my partner and I wrote, filmed, edited, and submitted A Life Changing Penny! We were living in Beijing at the time, and faced the additional fun challenge of filming in a foreign country with limited resources. We had a blast pulling together this stop motion video, and were fortunate enough to win 1st Place in the competition!

Microsoft Research Asia Enterprise Social Networking Platform
  • Client: Microsoft Research Asia
  • When: 2009
  • Team: Research team of 2 Psychologists and 2 User Experience Designers and Researchers
  • My Role: User Experience Designer and Researcher
Overview

In the Summer of 2009, I moved to Beijing, China to work for Microsoft Research Asia (MSRA) as a User Experience Design Researcher. I worked on a team of two Psychologists and two User Experience Designers/Researchers.

My time at MSRA was divided into two primary projects: Cross-Cultural Design Research and designing an Enterprise Social Networking Platform.

Cross-Cultural Design Research

With our design research, we strove to understand how to design better digital experiences for a Chinese audience. Using qualitative and quantitative research methodologies and usability studies, we honed in on elements that resonated with our target audience. Specifically, we conducted market research and competitive analysis, surveys, interviews, A/B testing, card sorting, walkthroughs, task analysis, facilitated brainstorming, and participatory design.

We conducted much of our research with our Enterprise Social Networking Platform, the Twinkle Project, which in turn informed our design choices and directed our next iterations.

Enterprise Social Networking Platform

Social networks are a fantastic way to generate and share knowledge among large groups of people. Social software has the potential to build and maintain strong communication and collaboration channels. Yet, why do enterprise social software solutions still leave something to be desired?

There is a huge opportunity to apply social software within the Enterprise. The Twinkle Project explores exactly that. Could we redesign and reinvigorate Social Enterprise Software? How can we enable users to connect, collaborate, share content, knowledge, and expertise, manage information, and increase productivity across an enterprise?

As a designer for Twinkle, I was responsible for design research and strategy and UX and UI design.

A blurb about our work on Twinkle was featured in the 10 Year Anniversary MSRA Book (pg. 28).