Immersive Entertainment for Hospitalized Kids
  • Client: AT&T Foundry Palo Alto
  • When: 2017
  • Team: Product Manager, Virtual Reality Development Engineering team (Quantum Interface), and Non-profit with connections to musician and hospital (Melodic Caring Project)
  • My Role: Product Manager
Overview

As an Innovation Lead at the AT&T Foundry, I work on applying emerging technologies to make the world a better place. In 2017, I led a technology for good project to create immersive entertainment experiences for children in hospitals as a form of distraction therapy, through collaboration with Quantum Interface (technology startup) and the Melodic Caring Project (nonprofit).

AT&T is transforming into both an Entertainment and Telecommunications company. Projects such as this highlight the need for a strong 5G use case where there is a need for high throughput and bandwidth to support a quality experience for users. By applying emerging technologies to real-life problems, we are able to solve business needs, uncover new markets, and help change lives.

Immersive Entertainment for Hospitalized Kids: Amos Lee Concert in Virtual Reality on Google Daydream VR Goggles UX Mockup

Immersive Entertainment for Hospitalized Kids Poster

Background

In 2016, I initiated and spearheaded our exploration of the Augmented and Virtual Reality market to propose strategic business plays for AT&T and Ericsson. As I engaged with our ecosystem, I discovered two amazing companies, each experts in their own field — one a technology company specializing in virtual reality and custom interfaces (Quantum Interface) and the other a nonprofit that streams concerts to children in hospitals (Melodic Caring Project).

It occurred to me that if I connected Quantum Interface’s next generation, interactive interface for 3D experiences together with a 360 virtual reality video of Melodic Caring Project’s live streaming of personalized concerts to hospitalized kids, we could create something truly memorable. So, we did just that.

Live Streaming

After introducing everyone, the project took off immediately! Quantum Interface brought in SubVRsive to make the Virtual Reality capture a reality, and Melodic Caring Project brought in singer-songwriter Amos Lee and team as the content creators at the core of this experience. Together, the team used the magic of 360 live streaming to transport hospitalized children to an Amos Lee concert experience that they could share with their loved ones as they received encouragement from near and far!

Our partners were pivotal in making our live stream a success. Fresh off this achievement, we quickly moved onto the next step — building an interactive, immersive experience.

“Watching the concert as a VR show completely swept Maya away. She was feeling badly from recent chemo and having the glasses and the 360 experience took her away from the yuck that she had been feeling.”

– Maya’s father (Maya is in the photo below)

VR Virtual Reality 360 Video Amos Lee Concert Experience for Maya

Hands-free, Interactive Experience

After the live stream, our team created a post-produced 360 experience with an interactive layer on top of this recorded concert. Children are not only able to be immersed in the concert, but also can interact with the environment and control playback using only small head movements, all completely hands-free! This is huge for patients who may not just be confined to their care facilities, but may also be bedridden or tethered to medical equipment with limited mobility.

We have been fortunate enough to share our interactive experience with countless viewers both inside and outside of hospitals, and the response has been overwhelmingly positive.

Instructions for Immersive Entertainment for Hospitalized Kids
AT&T Shape Conference attendees enjoying the Immersive Entertainment for Hospitalized Kids

Quantifying the Impact

We started by collecting anecdotal evidence that we are helping patients escape from the discomfort of their hospital rooms. Now, we are quantifying the impact our immersive entertainment experience is providing as distraction therapy through clinical trials.

With the use of quantifiable biometric sensors and qualitative surveys, we are able to correlate the two to assess how effective this experience is as distraction therapy and what factors are necessary to build an effective distraction therapy experience.

Streaming a Catalog of Content

As we widen our audience reach, we are also expanding the catalog of content accessible within our video player. Using AWS, we are building a repository of content pieces that a user can draw upon. Patients are able to navigate hands-free through a library of options to suit their needs, whether it be a desire for an outdoor adventure to a relaxing meditation by the fire.

Amos Lee Concert being recorded backstage in 360 degrees for Immersive Entertainment for Hospitalized Kids
Amos Lee on stage during the concert for Immersive Entertainment for Hospitalized Kids

Press Release

Austin – March 7, 2017 – Philadelphia-based singer-songwriter Amos Lee played a sold-out concert at the world-renowned Austin City Limits Moody Theater on Saturday, February 25, 2017. This time, Amos’ sold-out show didn’t just reach the crowds of the Moody Theater. With the support of partners including Quantum Interface, SubVRsive and the Ericsson team at the AT&T Foundry, the Melodic Caring Project, a nonprofit that bridges the gap between music, technology, and patients battling serious illness by live streaming personalized concerts to kids and teens in the hospital, live streamed its first-ever multi-camera, virtual reality 360 video show directly to kids’ hospital/home care rooms.

Since Melodic Caring Project’s founders, Levi and Stephanie Ware, began this journey seven years ago, the nonprofit has broadcast approximately 400 concerts to nearly 5,000 children all over the world and has partnered with some of the world’s biggest artists, including The Black Eyed Peas, Jason Mraz, Andra Day, Alabama Shakes, Rachel Platten, Daughtry and The Head and the Heart. The nonprofit gives the performing artists a list of kids (aka rockSTARS) who will be watching the night of their show. Then, during the shows, the artists call each rockSTAR out by name, offering support and words of encouragement.

The project all started at the AT&T Foundry, a place where corporations, technologists, start-ups and content creators come together to incubate ideas and test concepts. With a mission to take the viewing experience to the next level, a three-way collaboration was created between The Melodic Caring Project (MCP), Quantum Interface and AT&T Foundry/Ericsson. Quantum Interface and MCP crafted a vision to live stream a concert in fully immersive 360 Video and, by drawing in other parties from their networks, were able to make that vision a reality. With the support of Ericsson and thanks in large part to AT&T Foundry’s network of partnerships and the leadership vision that pioneered this collaboration along with Amos Lee’s desire to get involved, that vision came to life in Austin’s famous Moody Theater.

On the night of the show, SubVRsive, which handled the end-to-end production and distribution of the stream, placed cameras in two spots on stage and streamed the entire concert straight to the VR headsets of the evening’s rockSTARS. As the kids watched the concert, they were able to stand on stage with Amos Lee and the band, look out into an audience full of supportive faces, and leave the sights and sounds of the hospital behind to truly feel present at the show. Saturday’s concert in Austin was the first Melodic Caring Project concert that used state-of-the-art VR technology to give kids an opportunity to virtually be on stage with Amos and his band.

“One of the rockSTARS watching the show in Austin was a girl named Maya,” said Evan Blackstone, VP of Melodic Caring. “Maya had previously taken to Amos after watching one of his concerts and afterward, Amos paid her a hospital visit in Seattle. On Saturday, Maya lay on her couch in her hospital room, yet was front row at the show getting the full live experience of hanging out with her buddy Amos. He spoke directly to her and the other rockSTARS throughout the night and, although he was miles away, they were all able to be right there at the show, no longer in the isolation of their hospital rooms.”

“It’s been said that virtual reality is the ultimate empathy machine because it allows users to not just look through a frame, but step into it,” said Austin Mace, CCO of SubVRsive. “Being able to let these kids step through the frame and be on stage with Amos was a really powerful thing and we’re grateful to have had the opportunity to leverage 360 live streaming for such a great cause.”

The final stage of this project will be to combine the video with a virtual interactive layer, which Quantum Interface will be contributing. In this way, the amazing 360 video will become an interactive experience, so the children will not only be able to be immersed in the concert, but interact with encouraging messages, the environment, and other virtual content using only gaze, completely hands-free. This is a significant and first in world experience that will bring the 360 experience to life even more.

“Music is a celebration of life. Musicians have such a unique, magical ability that deeply moves people. We live in a time and place that needs this energy more than ever. Especially the kids that Melodic Caring Project works closely with. Levi, Stephanie [Ware] and crew are world class. We look forward to supporting their process and helping them tell that story”.

– Amos Lee

Learn More

Check out AT&T’s featured article on the project. AT&T’s LinkedIn post. AT&T’s Tweet. AT&T’s Innovator Series post.

Check us out on the Ericsson Tech For Good Blog.

Read SubVRsive’s perspective on our project.

Read our partner Melodic Caring Project’s perspective on our project.

We are also receiving international coverage.

Check out one of our demos at the following locations: AT&T Foundry in Palo Alto, AT&T Foundry in Houston, Ericsson Experience Center in Santa Clara, Ericsson Experience Center in Plano, Ericsson Experience Center in Sweden, AT&T Forum in D.C., Quantum Interface in Austin, and Melodic Caring Project in Seattle.

AT&T Design Thinking Workshops
  • Client: AT&T Foundry Palo Alto, Ericsson, AT&T Technology Development, and AT&T’s Girls in Future Technologies (GIFT) Day
  • Team: Design Thinking Coaches and Design Thinkers
  • My Roles: Lead Design Thinking Coach
Overview

In 2015, I was hired to lead design at the AT&T Foundry Innovation Center, and in that role, led projects, trained team members, and even worked on an initiative to bring design thinking tens of thousands of AT&T employees.

Of my time at the Foundry, some of my proudest achievements aren’t my achievements at all. They’re the achievements the team members I trained and mentored.

I delivered design workshops and coached more junior designers to do the same, both inside and outside the company.

During my time at the Foundry, I was frequently consulted on how to apply design thinking to products, teams, processes, and business models.

Training and Coaching Designers

I trained my teammates in design thinking organically through collaborative projects and more formally through coaching and workshops. In turn, my colleagues are now applying design thinking to their work. As they pursued User Experience design and research projects, I supported and guided them as a coach and consultant.

With the confidence they gained through the training and coaching, some are now leading workshops of their own.

Design Thinking Workshops

Design Thinking Workshop at AT&T Girls in Future Technologies Day

In 2016, one of the teammates I had trained earlier in the year joined me in conducting interactive design thinking workshops for middle school and high school women interested in technology. Read more about our contribution here: AT&T hosts Girls in Future Technologies (GIFT) Day.

We continued that momentum and ran another workshop for the AT&T Technology Development team. Soon after, she began hosting her first workshops on her own.

Applying Design Thinking

With her new skills, one Foundry designer led a joint design thinking project for AT&T and Ericsson. I coached her as we developed a ten week plan to apply design methodology to AT&T’s Mobile and Voice team’s search for new business growth opportunities.

We began the project with market and user research to dive into the problem space and identify a key theme to explore further.

Then, we worked with an external design thinking consultancy to conduct a workshop for Ericsson and AT&T Mobile and Voice team members.

In the third phase of the project, we applied the design process to the business unit’s previously identified theme. The team began by empathizing with users and ended with prototyping and testing with users.

The insights and tested prototypes led to direct product roadmap changes for new use cases and features. In the long term, we infused leaders in the AT&T Mobile and Voice team with the tools and mindset to operate outside of their current structure and processes so they can be as agile as their competition.

The Impact

My design thinking training and coaching increased the amount of design occurring at the Foundry. Through training, we grew new Design Thinkers amongst our greater team. With coaching, we honed skills and amplified our ability to apply design thinking to more projects.

Our workshops were so successful that we were annually invited to train internal teams and GIFT students. There were so many requests that we began being more selective with our workshops so that we could focus on our design projects.

My design team repetitively identified and solved difficult problems in short periods of time. When one of my interns dug into the needs of Uverse and DirecTV technicians—research that lasted no more than three weeks—he uncovered so many high impact opportunities that the responsible Senior Vice President allocated millions of dollars to address these findings.

Hololens Augmented Reality Pre-Production Visualization Tool for Filmmakers
  • Client: Fox Studios
  • When: 2016
  • Team: Product Manager, User Experience Designer and Researcher, Technical Manager, 3 Augmented Reality Software Developers, Film Maker
  • My Role: Product Manager
Overview

While at the AT&T Foundry, I led an Augmented Reality project to create a pre-visualization tool for filmmakers, specifically camera crews and directors in collaboration with Quantum Interface, Economist Media Lab, and teammates at Ericsson Research. Together, our team conducted user research, designed, and implemented a complete voice and natural gesture controlled Hololens solution to a prevalent need for film crews within three days at the Fox Studios Hackathon in June 2016.

Background

In June 2016, we were invited by the Fox Innovation Lab to build an augmented reality concept to improve the entertainment production process using the Microsoft HoloLens. In response, we created Spike, a tool that helps filmmakers streamline their pre- and post-production processes by tagging sets with virtual camera marker “spikes” and visualizing adjustments to camera settings. This same concept can be applied to other virtual objects in other contexts as described in the presentation video below.

The Presentation

The Concept Video

Impact

As the first Foundry AR/VR project, this success demonstrated the value of this technology solving real use cases beyond the gaming industry. It has since sparked interest in looking deeper into Augmented and Virtual Reality with further explorations into other industries and spurred discussions across the company.

Learn More

Quantum Interface’s video of our proof of concept showcasing their innovative interface technology.

Legacy Network Machine Decommissioning Tool
  • Client: AT&T Network Capacity Engineers
  • When: 2016
  • Team: User Experience Designer and Researcher, 2 Data Scientists, and Front-End Engineer
  • My Role: Lead User Experience Designer and Researcher
Overview

Just like many other large, established companies, AT&T finds itself in an interesting situation of needing to deal with a world of dramatically increasing scale and complexity. For decades, experienced company veterans have been able to address these challenges manually with the knowledge, skills, and intuition they have built over a career in their roles.

However, we are now reaching a scale where this is no longer feasible, and we are facing a host of problems that cannot be manually addressed. By building intelligent systems, we bring radical efficiency changes to how AT&T operates. These are orders of magnitude improvements, where something that may have taken months manually, may now take only an hour.

Along with my user experience research and design skills, my team built one such intelligent system to manage this complexity for network capacity engineers as they decommission legacy machines on the network. Our tool was extremely well received by our colleagues in the field and is currently being used in decommissioning to save unnecessary hours of labor and costs.

Legacy Network Machine Decommissioning Tool UX Mockup on single screen
Legacy Network Machine Decommissioning Tool UX Mockup on three screens

The Opportunity

AT&T’s legacy telephone wire system is made of automated, interconnected switches on a nationwide scale and has been around for decades. Maintaining this vast network requires a significant amount of money spent towards power. Naturally, AT&T is interested in finding equipment that can be decommissioned or replaced with newer, more efficient equipment in an effort to reduce this large footprint, all with an active, live network that must remain fully reliable through this process.

Currently, decommissioning a machine requires weeks or months of tedious, manual planning by highly experienced and trained engineers, each with their own personalized workflow.

The Solution

We created an assistive tool for network capacity engineers to reduce this time to hours by recommending better alternatives to free them for their other responsibilities. Our tool helps discover and recommend plans for removing equipment from the network.

Our project focused on two primary objectives:

1. Evaluating network equipment to establish a priority order for decommissioning.
2. Creating and recommending a valid circuit reassignment plan for operators to take into consideration.

Design Process

While my colleagues were developing the machine learning aspects to this project, I conducted user interviews to better understand the needs of a network capacity engineer to inform our product decisions.

As themes in their workflows arose, I developed quick mockups to encapsulate the needs I was hearing.

Azorian_Mockup3
Azorian_Mockup1
Azorian_Mockup2

I continued to iterate on them as our understanding of the user needs evolved.

Hand drawn pen and paper mockup of AT&T Legacy Network Machine Decommissioning Tool

As we were on a short timeline, my colleague quickly began implementing a working web-interface prototype as per my designs to connect the command line into a more user-friendly experience. Within a few days, we had a fully functioning version of the tool that we could share with our users.

Through usability testing with network capacity engineers, we identified tens of changes to our working prototype and continued to iterate.

Today, this internal tool is used by network capacity engineers across the company and is radically changing the way AT&T works. This product was so successful in creating an efficiency disruption within the company that more work of this nature is being requested by internal teams. I found this highly impactful project extremely gratifying. With just a few months of applied work, we were able to disrupt an internal process to save costs and significantly change how the company and employees operate day to day.

Re-branding the Futurecast Series
  • Client: AT&T Foundry Palo Alto
  • When: 2015
  • Team: Lead UX Designer, External Visual Design Consultancy
  • My Roles: Lead User Experience Designer
Overview

The Futurecast Series is a thought leadership series by AT&T Foundry and Ericsson. With a deconstructed panel format, Futurecast brings together leaders in technology, government, business and beyond (like Sebastian Thrun, Gavin Newsom, and Steve Case) to engage in vibrant discussions with an intimate, curated audience.

Since its inception in 2013, the series has been growing year over year. However, the branding and processes had not grown in turn. I noticed a unique opportunity to create a unified face for our growing event.

When I joined the AT&T Foundry in 2015, I led the charter to refresh our branded collateral, operational processes, and growth strategies for the Futurecast Series.

“Futurecast is a gathering of thought leaders designed to vet, debate and ultimately spark ideas that will set the course for our collective technology future. We invite the best and brightest around a particular topic to participate in a curated, intimate discussion with fellow experts in the field. It is a fantastic opportunity to move conversations forward, challenge orthodoxy, and generally define the future.”


Futurecast new digital poster after rebranding UX mockup in TV

The Opportunity

Our brand was all over the place. There were inconsistencies throughout the material.

And if the off-brand visuals were not enough, it was also not easy to engage with our end users and our processes were not streamlined to easily create collateral for future events.

We had a successful event with engaged followers, but we were not set up to scale well as we continued along our upward trajectory.

Futurecast old digital poster before rebranding

The Approach: Collateral

I started us off with an overhaul of the branded collateral, operational processes, and growth strategies.

For the collateral, I brought in an external visual design consultancy. I laid out our requirements, expected deliverables, and goals (low-resolution mockups) and kicked them off.

Soon after, we had new social media images, video screens, digital posters, and email templates.

In the meantime, I dove into updating the website. I updated the information architecture to encourage users to engage with past content and clearly see upcoming events.


Futurecast new website proposal after rebranding UX Mockup

The Approach: Processes

With the website as a key touchpoint for our users, I wanted to improve our internal processes for keeping information as updated as possible. I developed easy to use standards in the form of templates to streamline the process of creating archives for past events.

Before each event, we host startup technology demonstrations. I created a website funnel for demo requests to offer an open door for interested companies to approach us.

The Approach: Strategies

To harness our user engagement and amplify it, we began live streaming our events via Periscope and Facebook to open up the events to a wider audience, while maintaining the intimate, curated atmosphere that makes Futurecast so special.

We added in analytics and tracking to better understand our user behavior.

I also shifted our hashtag use from a unique hashtag for each event to a single #futurecastseries for all our events.

The Impact

We launched the new branding at CES in January 2016 and have been using it successfully every since. Even as the event has been handed over from teammate to teammate, my improved collateral, processes, and strategies have persisted, freeing up valuable time for teammates to start other projects, like the Futurist Reports.

AT&T Foundry Innovation Strategy
  • Client: AT&T Foundry Palo Alto
  • When: 2015-2017
  • Team: Team of Product Managers, Business Analysts, Data Scientists, Software Engineers, User Experience Designers and Researchers, Marketers
  • My Roles: Head of User Experience Design and Research, Business Development and Partnerships Lead, Business Innovation Strategist, Innovation Lead, and Product Manager
Overview

I joined the Ericsson team at the AT&T Foundry in Fall 2015, and my experience has been extremely diverse and fulfilling. My work spans a number of disciplines and industries as we work to create innovative solutions to challenging problems.

The AT&T Foundries are a network of six innovation centers across the world–Palo Alto, Atlanta, Houston, Plano (2), and Israel, each sponsored by a different company or internal organization. In Palo Alto, we are sponsored by Ericsson and jointly innovate with team members from both AT&T and Ericsson. As a member of the Ericsson team at the AT&T Foundry, I serve as a bridge between the two companies.

The Foundries were originally created several years ago as an open, collaborative environment to inspire and promote the rapid invention and innovation of strategic ideas from concept to commercialization. Foundry team members drive their own projects and champion them to stakeholders, much like entrepreneurs and intrapreneurs. Projects emerge from personal passions, business unit needs, external partnership opportunities, and our employee crowdsourcing platform.

As one of the top internal brands to AT&T, we are highly regarded internally as the reliable source of all types of innovation, with a special focus on efficiency and disruptive innovations.

AT&T Foundry Innovation Center Overview

Design Leadership

I was hired to lead design at the Foundry, and since then I’ve led numerous design projects, trained up team members, and worked on initiatives to bring design thinking to all of AT&T. I am frequently consulted on how to apply design to products, teams, processes, and business models. My work ranges from exploratory research to ideation to prototyping and implementation.

Projects

For instance, since 2016, I have collaborated with my teammate on the design portion of building a highly trafficked, enterprise product to provide a complete, seamless, self-service experience to incubate and validate any virtual network function against AT&T’s Domain 2.0 Architecture as part of the release of ECOMP (Enhanced Control, Orchestration, Management and Policy). Check out some press on this project and how we are in the process of open sourcing it in 2017:

Has AT&T ICE’ed VNF Onboarding?
AT&T ICEs Vendors of Virtual Network Functions

In 2015, I immersed myself with our key enterprise customers to understand their needs and expectations around our new Network on Demand product. My research uncovered key product strategies and features that our team was able to champion both companies.

In 2016, I led design for yet another engaging, enterprise design project, though for an internal tool this time. Our efficiency innovation reduced the time for network capacity engineers to plan out how to decommission legacy network machines from several weeks to hours.

Leadership

Over the years as the head of design at the Foundry, I have trained my teammates in design thinking through collaborative projects, coaching, mentorship, and workshops. In turn, my colleagues are now applying design thinking to their work and even leading training sessions of their own.

One such instance occurred in 2016 when my colleague and I conducted interactive design thinking workshops for middle school and high school women interested in technology. Read more about our contribution here: AT&T hosts Girls in Future Technologies (GIFT) Day

My design team has found success identifying and solving difficult problems they could never have imagined in short periods of time through my guidance. One team member dove into understanding the needs of Uverse and DirecTV installation and maintenance technicians for several weeks. His research uncovered so many high impact opportunities that when we presented our work to the Senior Vice President responsible for these teams, the SVP allocated millions of dollars in resources to addressing these findings immediately.

Business Strategy and Partnerships in Emerging Technologies

While at the Foundry, I have had the pleasure to engage with hundreds of startups working in emerging technologies. In early 2016, I became especially curious to learn more about augmented and virtual reality and identified it as a high potential path to new revenue streams.

With my market research, I educated, championed, and began the dialogue within AT&T to apply these emerging technologies to our business strategy. As concrete demonstrations of strategic AR/VR plays, I sought out and developed strong partnerships with leaders in the industry to create cutting-edge projects.

In one such project, my partners and I created an augmented reality, spatial tagging tool for camera teams and film production crews using the Hololens in collaboration with FOX Studios.

In another, my partners and I developed hands-free, interactive, virtual reality entertainment experiences for hospitalized children and tested immersive entertainment as a form of distraction therapy.

Marketing

Along with our numerous technology and design projects, marketing, partnerships, and thought leadership are similarly top of mind. I have contributed on visual design, information architecture, content strategy, startup partners, and developing marketing and brand collateral for several key initiatives, some of which are elaborated below.

Specifically, six times a year, we host the Futurecast Series, where we invite an honored guest to participate in a deconstructed panel where the curated audience is invited to participate in the conversation between the guest and moderator. Before the discussion, we also invite relevant startups to demo their latest and greatest to attendees. All our past and future events can be found on our website.

In 2016, we also began the Futurist Reports. In this series, we dig into technologies and trends while highlighting key insights that are reshaping entire industries and our world-at-large. Each report includes an industry-wide view from a diverse array of leading experts and features select startups at the forefront of technology. We delve into broader business implications of these technologies and explore indicators such as collaborations, investments, market demands, and technology advancements. Check out our latest reports on the Future of Drones and the Future of Entertainment.

Esper Product and Design Strategy Consulting
  • Client: Esper
  • When: 2015-2017
  • Team: 6 team members responsible for Product, Engineering, Business, Operations, and Design
  • My Roles: Product Manager, Lead Product Designer, Lead User Experience Researcher
Overview

Summer of 2015, I joined Esper, a small startup working on improving time management and productivity, as a consulting Product and Design Strategist. In collaboration with the founders, I guided the company through several key strategic pivots, including shifting us from providing services to focusing on building great products. I also led the team’s Product Design by conducting user research interviews and creating interaction flows, wireframes, and mockups. The journey of working in a small, roughly six person startup environment, where my voice has a significant impact on our direction, has been extremely fun and fulfilling.


Esper Charts Time Management and Strategizing Tool Demo Account View in Browser Mockup

Product and Design Strategy

Esper Scheduling Flow for Executive Assistants in Gmail and Google Calendar

Over the course of my two years working with Esper, I have been fortunate to influence several iterations of company direction. When I joined, the team had built a productivity product for Executive Assistants. To better improve their product, they dogfooded it on themselves by creating essentially an Uber for Executive Assistants, where Executives would be matched with Esper Executive Assistants 24/7, and the EAs hired by Esper would then use the Esper product to perform quality and efficient work.

Soon after I joined, I realized that we had learned what we needed from our service. As a team, we decided to close the service and shift our focus back to building an amazing product for EAs and Executives. We also discovered some unique insights into how the best of the best EAs worked. For instance, these EAs not only handled tactical scheduling for their Executives, they also strategically managed their Executive’s time.

Early version of Esper Charts Time Management and Strategizing Tool for Google Calendar

I took findings like these and proposed several strategic directions beyond our scheduling and calendaring assistant product. One of these, in particular, stuck with the team, and we dove into building our next product, Esper Charts. With Charts, anyone can strategically manage their time by quickly analyzing how they are currently using it. We essentially built a Mint for time. Our users were more than just individuals interested in upping their productivity, but also entire groups that wanted to manage their time as a team.

As we focused more energy on Charts, we decided we needed some more tactical products that our users could use daily. Hence, we opened up our suite of products beyond longer-term time management and created short-term hooks with Esper Ratings and Esper Agenda Check.

Esper Ratings a way to provide meeting feedback via Slack

Esper Ratings on Slack

Esper Agenda a way to create and distribute meeting agendas via Slack

Esper Agenda Check on Slack

Learn More

Check out a TechCrunch blog post on Esper.

Leeo Product Strategy
  • Client: Leeo
  • When: 2014
  • Team: Leeo C-level, Product Management, Marketing, IP, and Engineering teams, External Design Agency (Ammunition), External Web Development Agency (Noble Studios)
  • My Roles: Product Manager, Business Development and Partnerships Lead
Overview

In early 2014, I joined a small smart home startup called Leeo as a Product Manager leading our expansion into Enterprise Internet of Things (IOT). As the rest of our team worked on building and launching our first product, the Leeo Smart Alert Nightlight, a consumer, plug-and-play remote Smoke and Carbon Monoxide alarm monitor, I worked as a team with our co-founders to translate our company vision into our product suite, business, IP, and partnership strategy. In addition, I product managed our launch website, where I led the feature definition, information architecture, user experience design, content strategy, and vendor development and design partners.

My time at Leeo was a huge personal growth experience. Before Leeo, I had primarily worked as an Engineer and Designer. However, at Leeo, I played significant roles in Business Development, Partnerships, New Product Exploration, Product Marketing, and Strategy. I joined looking to work on high-level problems and expand my skills and experience. I am fortunate to say that got exactly that, beyond what I had even imagined.

Leeo Launch Website on a tablet

Research, Partnerships, and Strategy

As the sole employee out of our small team of twenty responsible for expanding from consumer to enterprise, I set the path for how to approach our growth. I began with a market survey of enterprise IOT and discussing our company vision with the Founders. Once I had a solid foundation of our goals, the market landscape in several enterprise IOT industries, and our existing partnership base, I selected a few high potential industries and dove into qualitative user research.

I interviewed 100+ individuals in the course of a few months to learn about various industries, different roles, and what their needs were in the IOT space. With our executive team’s wide-ranging contacts in Real Estate, we especially dove into all forms of that industry from Hospitality to Multifamily Residential Housing. This research spurred countless conversations with our leadership to determine company strategy for the coming months and years, resulting in numerous patents (see below).

What started as exploratory user research transformed into so much more as well. We began to form strong partnerships with individuals and companies who wanted not only to help us with our research but also to collaborate on projects with and even invest in us. For instance, after our meeting with one utility company about product collaborations, they invested and joined our board. Thus began my first experience leading Business Development and Partner Relationship Management, reporting directly to the Founding team.

Leadership

As the value of my work shined, I was soon able to grow my team. I hired and managed a colleague, and together we accomplished deeper market landscape analysis and research. Our work served instrumental in securing investors down the line when asked for our due diligence.

As the only team member who had ever shipped a consumer electronic product before, I was also often tapped to give advice on hardware product design. It was an honor to leverage my strong hardware engineering experience to be a resource to the team as they navigated contract manufacturers in Asia and industrial designers in San Francisco.

Product and Marketing

Three months before we publically launched our first product, we were in need of a Web Product Manager who could reliably deliver in a short period of time. I took this opportunity to step up to product manage our launch website.

I led our teams through the feature definition, information architecture, user experience design, content strategy, and vendor development and design partners to ensure that we had a fully functional, responsive, product launch marketing page, e-commerce store, blog, support forum, and community forum to showcase our company and product in time for our mid October launch date.

This was yet another new growth opportunity for me. So far at Leeo, I had already had a significant impact in my roles in Business Development, Partnerships, and New Product Exploration. Now, I was offered another chance to play a leading role, this time in Software Product Management and Marketing, and I owned it. Our entire launch was seamless and it was rewarding to see how my work directly led to sales.

Leeo Launch Website Desktop view on a Monitor

Patents

WO 2016040378 A3: Environmental monitoring devices and methods
US 20160071196 A1: Systems and methods for transferring data and revenue
US 20160072891 A1: Sensor-data sub-contracting during environmental monitoring
WO 2016007680 A1: Fault diagnosis based on connection monitoring
US 20160071219 A1: Dynamic insurance based on environmental monitoring
US 20160070614 A1: Identifying fault conditions in combinations of components
US 20160071184 A1: Service-improvements based on input-output analysis
US 20160071183 A1: Environmental monitoring device with event-driven service
US 20160071148 A1: Alert-driven dynamic sensor-data sub-contracting
US 20160070276 A1: Ecosystem with dynamically aggregated combinations of components
US 20160070920 A1: Constrained environmental monitoring based on data privileges

WO 2016032465 A1: Intuitive thermal user interface
US 9092060 B1: Intuitive thermal user interface
US 9304590 B2: Intuitive thermal user interface

WO 2016018269 A1: Electronic device having a programmed electrical characteristic
US 20160034010 A1: Electronic device having a programmed electrical characteristic

US 8967855 B1: Electronic device for determining external temperature
WO 2016028295 A1: Electronic device for determining external temperature

WO 2016032457 A1: Fluid-flow monitor
US 20160061640 A1: Fluid-flow monitor
US 20170038233 A1: Fluid-flow monitor

US 9213327 B1: Selective electrical coupling based on environmental conditions
US 9372477 B2: Selective electrical coupling based on environmental conditions
US 20150268205 A1: Selective electrical coupling based on environmental conditions
US 9170625 B1: Selective electrical coupling based on environmental conditions
WO 2016010529 A1: Selective electrical coupling based on environmental conditions
US 9116137 B1: Selective electrical coupling based on environmental conditions
US 20160018799 A1: Selective electrical coupling based on environmental conditions

Biosense ToucHB Website
  • Client: Biosense
  • When: 2011
  • Team: 2 Designers and Developers
  • My Role: Designer and Developer
Overview

In the Fall of 2011, I had the opportunity to re-design and develop a new website for an Indian medical electronics startup. Along with a friend of mine, we conducted initial user and market research, designed the user experience and interface, created all graphic and visual design assets, and developed the website using HTML, CSS, and JQuery for a remote client half-way across the world in India. We both had full-time positions as Mechanical Engineers at the time and used our evenings and weekends to work on this project.


Finished Biosense ToucHB Website product page in browser UX mockup

Problem Statement

Every minute, two people in the world die from Anemia–a completely curable disease! One may think that perhaps the cure is not well distributed, but that is not the case. In fact, the weak link in the chain boils down to lack of accurate diagnosis. With a false positive diagnosis and treatment, dangerous complications occur. With a false negative diagnosis, no life-saving treatment is offered.

Biosense’s TouchHb product addresses this key moment in the chain by providing a reliable, portable, non-invasive diagnostic to healthcare workers. TouchHb targets mobile healthcare workers in rural India with its low cost and minimal profile.

Our client asked us to re-design the existing Biosense website so that it was easier to use and more engaging.

Existing Biosense ToucHB Website before we began redesigning

Design Research

After determining that the website’s target audience would be the health care workers in the field and potential investors as opposed to the rural patients, my partner and I began with researching how to best design a site that could convince our target audience that TouchHb was a valuable product in which to invest.

We studied the history of anemia, key statistics, and existing solutions. We learned that though information was plentiful, it was not common knowledge and scattered.

We interviewed potential website viewers. With investors, we found that our biggest obstacle with was demonstrating the importance and need of TouchHb for people of the emerging world. Investors often did not realize the extent of the problem and how a solution was right at their fingertips. As we interviewed healthcare workers, we learned that many were entrenched in the mindset that reliable anemia diagnostics were only available at larger hospitals and had to invasively draw blood. We needed to make it clear that that was not the only option available to them. A portable and non-invasive solution could now be purchased by individuals at a fraction of the cost.

We researched how to best share our knowledge and achieve these goals, and came to the conclusion that our website needed to tell a story. From there, we began designing and prototyping what an immersive storytelling experience might be.

Storytelling Information Architecture and User Experience

As we dove into the storytelling and user experience, we worked to simplify our story down to absolute essentials. A full-page, immersive slideshow analogy began to form as our chosen tool of expression. We strove to make our design friendly, engaging, informative, and a clear call to action. We wireframed various iterations out on the whiteboard as we cycled through this process.

Biosense ToucHB Website Story Architecture whiteboarding

Since my partner and I were both the designers and engineers on this website, we were careful to design a website that achieved all our goals independently from engineering challenges. After we were confident in the framework of our design, we determined what the best way to code our solution. Naturally, we faced some key engineering tradeoffs. For instance, we wanted to use a CMS, but realized that our schedule and resources would not allow us to complete the design we wanted with a CMS.

Biosense ToucHB Website Development plan whiteboarding

When we handed off the completed website design to our client, we provided them with all the final code, visual assets, and a
guide to the code.

Landing Page User Interface and Visual Design

On the visual design side, we followed a similar process of iterative design with colors, graphics, photography, and individual page layout. Throughout the process, we checked in with our client to make sure that they were satisfied with our progress and we tested our designs through interviews, usability tests, surveys, and A/B testing.

We settled on using a theme of warm colors that had earthly tones along with a red to subtly reference the blood associated with anemia.

Biosense ToucHB Website theme colors

Let’s dive into our process for the front landing page. Our process for all the other pages was extremely similar.

For the front page, we created initial wireframes of full-screen slideshows as well as framed sliders. We explored where we wanted information to be presented, and how we wanted to indicate how a user was to interact with and move through our story.

Biosense_FP-Wireframe1
Biosense_FP-Wireframe2

As we regularly checked in with our client, we created prototypes to share our progress. We started with simple static prototypes and gradually progressed into functional prototypes.

Biosense_FP-Prototype1
Biosense_FP-Prototype2

Once we were confident with the framework of our website, we began prototyping our visual assets. We had several photoshoots where we played with colors, framing, and composition. In our first photoshoot, we rented a nice lens and photographed ourselves in preparation for when we hired a model and on the off chance we did not need one. After looking through our shots, we needed a model.

Biosense_FP-Photoshoot1
Biosense_FP-Photoshoot2

In our second photoshoot, we hired a model and coached her through the session. We played around with various backgrounds, attire, facial expressions, positioning, subjects, lighting, and composition. At the end of our session, we had a massive library to chose from for our story.

Biosense_FP-Photoshoot5
Biosense_FP-Photoshoot7
Biosense_FP-Photoshoot8
Biosense_FP-Photoshoot3
Biosense_FP-Photoshoot6
Biosense_FP-Photoshoot4
Biosense_FP-Photoshoot9

After choosing our top images, we created rough static mockups of key pages side by side for feedback. We used side by side comparisons to determine our final combination of photographs.

Biosense_Mockup1
Biosense_Mockup2

Finished Biosense ToucHB Website front page in browser UX mockup

Learn More

If you would like to learn more about Biosense’s ToucHb, watch their TEDx talk: A 20 second blood test without bleeding from 2013.

Barnes & Noble Nook Media Tablets
  • Client: Barnes & Noble Nook Media
  • When: 2011-2014
  • Team: 3 Mechanical Product Design Engineers, Electrical Engineer, and external Contract Manufacturing team
  • My Role: Product Design Engineer
Overview

I joined Barnes and Noble’s Nook Media team in Fall 2011. Though the company headquarters are in New York, Nook headquarters were in Palo Alto. Nook functioned much like a startup within the larger company, where we had the advantages of agility and resources.

Products

During my two and a half years at BN, I worked on the design of about ten tablets and accessories. Some were products I joined during the later stages of the development process and most were early concepts that we took through various stages of the development cycle.

Nook HD+ (shipped)
Nook HD (shipped)

Barnes & Noble Nook Media Tablets: Nook HD+ and Nook HD

Product Design

As a Nook Product Designer, I was offered the opportunity to dive even deeper into Hardware Product Design through the mentorship of my team. Over the years, I worked on almost every subsystem in a tablet, including custom batteries, cosmetic housing and structural parts, displays and touch screens, audio systems, antennae, buttons, connectors, PCB and flexes, media and camera systems, and high-level system architecture.

In teams of three, we not only designed the overall system architecture and the detailed mechanical part design, but we also collaborated with internal Engineering, Marketing, and Operation teams and external ODMs, consultants, partners, vendors, and suppliers.

Design Strategy and Research

During my final months at BN, our team did a massive re-evaluation of our roadmap. We worked side by side with multiple design consultancies to brainstorm and strategize what direction we ought to take our products. Over the course of a few months, we used our user previous research data to settle on some unique experiences that would be enabled by innovative product form factors and materials. It was very exciting to push the bounds of what we think of as a typical reader and to not only make one unique experience but to also design a whole family of products that interplayed with each other.

Patents

While at BN, we invented a number of unique assembly techniques for consumer electronic device product design.

US 20140201997 A1: Method for split wire routing in a cavity for a device
US 20140204547 A1: Apparatus for split wire routing in a bracket for a device
US 20140201996 A1: Techniques for split wire routing for a bracket in a device

US 20140026411 A1: Techniques for efficient wire routing in a device
US 20140027166 A1: Techniques for efficient wire routing in electronic devices
US 20140029218 A1: Apparatus for efficient wire routing in a device