Work

02 · RAKUTEN · 2018–2020 · ROLE: LEAD UX DESIGNER

Every partner testing devices in one lab, finally run as one system.

Situation
Rakuten’s lab teams were managing device testing across many partners, each with its own way of working, and no one view of what was happening.
Clarity
I studied how each partner actually worked, found what they had in common, and designed one portal everyone could run on.
Shipped
A portal where every team could see the work, track it, and act on it, on desktop or on a tablet in the lab.
Built forWebTablet

01 · The mess

Rakuten's lab tested devices for many partner companies. Each one worked its own way, with its own handoffs and its own quirks.

That made the whole operation hard to see. Technicians wanted to know their next step without more admin. Managers wanted one view of what was moving, what was stuck, and what had passed.

So the job was never really "design some screens". It was to understand every different way of working, and find the one system underneath them.

  1. 01Every partner tested devices their own way
  2. 02Nobody could see where a test had got to
  3. 03Tracking was manual, across too many tools
  4. 04Managers had no single view of the lab
  5. 05One portal had to fit all of them

02 · The work

Research

Each partner had built their own testing software and their own way of running it. I started by reading all of them and settling what we were actually building.

Partner

Own software

Own way of testing

Built independently, for its own way of working.

Partner

Own software

Own way of testing

Built independently, for its own way of working.

…and more

More of the same

Each one different

Several OEM partners, each with its own stack.

read them all, then scope

One shared scope

What every partner genuinely had in common, and what had to stay theirs.

Iterations

This one did not need many rounds. We agreed what we were building before design started, so the hard part sat somewhere else: making a huge amount of data readable.

The material

Test cases, runs, defects, nodes, versions, owners, across every partner at once.

The screen

Status
Issue
Node · version
Defect ID

One row per issue, ranked so triage happens before reading.

  • We only needed one or two rounds of changes. That is rare. It worked because everyone agreed early on what we were building.

Collaboration

I worked across three companies at once: employed by Infosys, engaged by Cisco, building a portal Rakuten owned.

Three companies, one project

Infosys

Employed me; the delivery team

Cisco

Engaged me onto the project

Rakuten

Owned the portal

Reported to

Cisco's CTO, with Rakuten's own team

Day to day

Senior developers, and the CTO directly

  • The portal housed the software of major global device manufacturers, partner names protected under NDA

03 · The big calls

SYSTEMSLens

Before I designed anything, I studied how each partner worked. They all did the same basic things, just in their own way. So I built one system that fits everyone. Nobody had to change how they work.

PRODUCTLens

A screen that just shows numbers was not enough. People needed to spot what was stuck and fix it right there. And what each person sees depends on their job.

EXECUTIONLens

This one had to get built, so the work went all the way from understanding people to wireframes to finished UI. Two very different people use it. A technician standing at a bench, and a manager checking progress from a desk.

04 · The build

FIG 02.1MULTIPLE OEM PARTNERS · ONE PORTAL
OEM 01OEM 02OEM 03One shared way of workingPortalmany flows → one system
FIG 02.1 · DIAGRAM · DRAWN FOR THIS PAGEEveryone's way of working, drawn as one.
FIG 02.2
← BACKTest cases

RAN

412

Total test cases

Passed268
Failed121
Blocked23

EPC

388

Total test cases

Passed301
Failed74
Blocked13

IMS

274

Total test cases

Passed190
Failed66
Blocked18

NFVI

196

Total test cases

Passed151
Failed38
Blocked07

27,318

Total test cases

10,928

Executed

6,877

Pending

8,142

Passed

1,904

Failed

882

Blocked

56.8 %

Execution status

Search projects by name, ID or owner

Project 001 · Partner A

Verify VPC-DI node hosting the MME · VNF booted and operational

10,928 test cases filtered

TabularGraphical
Test case IDPass / fail criteria
RMN-MME-001Node boots and the VNF reports operational
RMN-MME-002CF and SF resources match the allocation plan
RMN-MME-003Retry behaviour holds under induced timeout
RMN-IMS-014DSCP marking present on outbound SIP

Showing 01–10 of 10,928 records

Prev1222324999Next
FIG 02.2 · REBUILT FROM MEMORY · THE ORIGINAL IS UNDER NDA · ALL DATA MADE UPTen thousand tests, filtered to today's ten.
FIG 02.3
← BACKRelease request report · LAB-939

Release request details

Defects for retest

None

Attached documents

Unit test report Release notes Release plan MOP document Design doc Pen test report Security baseline

Release review and assessment

Security manager

Security dept. · 10 Apr

⌸ 2

Test manager

RAN QA · 10 Apr

⌸ 2

Test projects · 3

Partner A · RAN

Quality assurance test

430

Test cases

100 pass330 fail

Partner B · vRAN

Quality assurance test

500

Test cases

100 pass400 fail

Partner C · IMS

Quality assurance test

288

Test cases

214 pass74 fail

Defects

B

Node fails to boot after config push

DEF-41022
NF

Retry logic too aggressive on timeout

DEF-41183
BD

DSCP marking missing in SIP messages

DEF-41207

Signoff

QA

Signed · 10 Apr

Security

Signed · 10 Apr

Dept. head

Signed · 10 Apr

SEC head

Signed · 10 Apr

FIG 02.3 · REBUILT FROM MEMORY · THE ORIGINAL IS UNDER NDA · ALL DATA MADE UPWhere several companies sign off a release.
FIG 02.4
← BACKTest cases

10,928 test cases filtered

Last week
TabularGraphical
10k7.5k5k2.5k0
Total filtered · 10,928
01 Feb02 Feb03 Feb04 Feb05 Feb06 Feb07 Feb08 Feb
PassedFailedBlockedPending
FIG 02.4 · REBUILT FROM MEMORY · THE ORIGINAL IS UNDER NDA · ALL DATA MADE UPThe same tests as a chart, for managers.
FIG 02.5
← BACKPartner A · RAN, quality assurance test

RAN

412

Total test cases

EPC

388

Total test cases

IMS

274

Total test cases

NFVI

196

Total test cases

Partner A · RANQuality assurance test ⊗

FAILED

Overall status

1,892

Total cases

1,500 failed

392 passed

Project progress

54 % · environment: integration

Sr.TitleIDStatus
001Ping test with max number of RRC connected users166106FAILED
002VoLTE inter-eNB mobility test with combined impairment166701FAILED
003Ping test with max number of RRC connected users177653FAILED
004Throughput under sustained peak load198671FAILED
FIG 02.5 · REBUILT FROM MEMORY · THE ORIGINAL IS UNDER NDA · ALL DATA MADE UPA bad run. 1,500 tests failed of 1,892.
FIG 02.6
← BACKTest cases

RAN

412

Total test cases

Passed268
Failed121
Blocked23

EPC

388

Total test cases

Passed301
Failed74
Blocked13

IMS

274

Total test cases

Passed190
Failed66
Blocked18

NFVI

196

Total test cases

Passed151
Failed38
Blocked07

27,318

Total test cases

10,928

Executed

6,877

Pending

8,142

Passed

1,904

Failed

882

Blocked

56.8 %

Execution status

10,928 test cases filtered

TabularGraphical
TabularGraphical
Test case IDPass / fail criteria
RMN-MME-001Node boots and the VNF reports operational
RMN-MME-002CF and SF resources match the allocation plan
RMN-MME-003Retry behaviour holds under induced timeout
RMN-IMS-014DSCP marking present on outbound SIP
01
02
03
04
05
06
07
08
FIG 02.6 · REBUILT FROM MEMORY · THE ORIGINAL IS UNDER NDA · ALL DATA MADE UPThe same tests, as a table and a chart.

Problem → part

  • Many partner ways of workingOne way to run the lab
  • Fragmented status handoffsOne view of every test
  • Manual tracking and context switchingStatus that updates itself, and a clear next step
  • Manager uncertaintyRole-based dashboards and analytics
  • Lab-floor access needsTablet-ready testing views

05 · The facts

★ Ryan Soni

Case 02 · RAKUTEN · 2018–2020

3

Companies involved

2018–20

Timeline

Shipped

Status

Role
Lead UX Designer. I read how the partners worked, mapped it, then did the wireframes and the UI
Who was who
I worked for Infosys. Rakuten owned the portal. Cisco and Rakuten were the clients
Who I answered to
Senior people at Cisco and at Rakuten, through discovery, design, and review
Users
Lab technicians, the managers above them, and leadership
Product
The Rakuten Lab Management Portal, for testing devices
Scale
Testing ran through it for many partner manufacturers

· Outcomes ·

The team told us there was less manual tracking and less jumping between tools, and they took to it well. Nobody measured it, so I will not put a number on it

The real screens are protected. Everything here is rebuilt from memory

06 · The takeaway

Enterprise portals are rarely hard because of the screen. They are hard because the work underneath is split across too many places. This is what I do about that.