At its core, experience monitoring is the process of gathering performance and activity data from the devices that employees use to work from, as well as the networks they connect to and the applications and services being used, to help IT understand the experience from the user’s perspective in real time.

Most organizations today already enjoy a wealth of visibility into device usage, provided that each device remains inside the corporate network or when using on-premise applications. But very few of these organizations have the same level of visibility into their remote or distributed workforce. With more employees working remotely and depending on an increasing number of public cloud, SaaS and internet applications, it’s become harder to see, control and troubleshoot any issues that arise. While an organization may not ‘own’ the underlying infrastructure, it is still responsible for user experience.

In September 2020 NetMotion conducted two surveys in the US and the UK to understand the divide between IT teams and the remote workers they support. One of the surveys sourced responses from IT professionals, managers, directors and C-level executives; the other asked similar questions, but from the perspective of office workers who now work remotely. These surveys were carried out concurrently and resulted in 500 responses each. The findings present an interesting story.

Remarkably, even though two thirds of remote workers have encountered experience issues, only around half actually report them to their IT team. This points to a major issue in distributed working and the challenge in getting visibility into the remote working experience.

Now Tech: End-User Experience Management, Q3 2020
by Andrew Hewitt with Stephanie Balaouras, Rich Lane, Tyler Brown, and Diane Lynch August 2020

Issues encountered and not resolved

Issues encountered and not reported

Issues encountered and resolved

I have not encountered any technology issues

Key findings:

• 57.5% of all workers who encountered IT issues while working remotely did not share them with the IT team
• Two thirds of remote workers have encountered an IT issue during the lockdown
• Only 45.6% of all reported issues to IT were actually resolved.

This lack of visibility matters. If IT departments cannot understand the factors impacting remote workers, then they will be unable to support them. This goes some way to explaining the significant disparity between the estimated quality of experience for distributed workforces by IT leaders, and the actual working experience of those employees. The NetMotion study asked both cohorts to rate the experience of working remotely from a tools and technology perspective. IT respondents over-rated the quality of remote working experience by 21% when compared with scores shared by workers.  

This gap represents part of the problem but not all of it. According to the study, only one third of organizations are currently using experience monitoring solutions, with Gartner estimating the adoption rate at even lower.

Tip: click the legend below the chart to toggle a category on or off.

The terminology for experience monitoring can be difficult to navigate. Described as digital experience monitoring (DEM) by Gartner and by Forrester as end user experience management (EUEM), it is an evolution of more traditional approaches to application performance monitoring (APM) and network performance monitoring and diagnostics (NPMD).

Gartner first published its Market Guide for Digital Experience Monitoring by Federico De Silva, Charley Rich and Josh Chessman in 2019, which was followed up by a more exhaustive overview in August 2020. This document outlines three core types of DEM solutions: real user monitoring (RUM), endpoint monitoring (EP), and synthetic transaction monitoring (STM).

DEM gives IT teams the ability to actively monitor and troubleshoot a host of metrics related to device, application and network performance. These can include: device activity, mobile data usage, application and website usage, data destinations (e.g. where data is being sent), productivity and adoption rates, network performance and diagnostics, Wi-Fi security information, application performance, device performance, web activity (including website reputation and risk factors), and data consumption. 

Real user monitoring (RUM)
Real user monitoring evaluates the user experience from the perspective of the application, such as a website or mobile app.

Endpoint monitoring (EP)
Endpoint monitoring provides visibility into end-user devices.

Synthetic transaction monitoring (STM)
Synthetic transaction monitoring, the first and most established form of DEM, focuses on the performance and uptime of SaaS and other services

Yes, we use a variety of tools

Yes, we use one dedicated tool

No, we do not monitor employee experience

Key findings:

• Around half of all organizations are using a combination of different tools to monitor the remote working experience

• Only 1 in 6 companies are not monitoring the remote working experience at all

• 1 in 3 organizations are actively using a dedicated experience monitoring solution 

One of the undeniable factors driving adoption of experience monitoring today is the enormous shift to remote work seen in 2020. As travel restrictions and stay-at-home orders took effect around the world earlier in the year, for the first time in modern history employees began
working primarily from their homes, outside the safe perimeter of the corporate network. And as a result, traditional monitoring tools such as APM and NPMD became less effective at determining and troubleshooting issues as they appeared on remote devices.

By contrast, experience monitoring tools typically use an agent on the device to gather a wide variety of information, including the
status of the CPU, memory, disk and battery, as well as network metrics, application performance and more. Leveraging these data points directly from the endpoint, it becomes possible to evaluate potential stability and performance issues in real time, helping to speed up the troubleshooting process. This gives IT teams the visibility they need to decide which common problems can be automated and significantly reduces mean time to resolution (MTTR) for any other issues.

Traditional tools are not as effective at monitoring the experience, but is the experience of working remotely any worse? The 2020 NetMotion study would suggest it often is. Almost half of employees considered remote working as worse than in an office, from an IT and technology perspective. Some of this is driven by the reduced priority that distributed workforces often suffer from – a mindset which is changing fast. Cybersecurity clearly also plays a role. Overbearing technologies, such as VPNs and multi-factor authentication, often stifle productivity and frustrate workers. If balancing risk management with maintaining a good user experience is important in office life, then it’s absolutely critical when it comes to remote working. 

Use DEM to Understand and Enhance Your Employees’ Work-From-Home Experiences
Gartner 2020

Allina Health operates 11 hospitals, four ambulatory care centers, and 97 clinics. The group’s top-rated homecare and hospice division deployed remote Electronic Medical Record (EMR) software to review patient medical history, update care plans and document other important patient status information.  

Allowing nurses to operate in the field using tablets offered a much richer and more convenient experience to patients, as well as giving healthcare staff more flexibility in their approach to work. The challenge was that nurses were experiencing a host of technical issues, meaning the productivity rate of clinical work suffered. After implementing an experience monitoring solution, the IT team were able to identify lost connectivity as the most common issue, causing critical applications to log out without warning and forcing nurses to re-enter lost data. Some session interruptions resulted in corrupted data, requiring IT to extract files from the central database—a repair that often took half a day. Nurses frequently waited until the end of their shifts to sync from an office or once back at home, lengthening their workday. Several nurses even left the company in frustration.

After identifying the most common issues, Allina Health was able to work on remediating them. Upgrading its remote access software, changing network policies and rolling out new training programs made a big difference - homecare and hospice nurses have since been able to provide secure, stable EMR access at patients’ homes and other sites. Within the first six months of implementing these changes, nurses on average saved enough time to visit eight or nine patients each day instead of five previously, an increase of three additional patients per day. Not only did staff churn decrease, Allina credits DEM as a key factor in helping the organization double its homecare unit's staff. 

Clyde Daisley, system engineer
Allina Healthcare

IT leaders expect complete visibility of network performance and application uptime, user behavior and online threats. But as the shift continues towards a more mobile, remote and distributed workplace, employees are accessing a wider variety of SaaS and internet resources from countless unknown networks, over any number of Wi-Fi and cellular connections, resulting in higher risk and greater troubleshooting complexity that legacy APM tools simply weren’t designed for.  

For many organizations, permanent remote working has surfaced a host of irregular problems that the IT team is not equipped to support. The NetMotion September 2020 study revealed that three quarters (75%) of all organizations encountered an increase in support tickets since the start of the lockdown when compared with before. Over one quarter described the change as being significant, yet most did not benefit from an equivalent growth in available resources.

This is where experience monitoring tools are most valuable, thanks to their ability to monitor and improve the remote working experience. IT teams can react to tickets much more intelligently, using rich diagnostics features to better understand and resolve issues. More importantly, perhaps, they can also start improving the employee experience proactively and eliminate issues before workers get frustrated enough to inform the helpdesk.

There are many tangible benefits to experience monitoring
beyond the measurable improvements to the support team effectiveness.   

• Increased productivity of remote workers, due to eliminating common experience problems such as network disconnects, outdated hardware or misconfigured apps. 

• Faster speed of remediation. DEM can give insight to those working in IT, providing root cause analysis and diagnosis of problems, enabling more effective issue resolution. 

• Improved engagement with digital transformation projects. Experience monitoring can help measure and encourage adoption of new programs, applications and processes – identifying potential blocks and advocating for change. 

• Overall morale and satisfaction improvements by tackling sources of frustration. This can prove critical for remote workers who all too often ‘suffer in silence’ – 57% of all issues experienced by distributed workforces are not even reported to IT. 

Gartner Market Guide for Digital Experience Monitoring, August 2020 
by Federico De Silva, Charley Rich, Josh Chessman 

One of the best ways to improve the situation is to start with clear objectives. Experience monitoring tools excel at gathering data, but data itself is of little value if the organization doesn’t draw appropriate insights and take action to fix (or at least minimize) risks and issues. 

This is where IT leaders often struggle. They are not accustomed to quantifying ‘soft’ metrics such as user experience, so this is where setting specific KPIs around quality of experience and employee engagement can help. For example, information about device usage can prove invaluable, particularly if it includes metrics about the number of times employees encounter network disconnects, the times of day that employees are working, or information about which applications consume the most bandwidth.  

For example, the NetMotion study showed that network performance was the most commonly cited contributor to remote working challenges, with one quarter of respondents also sharing that simply diagnosing the problems in the first place was difficult – an issue exasperated by the fact that most remote workers are operating on unmanaged networks and in unknown conditions.

Based on these kinds of insights, an IT team can make informed judgements about the user experience to make decisions about how to prioritize and resolve issues as soon as they appear. This can range from rolling out policies that block risky websites or limit access to platforms like Facebook until after normal working hours, but it can also include mobilizing an engineer to push software updates or scripts, tweak VPN or Wi-Fi settings and create automatic responses to common problems.

50%

30%

40%

20%

10%

0%

Reliable network performance

Software/application
issues

Remote worker cybersecurity

Hardware performance

Root cause analysis
of problems

Gartner Market Guide for Digital Experience Monitoring, August 2020
by Federico De Silva, Charley Rich, Josh Chessman

•        Device

•        Application

•        OS

•        Cloud

•        Network

•        Filter

•        Automate

•        Summarize

•        Analyze

•        Distribute

•        Block

•        Optimize

•        Prioritize

•        Notify

•        Configure

With offices in 20 countries around the world, this global law firm has always prided itself on investing in technology to support its 3,000 lawyers and administrative staff. As the Covid-19 pandemic forced employees to work from home, the company has actively encouraged open dialog about workplace flexibility and agility, to cater to the needs of employees while ensuring that productivity can be maintained. This has included offering employees flexible start and finish times, modified ‘core’ hours to allow for other non-work-related commitments. Crucially, it needed to ensure the productivity of ‘fee earners’ did not significantly drop. Clients are typically billed in increments of just six minutes, meaning that any impediment to the working experience of fee earners could be directly attributed to revenue loss.

In response to the changes created by this working environment, the company was able to roll out new policies for all of its employees, allowing them to work remotely across its global network. Rather than simply waiting for support tickets to flood in, the firm’s IT team can take proactive action. By using an experience monitoring solution, it could actively track the most commonly technical issues and remediate them before many employees even knew they existed. Within days, the firm actually started seeing an increase in the billable productivity of fee earners, with the remote working program heralded as a major success.

Managing partner

IT director

One thing is clear from the events of 2020 – distributed working is not just a short-term trend. As IT leaders face the reality that a large percentage of the workforce will remain distributed, many of them are quickly realizing that they lack visibility into endpoints, connectivity and application performance – exposing their organizations to greater risk and bottlenecks, and in many cases leaving employees frustrated and underperforming. 

With abundant dissatisfaction and many workers electing not to report issues to IT teams, it should come as no surprise that remote employees have embraced shadow IT even more so than they have in years past. The NetMotion study found that 62% of remote workers are using applications unknown or unsanctioned by IT teams – with 25% using a significant number of unapproved tools outside of those that have been provisioned. 

Shadow IT, contrary to how it is viewed by some, is usually a result of workers seeking to be more productive; not less. The majority of people simply wish to get their jobs done. It is well documented that productivity can be linked to morale, and workers will turn to alternative tools if the ones provided are not good enough. This is all linked to the overall employee experience, and monitoring solutions can be used to better understand it. DEM tools can keep track of adoption rates for new applications, as well as detecting workarounds and rogue alternatives being used by employees. Often, this will present an opportunity for IT leaders to adjust their own strategies in response to real-time employee feedback. 

The data supports the productivity hypothesis. Most workers are not inherently lazy – productivity tools are the most likely to be adopted by remote workers.

Alan Boswell Group is an independent insurance broker and financial planning firm, known for exceptional customer service and expert advice on matters of insurance, risk management and financial services. The company serves clients all over the UK from ten regional offices, with financial advisors, claims personnel, and management frequently needing to access sensitive data from home or while at a client’s
location. 

With cellular and Wi-Fi connectivity not always being available, the company’s remote employees already faced challenges with productivity. Experience monitoring was implemented to better understand the nature of these issues, flagging those that were causing the biggest problems. Employees using Microsoft Surface devices at client sites – often restaurants and other hospitality venues – were spending far too long with the authentication process in logging into mission critical applications. Unreliable Wi-Fi and legacy software meant that simple tasks were needlessly problematic for frontline staff.

Identifying these issues meant that the IT team could work on some smart remediation strategies, helping employees reduce the amount of time wasted on technical issues. This knowledge was extremely valuable at the onset of the global lockdown. Equipped with battle-tested technologies and policies, the firm was able to enable the traditionally mostly fixed workforce into an entirely distributed one in just 72 hours. While rival firms struggled with business continuity and diagnosing major disruptions to productivity, Alan Boswell managed the transition seamlessly.

"The remote user experience of NetMotion is worlds apart,” said Tom Fisk, IT operations manager. With NetMotion, IT can easily troubleshoot issues remotely, and quickly deploy company-issued devices that are configured to connect to the network securely. This has given the IT team the confidence to roll out new applications such as  Microsoft Teams for virtual client meetings” 

Tom Fisk, IT operations manager
Alan Boswell Group

As this report has demonstrated, the enormous shift to remote working has created problems that experience monitoring
solutions are uniquely capable of resolving. The ability to gather real-time, actionable data about the experience of workers can have a massive impact on the success of a business.
Satisfied employees help reduce churn, and almost always make
more productive workers. The knock-on effect of having a high-quality employee experience from happier employees has tangibly positive results on customer experience and will indirectly contribute to improved employee retention and hiring rates.  

Forrester and Gartner divide the market in different ways. Gartner splits the ‘DEM’ market into real user monitoring, endpoint monitoring and synthetic transaction monitoring, while Forrester categorizes ‘EUEM’ into pure-play tools, endpoint management specialists and monitoring suites. As a nascent market, the edges aren’t entirely clear yet, making the decision-making process for IT leaders much more difficult. Ultimately though, every organization is unique – finding the right fit for yours will require some reflection.

Forrester Now Tech: End-User Experience Management, Q3 2020
by Andrew Hewitt with Stephanie Balaouras, Rich Lane, Tyler Brown, and Diane Lynch August 2020

NetMotion DEM provides real-time data about the device, application and network performance in a single pane of glass. No other DEM solution can provide the same level of insight into mobile workers, showing real-time, non-synthetic information on networks, applications, devices and much more. NetMotion is entirely software-based, making it easy to implement in the cloud, on-prem, or as a service. It scales seamlessly, without new investments or headaches. Other experience monitoring products can reveal what’s wrong, but few can help resolve issues. NetMotion’s policy features and optimized tunnel do exactly that.

One of the most popular ways to implement experience is through endpoint agents. This typically works by deploying a client on work devices such as laptops, tablets and mobiles. These agents give IT leaders added insight into the experience of workers from a device, application and network perspective.
NetMotion is an endpoint-based experience monitoring solution with unique insight into network data, combined with the most powerful diagnostics and remediation functionality on the market.

The Forrester New Wave™: End-User Experience Management, Q4 2020  
by Andrew Hewitt with Stephanie Balaouras, Shannon Fish, and Diane Lynch 

Gartner is the world's leading research and advisory company. This guide offers I&O leaders a market analysis with recognized vendors (including NetMotion), use case examples, and actionable recommendations to consider.