AACHEN, Germany; December 14, 2021 – A new report analyzing the performance and reliability of mobile voice and data services in the UK ranks EE’s mobile network first, ahead of Vodafone, Three and O2. The benchmark is conducted annually by infrastructure and benchmarking specialist umlaut, now part of Accenture, and international consumer telecommunications magazine ‘connect.’ EE was awarded the top position for the seventh consecutive time.
Overall results
The benchmark measures each network's maximum data and voice performance. Additionally, a sophisticated crowdsourcing methodology determines the quality and performance of the mobile connections users actually experience.
Hakan Ekmen, CEO umlaut telecommunications, said: “Congratulations to EE for winning the umlaut connect Mobile Benchmark in the UK for the seventh time in a row. We would also like to recognize Vodafone for offering the best voice service, Three for the highest score increase, and O2 for its improvements in Voice and Data compared to our previous benchmarks.”
Hannes Ruegheimer, editor at connect magazine, added: “Operators in the UK have been working hard to improve their networks, including their 3G, 4G and 5G deployments. Compared to our previous tests, 5G coverage in the UK has progressed significantly. We hope our benchmarks will contribute to continued positive development and even more benefit to consumers.”
Cities benchmark – EE takes the lead in London
By far the most densely populated area in the UK, Greater London is an exceptionally demanding terrain for deploying and maintaining mobile networks. Yet, all networks score a little higher in the capital than the overall assessment. Again, EE leads the pack with better scores in the Voice category and crowdsourcing analysis but falls behind in Data compared to its overall results in this category. The same is true for the London-second Vodafone and third-placed O2. Three ranks fourth in London with a slightly lower score in the Voice category than its overall results but a somewhat higher score for Data.
umlaut also analyzed how mobile networks perform in Belfast, Birmingham, Bradford, Bristol, Cardiff, Edinburgh, Glasgow, Leeds, Liverpool and Manchester.
Benchmark methodology
umlaut measured the performance and reliability of mobile data and voice connections in three ways: 1) Drive tests – Four test cars traveled 19 cities and 46 towns covering approx. 10,000 kilometers. 2) Walk tests – Two test teams visited eleven cities, traveling between cities by train. The tests were conducted from October 25 to November 15. The total testing area represents 17.3 million people or approx. 26% of the population in the UK. During drive tests and walk tests, each network's highest possible data and voice performance are measured under controlled circumstances. 3) Crowdsourcing – Over 24 weeks (May – November), approx. 2.7 billion data and voice connection samples from 670,000 users, representing 99.8% of the UK's population, were analyzed. The results of all three tests were thoroughly weighed to achieve a realistic and conclusive assessment of each network’s potential and performance.
The umlaut connect Mobile Benchmark is an independent evaluation that provides a detailed orientation to consumers and a fair, transparent and neutral evaluation and comparison of their networks' capabilities to management and supervisory boards of operators. It combines umlaut's expertise in measuring network performance with connect's long-standing editorial experience and knowledge in testing telecommunications products and services. First conducted in Germany more than 20 years ago, umlaut and connect since 2009 extended their mobile network benchmark to other European countries, including Austria, Netherlands, Spain, Sweden and Switzerland. In the UK, the benchmark was published first in 2014 and paused in 2020 because of the COVID-19 pandemic. It has become the de-facto industry standard for customer-perceived network quality.
The full umlaut connect Mobile Benchmark in the UK can be downloaded here: https://www.umlaut.com/en/stories/ee-wins-the-umlaut-connect-mobile-benchmark-in-the-uk-for-the-seventh-time or www.connect-testlab.com/united-kingdom
The press material can be downloaded here: https://filecloud.umlaut.com/Download/ee7067a54db07f63b65d2b919e3d76
Overall results
The benchmark measures each network's maximum data and voice performance. Additionally, a sophisticated crowdsourcing methodology determines the quality and performance of the mobile connections users actually experience.
- EE: UK's second-largest operator was named “Best-in-Test” with 864 of 1,000 points possible and the overall grade “very good.” EE scored best in the Data category and achieved the best results in the crowdsourcing analysis. The operator also achieved the broadest 5G coverage in the benchmark.
- Vodafone: The operator scored 820 points and received the overall grade “good.” Vodafone leads in the Voice category and ranks second in Data and the crowdsourcing analysis.
- Three: The smallest UK operator showed the highest score increase compared to the previous benchmark and won back the third rank with a score of 739 and the overall grade “satisfactory.” Three provides particularly fast 5G data rates.
- O2: The country's largest mobile operator came in fourth with 715 points and a “satisfactory” grade. O2 significantly improved in the Voice and Data categories compared to the previous benchmark.
Hakan Ekmen, CEO umlaut telecommunications, said: “Congratulations to EE for winning the umlaut connect Mobile Benchmark in the UK for the seventh time in a row. We would also like to recognize Vodafone for offering the best voice service, Three for the highest score increase, and O2 for its improvements in Voice and Data compared to our previous benchmarks.”
Hannes Ruegheimer, editor at connect magazine, added: “Operators in the UK have been working hard to improve their networks, including their 3G, 4G and 5G deployments. Compared to our previous tests, 5G coverage in the UK has progressed significantly. We hope our benchmarks will contribute to continued positive development and even more benefit to consumers.”
Cities benchmark – EE takes the lead in London
By far the most densely populated area in the UK, Greater London is an exceptionally demanding terrain for deploying and maintaining mobile networks. Yet, all networks score a little higher in the capital than the overall assessment. Again, EE leads the pack with better scores in the Voice category and crowdsourcing analysis but falls behind in Data compared to its overall results in this category. The same is true for the London-second Vodafone and third-placed O2. Three ranks fourth in London with a slightly lower score in the Voice category than its overall results but a somewhat higher score for Data.
umlaut also analyzed how mobile networks perform in Belfast, Birmingham, Bradford, Bristol, Cardiff, Edinburgh, Glasgow, Leeds, Liverpool and Manchester.
- Four cities – Birmingham, Bristol, Cardiff and Manchester – reflect the nationwide ranking, with EE in the lead, closely followed by Vodafone, Three ranked third, and O2 fourth.
- In Edinburgh, Glasgow and Leeds, EE ranks first, Vodafone second, O2 third and Three fourth.
- In Belfast and Liverpool, Vodafone takes the lead, followed by EE, O2 and Three.
- In the Metropolitan Borough City of Bradford, West Yorkshire, O2 ranks first ahead of EE, Vodafone and Three.
Benchmark methodology
umlaut measured the performance and reliability of mobile data and voice connections in three ways: 1) Drive tests – Four test cars traveled 19 cities and 46 towns covering approx. 10,000 kilometers. 2) Walk tests – Two test teams visited eleven cities, traveling between cities by train. The tests were conducted from October 25 to November 15. The total testing area represents 17.3 million people or approx. 26% of the population in the UK. During drive tests and walk tests, each network's highest possible data and voice performance are measured under controlled circumstances. 3) Crowdsourcing – Over 24 weeks (May – November), approx. 2.7 billion data and voice connection samples from 670,000 users, representing 99.8% of the UK's population, were analyzed. The results of all three tests were thoroughly weighed to achieve a realistic and conclusive assessment of each network’s potential and performance.
The umlaut connect Mobile Benchmark is an independent evaluation that provides a detailed orientation to consumers and a fair, transparent and neutral evaluation and comparison of their networks' capabilities to management and supervisory boards of operators. It combines umlaut's expertise in measuring network performance with connect's long-standing editorial experience and knowledge in testing telecommunications products and services. First conducted in Germany more than 20 years ago, umlaut and connect since 2009 extended their mobile network benchmark to other European countries, including Austria, Netherlands, Spain, Sweden and Switzerland. In the UK, the benchmark was published first in 2014 and paused in 2020 because of the COVID-19 pandemic. It has become the de-facto industry standard for customer-perceived network quality.
The full umlaut connect Mobile Benchmark in the UK can be downloaded here: https://www.umlaut.com/en/stories/ee-wins-the-umlaut-connect-mobile-benchmark-in-the-uk-for-the-seventh-time or www.connect-testlab.com/united-kingdom
The press material can be downloaded here: https://filecloud.umlaut.com/Download/ee7067a54db07f63b65d2b919e3d76
