» ISP News » 

Broadband Forum Building More Accurate Open Source Speedtest

Monday, September 21st, 2020 (8:50 am) - Score 6,000

The Broadband Forum has kicked off the development of a new standards focused open source and User Datagram Protocol (UDP) based broadband speed test, which aims to deliver “more accurate results” and “updated methods and metrics which are more suited to the gigabit services now being deployed.”

Accuracy has always a problem with testing any kind of internet connection. For example, traditional web based speedtests can easily be impacted or polluted by issues such as slow WiFi, local network congestion (e.g. background updates or other users consuming bandwidth at the same time as the test being run) and various other problems (e.g. any limitations of the remote server used for testing).

One way around this is to place the testing equipment before the WiFi and have it run during periods of idle connectivity (i.e. low network traffic), which can usually be achieved by either installing a custom modified router into the network (e.g. the SamKnows approach, as used by Ofcom and Virgin Media etc.) or adding custom firmware code into the ISPs bundled broadband router in order to do the same (as used by BT and other ISPs).

Many of these testing systems tend to harness the Transmission Control Protocol (TCP), which defines how to establish and maintain an IP network communication through which software programs can exchange data, but the forum notes that they become “less accurate” at speeds over 500Mbps. Some tests may also harness a bit of UDP, which is better at creating low-latency and loss-tolerating connections between internet applications.

At first glance this might suggest that the Broadband Forum’s decision to focus on UDP (with a touch of Google’s QUIC) is intended to target issues of latency and connection reliability, instead of raw data speed, but they actually plan to tackle both via what they’re calling the UDP-based IP Capacity metric (PDF). The forum claims that this new tool will “enable the replacement of many existing test tools, some running over TCP.”

broadband forum udp speedtest tool results

At present we still know very little about the underlying approach and implementation plans for this. The forum merely states that the speed test’s adoption will be fostered through an open source implementation, with the base running code provided by a US network operator, AT&T. Several major international and US operators are also already signed-up and backing the project.

Robin Mersh, CEO of the Broadband Forum, said:

“User experience is at the core of any service provider’s offering, and today’s consumers expect their broadband service to deliver speed, low latency and seamlessness. A benefit to both providers and consumers, the UDP Speed Test is a game-changer, providing a criterion to ensure next-generation networks meet industry-wide expectations and can deliver the connected services we consume every day.”

Internet service providers are currently facing increasing regulatory demands to provide consumers with efficient demonstration of their maximum subscribed speeds, which is likely to be what has driven the forum to kick-start development of the new tool. We suspect this sort of tool would work best inside the code of a broadband router.

In the meantime, the Broadband Forum is planning to host a webinar to discuss this on 21st October 2020 (here).

Leave a Comment
9 Responses
  1. Avatar NE555 says:

    What they are really building is a tool to make the ISP look good.

    TCP’s congestion control algorithm is very sensitive to packet loss: a dropped packet is considered an indication of congestion and causes the speed to back off. There’s a formula for it here:


    Current speed tests mask this by running 4, 6 or more TCP streams concurrently, each of which responds to packet loss in the same way but the total bandwidth consumed is higher.

    UDP doesn’t have congestion control, so they can happily fill the pipe at gigabit speed, and who cares about a few dropped packets along the way? Except of course, most of the real-life applications that you actually care about use TCP.

    1. Avatar CarlT says:

      ‘The UDP-based measurement of Maximum IP Capacity simultaneously measures the packet loss, round-trip delay, delay variation, and reordering present. This is superior information to that provided by TCP and Ping measurements made separately.’

      As far as the Wikipedia link you provided goes most of us are using OS running CUBIC congestion avoidance to try and mitigate some of the shortcomings of standard TCP mentioned in the article.

  2. Avatar Sarcastic Wombat says:

    UDP gonna deliver more accurate test?
    Because all my file uploads and downloads are using UDP not TCP right..

    1. Avatar CarlT says:

      Speed tests aren’t representative of application performance at gigabit speeds anyway. They’re a dubious measurement of connection capacity, nothing more.

      Source: that basically nothing besides speed tests can get anywhere near maxing out either of my gigabit services as they aren’t intended to.

    2. Avatar Sarcastic Wombat says:

      CarlT torrents (copies of linux obviously) give me full dl speed (350mbit) and so does steam downloads, anything from microsoft/apple does.

    3. Avatar CarlT says:

      The torrents that, assuming you’re using a reasonably modern client, run at least partially over uTP?


      I mentioned gigabit for a reason. Neither MS, Apple or Steam saturate it in my experience.

      TCP has limitations, especially across distance and at higher capacities. Speed tests are measurements for measurement’s sake so may as well make them reflective of what you’re trying to test.

    4. Avatar Andrew Clayton says:

      > Because all my file uploads and downloads are using UDP not TCP right..

      Perhaps more than you think, especially going forward. Heard of HTTP/3 (QUIC)?

  3. Avatar Connor says:

    I know my ISP won’t be signing up to this, Excessive UDP makes their modem fall down and die.

    1. Avatar Andrew Clayton says:

      > I know my ISP won’t be signing up to this, Excessive UDP makes their modem fall down and die.

      Best get a new modem… the use of UDP is only going to increase…

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Comments RSS Feed

Javascript must be enabled to post (most browsers do this automatically)

Privacy Notice: Please note that news comments are anonymous, which means that we do NOT require you to enter any real personal details to post a message. By clicking to submit a post you agree to storing your comment content, display name, IP, email and / or website details in our database, for as long as the post remains live.

Only the submitted name and comment will be displayed in public, while the rest will be kept private (we will never share this outside of ISPreview, regardless of whether the data is real or fake). This comment system uses submitted IP, email and website address data to spot abuse and spammers. All data is transferred via an encrypted (https secure) session.

NOTE 1: Sometimes your comment might not appear immediately due to site cache (this is cleared every few hours) or it may be caught by automated moderation / anti-spam.

NOTE 2: Comments that break our rules, spam, troll or post via known fake IP/proxy servers may be blocked or removed.
Cheapest Superfast ISPs
  • Vodafone £22.00
    Avg. Speed 35Mbps, Unlimited
    Gift: None
  • Hyperoptic £22.00
    Avg. Speed 50Mbps, Unlimited
    Gift: None
  • Onestream £22.49 (*29.99)
    Avg. Speed 45Mbps, Unlimited
    Gift: None
  • xln telecom £22.74 (*47.94)
    Avg. Speed 66Mbps, Unlimited
    Gift: None
  • Plusnet £22.99 (*36.52)
    Avg. Speed 36Mbps, Unlimited
    Gift: £55 Reward Card
Prices inc. Line Rental | View All
The Top 20 Category Tags
  1. FTTP (2823)
  2. BT (2796)
  3. FTTC (1795)
  4. Building Digital UK (1760)
  5. Politics (1689)
  6. Openreach (1644)
  7. Business (1457)
  8. FTTH (1341)
  9. Mobile Broadband (1256)
  10. Statistics (1253)
  11. 4G (1081)
  12. Fibre Optic (1072)
  13. Wireless Internet (1037)
  14. Ofcom Regulation (1029)
  15. Virgin Media (1021)
  16. EE (714)
  17. Vodafone (683)
  18. Sky Broadband (676)
  19. TalkTalk (674)
  20. 5G (539)
Helpful ISP Guides and Tips

Copyright © 1999 to Present - ISPreview.co.uk - All Rights Reserved - Terms , Privacy and Cookie Policy , Links , Website Rules , Contact