Takeaways & Observations

© Internet Society / Nyani Quarmyne / Panos Pictures

What Is Consolidation? Impact Analysis

Key Features of the Consolidation of the Internet Economy

This section looks more closely at some of the features of the consolidation of the Internet economy. We uncovered 5 key features during the course of the research, which raised a broad span of issues, including how consolidation might shape the user experience, its impact on innovation, to how governmental or other stakeholders might respond to it. While not exhaustive, the list of considerations below helps us understand how consolidation trends in the future might impact the Internet and its users.

Download Takeaways & Observations

Download Full Report

Share with a friend:

Total Service Environments

© Sven Read / Unsplash

Summary

  • Many Internet platforms are expanding into new service and content areas, both to retain customers and to continue to grow revenues.
  • Total service environments for business and innovators operate at a scale that will allow entrepreneurs to do things they couldn’t otherwise. This includes accessing a much larger customer base, as well as resources and expertise that no small business could tap on its own with limited resources or time.
  • Platform environments unleash huge opportunities, but because innovation and entrepreneurship remain within the platform, competition to the dominant players will effectively be neutered.

Total service environments; the convenience of a one-stop shop

While some companies dominate their original markets such as search, e-commerce, and messaging, their increasingly diversified service offerings are overlapping and starting to compete in other markets. Search-oriented Google, for example, is trying to capture more of e-commerce, as is Facebook. The consumer-to-consumer Facebook Marketplace competes with eBay. Similarly, Google and Amazon compete for the smart home and smart device market, along with Samsung and Apple.

At the same time, how people spend their time when using the Internet is evolving. For instance, in some regions, young people may be spending less time on social media and more on and gaming platforms.1Limelight Networks (2018). The state of gaming – 2018. Available at: https://www.limelight.com/resources/white-paper/state-of-online-gaming-2018/. As they expand their reach and services, many platforms will compete with each other more directly, trying to leverage their dominance in one service or application space to quickly build a presence in another.

In content provision, as it is broadly defined, Internet platforms and telecommunications and media players such as AT&T/Time Warner are likely to work hard to retain and grow their customer bases, offering increasingly tailored content and services to meet their users’ demands for content. Many Internet platforms compete with each other and with the traditional media players: from Google’s YouTube, to Amazon’s Prime and studio offerings, to Facebook’s Facebook Watch, Disney, Oath, and Netflix, alongside telecommunications/content licensing deals such as India’s Eros and China’s iQIYI,2Frater, P.  (2018, September 10). India’s Eros Strikes Content Deal With China’s iQIYI. Variety. Available at: https://variety.com/2018/digital/news/india-eros-strikes-content-deal-with-china-iqiyi-1202934188/. Alibaba’s Tmall Box Office,3Mendoza, M. (2015, June 15). Tech Times, Alibaba's Tmall Box Office Will Be Netflix And HBO Of China. Tech Times. Available at: https://www.techtimes.com/articles/60419/20150615/alibabas-tmall-box-office-will-be-netflix-and-hbo-of-china.htm. Safaricom’s Iflix partnership,4Njanja, A. (2018, February 26). Safaricom customers to enjoy free iflix content for 2 months. Daily Nation. Available at:  https://www.nation.co.ke/business/Safaricom-customers-to-enjoy-free-iflix-content/996-4320936-ocovyv/index.html. and numerous Over-the-Top (OTT) Video on Demand partnerships all over the world.

In China, the Alibaba consumer-focused financial spin-off Ant does everything from mobile payments to life insurance, credit, investments, and savings. For many of its users, it has become a financial one-stop shop.5CNBC (2018).  How Ant Financial grew larger than Goldman Sachs.  Available at: https://www.cnbc.com/2018/06/08/how-ant-financial-grew-larger-than-goldman-sachs.html WeChat, the original “app for everything,” focuses on “everything from point-of-sale purchases to accessing public services – (and) is likely the template that other social platforms around the world will emulate as they strive for more thorough integration with their users’ lives.”6World Economic Forum (2018). The social media universe in 2018. Available at: https://www.weforum.org/agenda/2018/08/visualizing-the-social-media-universe-in-2018. WeChat is owned by Tencent, whose platforms, which include WeChat/Weixin, QQ, Qzone, Tencent Video, and Tencent News, capture more than 55% of Chinese consumers’ mobile Internet usage.7Cision PR newswire (2018, September 21). Tencent And WeChat Deliver New Ways For U.S. Marketers To Directly Engage Nearly One Billion Chinese Consumers. Available at: https://www.prnewswire.com/news-releases/tencent-and-wechat-deliver-new-ways-for-us-marketers-to-directly-engage-nearly-one-billion-chinese-consumers-300523571.html. Tencent provides a one-stop shop with everything from “social networking to gaming, digital assistants, mobile payments, cloud storage, education, live streaming, sports, movies, and artificial intelligence”.8Marr, B. (2018, June 4). Artificial Intelligence (AI) In China: The Amazing Ways Tencent Is Driving It's Adoption. Forbes. Available at: https://www.forbes.com/sites/bernardmarr/2018/06/04/artificial-intelligence-ai-in-china-the-amazing-ways-tencent-is-driving-its-adoption/#2f8548c3479a.

With the evolution and proliferation of IoT and technologies like voice-controlled devices, these total service environments are intertwining more with our physical lives. Our homes, cars, roads, hospitals, and more will form greater connected ecosystems as ubiquitous computing and networking evolve. Users may choose the platform’s own offerings over niche providers because one-stop shops can provide a better and more convenient service, driven by scale and pooled resources.

© Internet Society / Nyani Quarmyne / Panos Pictures

Choice by default

The success of a total service environment is the consequence of the ability to provide a range of services that users believe or know they need. Much of this success is driven by convenience and by providing easy access to useful and targeted products and services. Platforms grow ever more “sticky, understood as their ability to retain users, with AI-tailored hyper-personalised services and business strategies that seek to capture the users of today and tomorrow.

Platform stickiness is driven by the idea of default: users often stay with a search engine, social media platform, or cloud-based business services because it’s convenient or because of necessity. Becoming a default platform increases the potential of retaining users for longer periods of time, which means the platform can gather ever more data to be used for targeted advertisement and further improving the service. This path towards becoming the default provider occurs through different ways, and largely by design:

  • Default options on devices or in software might not seem difficult to change for many Internet users, but many users will refrain from taking the extra effort needed to figure out how to switch. But remaining with a particular platform reinforces that platform’s dominance. Google is the default search for Apple’s Safari, Mozilla’s Firefox (replacing Yahoo), and the Siri smart assistant. Google is also the default search service on the Android mobile operating system and platform. Google developed Android and it is now used in more than 86% of mobile phones around the world.9Miller, C. (2016, August 18). 9To5Mac, Latest Gartner data shows iOS vs Android battle shaping up much like Mac vs Windows. 9to5Mac. Available at:  https://9to5mac.com/2016/08/18/android-ios-smartphone-market-share/. Applications having Google as the default search engine reinforces its dominance and drives its advertising revenues.
  • The popularity of smart voice assistant devices means there’s less of a need for people to use a smartphone or computer or use a particular service to buy something online. One can simply speak out loud and the service-provider’s fulfilment centre instantly takes an order. If users don’t adjust the settings and ask for a specific music service on an Amazon Echo, for example, it will automatically use Amazon’s own music service.10Chaudhuri, S. & Terlep, S. (2018, February 27). The Next Big Threat to Consumer Brands (Yes, Amazon’s Behind It). The Wall Street Journal. Available at: https://www.wsj.com/articles/big-consumer-brands-dont-have-an-answer-for-alexa-1519727401.  

This strategy of default and nudging users to one’s own products is not new, but it illustrates the power inherent in controlling the platform through which other services and products are accessed. With the evolution of more personalised services powered by personal data that can anticipate our needs, this power of default will become even more important. For the user, it can have great advantages, but it can also impact competition and choice in ways that will become more pronounced in the future.

As the platforms expand, they acquire companies that might have become a future competitor: the largest US tech platforms have acquired hundreds of start-ups in the last 10 years.11Dwyer, P. (2017, July 20). Bloomberg BusinessWeek, Should America’s Tech Giants Be Broken Up? Bloomberg Business. Available at: https://www.bloomberg.com/news/articles/2017-07-20/should-america-s-tech-giants-be-broken-up.  Customers moving from one service to another, although somewhat different, may merely be moving to a differently branded service of the same platform:

© Internet Society / Nyani Quarmyne / Panos Pictures

These types of acquisitions have led some tech investors to claim there is a kill zone around the top 5 American technology platforms. This kill zone lessens the incentives for investors to look for potential competitors to the dominant platforms, undermines competition generally, and leads to the ossification of the market through the perpetuation of the one-stop shop and default service. Ultimately, the kill zone enables the continued dominance of the current players.17The Economist (2018, June 2). American tech giants are making life tough for startups. Available at: https://www.economist.com/business/2018/06/02/american-tech-giants-are-making-life-tough-for-startups; Schechter, A. (2018, May 23). Google and Facebook’s “Kill Zone”: “We’ve Taken the Focus Off of Rewarding Genius and Innovation to Rewarding Capital and Scale”. ProMarket (Stigler Center blog). Available at: https://promarket.org/google-facebooks-kill-zone-weve-taken-focus-off-rewarding-genius-innovation-rewarding-capital-scale/.

Total service environments are becoming de facto platforms for new and evolving businesses

Total service environments extend both vertically and horizontally to serve the ever-growing range of needs of business users and technological innovators. Amazon provides cloud services through its Amazon Web Services (AWS), as does Microsoft through Microsoft Azure. Google extends through its own cloud offerings and content delivery network services (CDNs). Beyond servicing large companies and government agencies, these services offer small and emerging businesses and innovators compelling access to infrastructure and expertise, along with functionality.

The ambition of the large Internet platforms does not stop there. Through digital assistants, drones, connected cars, smart homes, and smart cities – all underpinned by increasingly sophisticated AI — they are building their capacity across multiple domains, securing the footprint and developing a range of services to ensure that they remain the preferred total service environments of the future.

Platforms strive to keep innovation within their services ecosystems. The recent product launches from Amazon at their re:Invent 2018 conference18Barr, J. (2018, November 28). AWS Launches, Previews, and Pre-Announcements at re:Invent 2018 – Andy Jassy Keynote. Available at: https://aws.amazon.com/blogs/aws/aws-previews-and-pre-announcements-at-reinvent-2018-andy-jassy-keynote/. provide several examples of this dynamic at work. The larger platforms recognise that capturing innovation within their platforms not only drives their own functionality and popularity, but also identifies and channels innovations that have the potential to be disruptive and competitive. While platform driven APIs and SDKs provide great opportunity and access to markets for developers, they also help ensure that future content, gaming, and other services remain mostly within the platform.

The trend towards a total service environment is an attractive choice for many businesses and innovators. The savings and operational benefits that accompany the services of a single provider, from productivity suites to cloud services and the ability to outsource business infrastructure and services, are considerable. But at the same time, outsourcing to a single provider builds a dependency on the platform offering the services, creating a potential lock-in and vulnerability to business and systems-wide cyber threats. A recent debate around whether the US Department of Defense should use a single cloud services provider highlights concerns related to adopting a single-vendor solution.19The Next Web (2018). Pentagon remains hellbent on using a single-provider cloud for Project JEDI. Available at:  https://thenextweb.com/google/2018/11/14/pentagon-remains-hellbent-on-using-a-single-provider-cloud-for-project-jedi/

© Hossein Fatemi / Panos Pictures

AI, the competitive frontier

AI will be an important element for online businesses in the next decade, including data-driven platforms’ ability to attract and retain users, as it enables platforms to provide users and business customers with more value by continuously tailoring responsive products and services. Scale – and related access to data and resources – may be key to unlocking AI and maintaining platform “stickiness” to keep users in one-stop shops indefinitely. Examples of how AI is currently being pursued to attain a competitive edge include:

Are one-stop shops inevitable?

Most users can benefit from the tremendous convenience, versatility, and deep wealth of offerings of the one-stop shops. It is usually much easier to navigate within an environment of services provided by 1 player than to find everything we want or need independently. With the move to voice-controlled devices our interactions will become even smoother. That said, one-stop shops could also constrain the potential for new market entrants, limiting the opportunity and impact of disruptive innovation outside of the proprietary platform environments.

A question arises at this stage: Is the one-stop shop inevitable, or is there a path towards an Internet economy in which there’s a greater diversity of players that are more competitive and innovative?

© Internet Society / Nyani Quarmyne / Panos Pictures

Interoperability as a Function of Scale

© Roopa Gogineni / Panos Pictures

Summary

  • The nature of an open, collaborative, and interoperable Internet is influenced by a small number of large companies, where organisational scale and market share play a significant role in the development and deployment of the open technical standards on which the Internet depends.
  • Large organisations can accelerate the adoption of existing but under-deployed standards like IPv6 and push the development and testing of new standards, benefitting the Internet as a whole.
  • The growing use of APIs puts more of the Internet’s innovation, functionality, and interoperability into the hands of the dominant Internet platforms, whose interests may not always align with those of the broader technical community and other players.   
  • Future innovation, services, and applications may depend on the availability of a small set of proprietary platforms and services, rendering those applications less resilient, reliable, and capable of supporting further innovation.

A dumb network

The Internet’s architecture is unusual because of the nature of “inter-nets”: they are networks of networks, and the Internet spans the whole world. Because each network operates autonomously, (hence “Autonomous System”), there is no central authority to determine what a network might or might not do. But to make each node in each network operate tolerably with other nodes (nodes that might be in other networks), we need common protocols. It emerged that the best way to operate in such an environment is to place as much functionality as close as is practical to the “end” of communication;25Saltzer, J.H.; Reed, D.P. & Clark, D.D. (1984). End to end arguments in system design. ACM Transactions on Computer Systems, vol. 2(4):277-288. Available at: http://web.mit.edu/Saltzer/www/publications/endtoend/endtoend.pdf. sometimes called the “end-to-end” architecture.

It is also sometimes called the smart endpoint design, and distinguished from the smart network design typical of the traditional telephone network: in the former, most of the ability to work with the network resides at the endpoint (with the network basically just carrying messages). In the latter, the ability to work with the rest of the network resides in the middle of the network, and the end points are dumb clients, which means that their functionality is fully dependent on connecting to a central server. The end-to-end architecture is one of the key enablers of the development of the Internet economy over the past 3 decades.

Another feature of the Internet’s technical architecture is its independence from pre-existing contractual relationships among all parties. Any party using the Internet can talk to any other party, without permission from intermediary networks, as long as each conforms to the relevant protocols for the network’s intercommunication. Combined with a smart endpoint design, this architecture enables permissionless innovation, because nobody else on the Internet needs to change anything in order that 2 end points use some new network application.

Just as shared languages enable people to cooperate, build communities and exchange ideas, the use of open and globally interoperable protocols has enabled the Internet to grow into the network of networks it is today.

However, the impact of a consolidating Internet economy on the development and deployment of protocols for interoperability indicates that scale is not just a source of efficiency, but also a source of power.

© Internet Society / Nyani Quarmyne / Panos Pictures

84% of our survey respondents identifying as “Technical Community” had noticed larger players in the Internet Economy increasingly influencing standardization for networking, technology, software, and interoperability.

Scale drives the adoption of standards

Open standards are the basis of the Internet’s success, but adoption requires investment, which can result in sluggish take-up. While many agree that IPv6 is important and beneficial to the Internet as a whole, individual organisations have hesitated to invest in the hardware, technical expertise, and possible changes to network operations that are required. Without a significant deployment of IPv6 in the Internet overall, there have been fewer incentives to adopt it because the benefits were seemingly outweighed by the costs of dual-stack deployment.26Because IPv6 and IPv4 are not directly interoperable, the adoption of IPv6 has been dependent on a dual-stack deployment approach where IPv6 is deployed in parallel with IPv4 on all infrastructure and services and then automatically used in preference to IPv4, whenever possible.

Large organisations, including network operators and content providers, have addressed this challenge, adopting IPv6 in a coordinated way.27See: World IPv6 Launch: http://www.worldipv6launch.org/. Since the World IPv6 Launch began in mid-2012, IPv6-enabled connections from Internet users to Google services have increased from less than 1% to more than 25%.28Google (n.d.). IPv6 statistics. Available at: https://www.google.com/intl/en/ipv6/statistics.html. While it is difficult to determine exactly how much of that growth was stimulated by the intentional movement of very large organisations, or whether growth was inevitable due to IPv4 shortages, the effect has been significant. Since at least mid-2012, several major operators now deliver the majority of traffic from major content sources like Google, Akamai, and others over IPv6.29Ford, M. (2017, June 6). Landmark IPv6 Report Published: State of Deployment 2017. The Internet Society. Available at: https://www.internetsociety.org/blog/2017/06/landmark-ipv6-report-published-state-of-deployment-2017/.  

In addition to directly adopting a particular standard themselves, big players can also nudge others to adopt standards that benefit the Internet as a whole. Google displays a “Not Secure” warning in the Chrome browser’s address bar if a user connects to an unencrypted website, incentivizing websites to use HTTPS30HTTPS is an encrypted version of HTTP that provides increased privacy and security for communications on the Web.. In a similar push to service providers to do the right thing, Apple requires all apps on its iOS AppStore to be IPv6 compatible.

Scale and market share therefore imply that when big players in the Internet economy decide to support a new standard, they can accelerate and spread its adoption and ultimately change the incentives for others to do the same.

© Atul Loke / Panos for Internet Society

Scale drives standards development, too

In a network of networks, there is no centre of control because there is no centre: each network does what it wishes according to local needs. As such, there is no way to impose a common standard. It is only possible to invite participation in a standard protocol according to the wants and needs of others. The inter-network’s participants therefore use an open standards development process to reach consensus on communication protocols.31Fältström, P. (2016, May 20). Market-driven Challenges to Open Internet Standards. Centre for International Governance Innovation. Available at: https://www.cigionline.org/publications/market-driven-challenges-open-internet-standards. Because expertise and resources are necessary for people to engage effectively in standards processes, large corporations, universities, and other influential organisations have always played prominent roles. Competitive markets that exist outside the standards process has generally meant that the interest of particular businesses in influencing particular protocols was offset by rivals. But just as scale is important for deploying standards, it is also an important and growing factor in developing standards, too.

HTTP/3 is a new protocol based on QUIC, a protocol initially developed by Google, and now under consideration for standardisation by the IETF. HTTP/3 reduces the time for establishing a connection for IP traffic without compromising security, and has the potential to benefit the Internet as a whole. Google’s role in originating the protocol was enabled by its significant resources and expertise. The company’s enormous size allowed it to test QUIC on a global scale using its browser, Chrome, and its servers for popular services including YouTube. The fact that it controls both the browser platform and the service being delivered is a tremendous benefit in analyzing Internet usage and experimenting, developing, testing, and deploying potential improvements. However, it is also an example of how its significant browser and content provisioning market share provides it with unique resources that few can match.

An example of how 2 companies could change the dynamic of a bigger technical ecosystem is “DNS over HTTPS” (DoH). Mozilla is championing DoH, a protocol for doing DNS resolution via HTTPS32DNS Queries over HTTPS (DoH), RFC 8484. Available at: https://datatracker.ietf.org/doc/rfc8484/, and testing it in partnership with Cloudflare.33Deckelmann, S. (2018, September 13). DNS over HTTPS (DoH) – Testing on Beta. Mozilla. Available at: https://blog.mozilla.org/futurereleases/2018/09/13/dns-over-https-doh-testing-on-beta/. DNS data can be sensitive from a privacy perspective and DoH seeks to improve user privacy by encrypting DNS requests using HTTPS. On the one hand, this development appears increase the privacy of user data. On the other, it would be possible for a web browser to select a single DoH provider as the default option to handle all requests. In that case, it would concentrate a great deal of information about that browser’s users under the control of a single DoH provider. This might happen without user intervention, and if it happened in a web browser with large market penetration it could change the effective privacy properties of a large fraction of global DNS requests, while changing the trust model of the DNS itself.

© Atul Loke / Panos for Internet Society

APIs can operate less like the Internet and more like a monolithic system

New services and applications on the Internet increasingly depend on their ability to interoperate with third-party services made available through an application programming interface, or API. A public API is an interface to functionality of a third-party service. APIs intended for use in this fashion are publicly specified, (e.g., the Google Street View API34See: https://developers.google.com/maps/documentation/streetview/intro.  There are “private” APIs and APIs that are covered by non-disclosure agreements, but they are less relevant to this discussion.).

In some ways, network protocols and APIs are similar, but there is an important difference. A protocol must be agreed to by everyone who uses it. An API is under the control of the entity that owns the “A”: the application with which one interfaces.

On the Internet, APIs have implications for change control. In an open standard, the interested community has a say about changes to the interface defined by the standard. APIs can be made publicly available, (e.g., by publishing the specifications for use), but unilateral control of changes always remains in the hands of the application owner who publishes the API. Greater dependence on an API for Internet-facing functions may therefore entail greater control by the API owner as to what is possible on the Internet, as well as a corresponding reduction in the reliance on open protocols.

© Internet Society / Nyani Quarmyne / Panos Pictures

Will new protocols, standards, or practices championed by large organisations have positive effects for all or only some?

New protocols, standards, or practices championed by influential organisations could have significant effects. Some impacts could be positive, such as overcoming market failure in adoption and the ability to widely test protocols before full deployment. But others may be negative. This evolution might benefit small numbers of players or concentrate traffic flows, with possible adverse effects on competition or even privacy. While the Internet may benefit from specific developments, the ability of small numbers of huge organisations to be benevolent rule-makers while everyone else is a rule-taker could concentrate power on or over the Internet.

Interoperability has been fundamental to how the Internet has evolved and why its many uses and innovations have flourished. But while the Internet will continue to enable new and interoperable services and applications in the future, innovation might be concentrated where value is readily available, on a small set of proprietary platforms. Are users locked into 1 or 2 platforms really benefiting from all the opportunities the Internet has to offer, or are they merely using the Internet for transport?

This evolution raises several questions: Will new protocols, standards, or practices championed by especially large organisations have positive effects for all or only some? How will concentration affect the development of standard and non-standard protocols on the Internet?

The Internet was envisioned as a decentralised network which facilitates communication between two endpoints. However, a discussant pointed out that the landscape of network traffic is wholly different now: video streaming makes up a significant chunk of the traffic now, with Cisco estimating the 80% of the Internet Protocol traffic will be video by 2021.96https://www.cisco.com/c/en/us/solutions/service-provider/visual-networking-index-vni/index.html Since video hosting is dominated by a few companies such as Youtube, Netflix, and Facebook, there has been an emergence of “super-nodes” in the Internet. This has been followed by a concerted effort to be efficient at meeting such consumers’ needs, which further contributes to changing the network topology. For example, several companies employ edge caches at various Internet Service Providers (ISPs) to optimise user performance. — Regional panel report, The Centre for Internet and Society, India

A Changing Internet Topology

© Johannes Groll / Unsplash

Summary

  • The ability of a small number of content and cloud services to invest in their own networks and deploy their servers close to the broadband network edge is amplifying the existing trend of a flattening Internet, where access networks are increasingly interconnected and have less need for international transit.
  • Access networks are evolving rapidly, driven by the Internet of Things (IoT) deployments and other demands for processing on a range of user devices, including evolving technologies such as autonomous vehicles.
  • Big cloud providers like Amazon, Alibaba, Google, and Microsoft are well-placed to dominate the new era of IoT and edge computing, further driving a changed Internet topology with less international transit and more complex, private, specialised networks and services. This could come at the cost of the general-purpose Internet.

A flattening Internet

As access networks increase their interconnectedness and the need for transit decreases, the Internet’s topology is flattening. Geoff Huston, Chief Scientist at APNIC,35APNIC, or the Asia Pacific Network Information Centre, is an open, membership-based, not-for-profit organisation providing Internet addressing services to the Asia Pacific. For more information, see: https://www.apnic.net. calls this "the death of transit."36Huston, G. (2016, October 28). The death of transit? APNIC. Available at: https://blog.apnic.net/2016/10/28/the-death-of-transit/. He is describing how the current, denser mesh of access networks is driven by Internet Exchange Points (IXPs) that facilitate peering arrangements, as well as the ability of access networks to peer directly with content delivery networks (CDNs). This flattening will continue as activity to develop access networks intensifies to facilitate IoT deployments and the processing of real-time applications.

Flattening is not an inherent consequence of consolidation trends, but is strengthened and shaped by a small group of content and cloud providers with the ability to deploy content delivery caches globally. Caches, in turn, become more effective and useful by the increasing numbers of IXPs, which tend to interconnect access networks and concentrate the points where transit needs to be provided.

© Internet Society / Nyani Quarmyne / Panos Pictures

67% of our survey respondents expect consolidation to significantly shape the evolution of the Internet in the next five years.

A global network of data centres

As we saw in the previous section, large content and cloud providers are investing in their own international connectivity infrastructure to serve their networks of data centres and servers across the globe. TeleGeography estimates that the capacity deployed by a small set of content providers is growing faster than all other customers of international bandwidth and may become the largest share of used international bandwidth as Internet backbone providers’ share decreases.37Mauldin, A. (2017, November 9). A complete list of service providers’ submarine cable holdings. TeleGeography. Available at: https://blog.telegeography.com/telegeographys-content-providers-submarine-cable-holdings-list.

InternetSociety-Used-International-Bandwidth

Underpinning the trend of content and cloud providers investing in their own infrastructure is the dominance of a small set of providers in the application layer, predominantly Google, Facebook, Amazon, and Microsoft. Their services rely on a global network of interconnected data centres and servers to process and deliver content closer to the users.38Miller, J. (2018, May 25). Want to understand content providers’ priorities? Look at where they’re building cables. TeleGeography. Available at: https://blog.telegeography.com/content-providers-google-submarine-cables-bandwidth-market-junior-curie. With the exception of Facebook, these providers are also competing in the market for cloud computing. Having a large customer base in the application layer supports investment in infrastructure to serve both those customers and users of service infrastructure.

Infrastructure investments by the large platforms are being driven by ever-increasing traffic between their data centres as cloud-based applications and services continue to grow. Cisco estimates that global traffic between data centres will grow by 32.7% annually between 2016 and 2021, a higher growth rate than the traffic between data centres and the users, which is projected at 25.2%.39Cisco (2018, November 19). Cisco Global Cloud Index: Forecast and Methodology, 2016–2021 White Paper. Available (for purchase) at: https://www.cisco.com/c/en/us/solutions/collateral/service-provider/global-cloud-index-gci/white-paper-c11-738085.html. This trend has been driven by CDNs and the need to disseminate large volumes of static content closer to the user, such as images and video. In the near future, however, evolving services where processing moves closer to the end user or device will likely dominate traffic growth.

© Internet Society / Nyani Quarmyne / Panos Pictures

In the digital networking world, we are seeing more and more data traffic go ‘dark’. Content service operators are using their own transmission systems or slicing out entire wavelengths from the physical cable plant. This withdrawal of traffic from the shared public communications platform is now not only commonplace, but the limited visibility we have into this activity suggests that even today the private network traffic vastly overwhelms the volume of traffic on the public Internet. And the growth trends in the private data realm also is far greater than growth rates in the public Internet. — Geoff Huston, RIPE NCC, December 2018

An evolving edge

Access networks and access devices — the edge of the Internet — evolve rapidly, with many and varied devices connecting to new services, potentially using specialised networks, driven in large part by the IoT. 5G cellular network standardisation and deployment are partially driven by anticipated uses that depend on bespoke access networks with much greater processing capabilities in base stations close to mobile terminals. It is not yet clear how much of the 5G vision will be realised in practice, but it is at least possible that 5G deployments will increase the tendency for access network specialisation and the growth of edge computing. Of course, neither of these tendencies form part of an Internet approach to networking.

Some processing is better done on the device or at data centres closer to the user. Facial recognition in Apple’s recent iPhone X is processed on the device and not performed in the cloud.40Apple (n.d.) About Face ID advanced technology. Available at: https://support.apple.com/en-us/HT208108. Some applications dependent on AI and machine learning need to be trained on data from local environments. In most cases, however, speed is a key concern. Real-time applications such as self-driving cars cannot afford the time it takes to have decisions processed in the cloud.

The evolution of edge computing is not a substitute for cloud computing in large data-centres, but rather a complement that facilitates the needs of some applications to use both types of computing resources. While some applications powered by AI need edge processing to make inferences on the device, they still rely on data models trained with the cloud’s abundant processing power and enormous amounts of data.

While the evolving edge of the Internet is a new frontier that could see new entrants, large cloud providers like Amazon, Alibaba, Google, and Microsoft may be in a favourable position to dominate the new era of IoT and edge computing. Ownership of the underlying infrastructure is one advantage, as is provisioning the platforms for the development of new applications. Microsoft’s new slogan, “intelligent cloud, intelligent edge”41Nadella, S. (2018, March 29). Satya Nadella email to employees: Embracing our Future: Intelligent Cloud and Intelligent Edge. Microsoft. Available at: https://news.microsoft.com/2018/03/29/satya-nadella-email-to-employees-embracing-our-future-intelligent-cloud-and-intelligent-edge/. is an attempt to capture this trend. Services like Amazon Greengrass,42See: https://aws.amazon.com/greengrass/. or Google Cloud IoT Edge,43See: https://cloud.google.com/iot-edge/. are all intended to support developers to deploy new applications that require processing in access networks. Google has even launched a new chip, the Edge TPU, which is specifically designed to optimise machine-learning inference on the edge computing device itself.44Vincent, J. (2018, July 26). Google unveils tiny new AI chips for on-device machine learning. The Verge. Available at: https://www.theverge.com/2018/7/26/17616140/google-edge-tpu-on-device-ai-machine-learning-devkit.

© Internet Society / Nyani Quarmyne / Panos Pictures

Will the deployment of new infrastructure support the general-purpose Internet for everyone?

The trend of localizing content, and the growing complexity of specialised networks and purpose-built services, will drive the Internet topology towards a more densely connected mesh. This trend towards a more densely connected network has in the past been positive in how it improved the delivery of content, and reduced overall traffic costs. But we must consider how the continued flattening of the Internet disrupts economic models of the past.

Several questions arise: Will traffic in access networks be driven by large content and cloud providers feeding their localised infrastructures via private networks? Does this mean that a smaller player, depending on transit and therefore subject to longer latency, will necessarily lose out? Will the deployment of new infrastructure support the general-purpose Internet for everyone, or could the Internet fade into the background as the evolving edge is captured by a small set of private networks and services designed for a few operators?

© Atul Loke / Panos for Internet Society

61% of our survey respondents said consolidation is likely to impact the scale and severity of cyberattacks and cybercrime in the next five years.

Deep Dependencies

© Internet Society / Nyani Quarmyne / Panos Pictures

Summary

  • Central to the Internet’s success has been its ability to evolve, as captured by the characteristic of “no permanent favorites” where no specific company or technology is above disruption, evolution and competition. This characteristic could be challenged as dependencies continue to grow.
  • The development of new applications, services, and businesses across the global economy is increasingly dependent on a small number of private platforms owned by the largest Internet companies. While the risk of catastrophic failure may be very low, consequences of failure could create a domino effect for other parts of the global economy.
  • As platform environments expand further, entering and often dominating more sectors and markets, combined with an exceptional economic power, there is a risk of growing societal dependencies on a handful of powerful economic actors.

The largest Internet platforms are expanding horizontally from dominance in their core areas — search, social, operating systems, e-commerce — into new economic sectors like health, automobiles, or even urban infrastructure. While the success of such horizontal expansion remains to be seen, these companies are also expanding vertically, through the application, infrastructure, and access domains of the Internet economy.

Governments rely on these companies for service procurement, and at least one, Alphabet, has a stated goal to improve traditionally public services.45Wired (2017).  Alphabet Is Trying to Reinvent the City, Starting With Toronto.  Available at: https://www.wired.com/story/google-sidewalk-labs-toronto-quayside/ If this trend continues, future societies may become dependent on a small number of companies providing much of the backbone for daily life and becoming too big to fail.

“Too big to fail” is what happens when the potential consequences of a single organisation’s failure are so severe they create systemic risk. In one example context, it could mean risk to the economic system as a whole. This is one of the reasons why some governments stepped in to bail out or guarantee failing banks during the global financial crisis in 2007 and 2008. Could a few Internet companies become so central to how we do business, deliver public services, and sustain social and political life that the failure of one could create cascading effects throughout the economy as a whole?

Cascading effects would likely only occur if the platforms’ services were not substitutable. This would mean that when the service failed, those depending on it were not able to find and implement a replacement. While the likelihood of such a crisis is speculative, its potential consequences are vast and unpredictable. Will our growing dependence on the largest Internet companies motivate a wider concern to ensure they survive, no matter what? This could unintentionally hamper the continuing technological and business innovation the Internet supports, effectively creating permanent favourites.

API-driven dependencies

A platform’s SDKs and APIs, which provide access to functionality of a service or platform, are increasingly important building blocks for technology and business innovation. APIs are often used by an application that, in turn, is used by another application, and so on. If an API fails, changes its conditions, or shuts down, it will likely harm all dependent businesses built on top of it. The resultant harm could range from negligible (such as when a service is easily substituted) to severe or critical (such as when a service is otherwise completely unavailable or when the loss of the service does not completely break another service).

For example, the ride-hailing service, Uber, has been using Google Maps’ API to connect drivers and customers to routes and directions.46Hempel, J. (2018, June 13). How Maps became the new search box. Wired. Available at: https://www.wired.com/story/how-maps-became-the-new-search-box/. This integration was a critical part of Uber’s success, but it meant the company’s core activity depended on access to another firm’s API. The conditions for that access could change47Singh, J, (2018, August 28). Google Maps API price hike is threatening the future of some companies. Gadgets 360. Available at: https://gadgets.ndtv.com/apps/features/google-maps-apis-new-pricing-impact-1907242; ProgrammableWeb. (2018, August 26). Time to challenge Google Maps pricing. Available at: https://www.programmableweb.com/news/time-to-challenge-google-maps-pricin/elsewhere-web/2018/08/26. at any moment and abruptly alter or even hamper a company’s ability to operate. Uber’s investments and acquisitions of mapping technology is seen by some as a way to reduce the company’s dependency on the Google Maps and other APIs for its services.48Singh, ibid; Fitzpatrick, A. (2015, May 8). Here’s why Uber would spend $3 Billion on Maps. Time. Available at: http://time.com/3851639/uber-here-nokia-maps/; Smith, J. (2016, August 1). Uber to invest $500m in mapping project to skirt Google Maps: Report. ZDNet. Available at: https://www.zdnet.com/article/uber-to-invest-500m-in-mapping-project-to-skirt-google-maps-report/; Ashford, W. (2016, August 1). Uber plans own Google Maps amid merger with rival China. ComputerWeekly.com. Available at: https://www.computerweekly.com/news/450301589/Uber-plans-own-Google-Maps-amid-merger-with-rival-in-China.

The same type of dependency can be seen in applications developed in the cloud Platform as a Service (PaaS) market. PaaS offers an easily accessible software environment for operating systems and middleware that can include critical business functions like database management or specific AI/ML capabilities. If providers change the conditions, greatly increase the prices, impose unacceptable conditions, decide to abruptly terminate services, or simply fail to continue providing the functionality their client-businesses depend on, these businesses may fail and create a further cascade of failure elsewhere in the economy.

Service failures happen all the time. The core concern is not that of vertical integrated providers, which is expected in layered technologies, but substitutability, which becomes an issue when a service is proprietary such that alternatives cannot be had at any price. If a single provider has several such popular services that cannot be substituted, then it becomes critical to a broader range of economic activities, and may be too big to fail.49For a detailed discussion of interoperability and portability for cloud computing, see: Cloud Standards Customer Council. (2017, December). Interoperability and Portability for Cloud Computing: A Guide (version 2.0). Available at: https://www.omg.org/cloud/deliverables/CSCC-Interoperability-and-Portability-for-Cloud-Computing-A-Guide.pdf.

© Internet Society / Nyani Quarmyne / Panos Pictures

Governments may use single providers

Government departments and agencies may contract with large companies who can act as single providers of important systems. This allows governments to adopt the most up-to-date functionalities that citizens expect. The scale required often means only the biggest providers are suitable. For instance, cloud-based services from single providers like Google’s G Suite50See: https://gsuite.google.com/industries/government/. or Microsoft 36551See: https://products.office.com/en/government/office-365-web-services-for-government. are targeted to governments looking for broad and flexible solutions.

The U.S. Department of Defense has been criticised for considering use of a single provider, likely Amazon Web Services (AWS), to move its data to the cloud.52Gregg, A. (2018, August 5). Pentagon doubles down on ‘single-cloud’ strategy for $10 billion contract. The Washington Post. Available at: https://www.washingtonpost.com/business/capitalbusiness/pentagon-doubles-down-on-single-cloud-strategy-for-10-billion-contract/2018/08/05/352cfee8-972b-11e8-810c-5fa705927d54_story.html?noredirect=on&utm_term=.368ffbe41529; Williams, L.C. (2018, July 26). DOD releases $10 billion JEDI clod contract. Defense Systems. Available at: https://defensesystems.com/articles/2018/07/26/jedi-hits-the-street.aspx. This could create critical dependencies. While technical responses may mitigate the associated risks involved, and private sector provision of services to government is hardly new, it raises important questions about how much public institutions should become dependent on a small set of powerful actors in the Internet economy.

Could our increasing reliance on just a few companies in the Internet economy create critical dependencies, or make them too big to fail?

An important feature of the Internet’s success has been its ability to evolve, where no specific company or technology is above disruption, evolution, and competition. As the largest companies establish dominance in more markets and sectors of the economy, our dependence on them is growing, raising questions about what extent this feature still holds true. The reality is that some of the largest Internet companies are already more valuable than most governments on earth.53See: Rapier, G. (2018, September 4). Amazon becomes the 2nd US company to join the $1 trillion club (AMZN). Markets Insider. Available at: https://markets.businessinsider.com/news/stocks/amazon-stock-price-2nd-us-company-1-trillion-club-2018-8-1027506812. They are seemingly becoming the central locus of new innovations, services, and businesses across the global economy.

As we consider the future, several questions arise: Could our increasing reliance on just a few companies in the Internet economy make them too big to fail? Are there economic and technical dependencies on services that cannot be substituted that effectively create a set of permanent favourites?

© Internet Society / Nyani Quarmyne / Panos Pictures

The information superhighway cracks apart more easily when so much of it depends on privately owned infrastructure. An error at Amazon Web Services created losses of service across the web in 2017; a storm disrupting a data center in Northern Virginia created similar failures in 2012. — The New York Times, October 2018

Responses to Consolidation

© Jordi Ruiz Cirera

Summary

  • Responses to the negative effects of consolidation have been distributed across the applications, services, and access domains of the Internet economy; in different sectors, regions, and by different institutions.
  • Countries have adopted different strategies. Some have a higher tolerance for the risk of dominance if it also delivers Internet access and services, and they may have a traditionally lower tendency to regulate. Others, such as those in the European Union, are mobilizing more concerted, cross-agency responses (often spanning competition, consumer protection, and data protection regulators).
  • Similarly, different stakeholder groups have also focused on different issues as far as dominance is concerned.

Examples of government responses

As awareness grows of the potential economic, developmental, and social benefits of the Internet, as well as its challenges, governments around the world have taken increasingly interventionist, but also diverse, stances to dominant actors in the Internet economy. Some politicians publicly denounce the power of large companies or threaten to regulate, like U.S. President Donald Trump, who has accused Google’s search engine of ideological bias,54e.g. Barret, B. (2018, August 28). Why Google is the perfect target for Trump. Wired. Available at: https://www.wired.com/story/trump-google-news-algorithm-target?mbid=nl_082918_daily_list1_p4&CNDID=51231065. or French President Emanuel Macron, who has warned that Americans may come to see “Big Tech” as “not just too big to fail, but too big to be governed”.55Thompson, N. (2018, March 31). Emmanuel Macron talks to Wired about France’s AI strategy. Wired. Available at: https://www.wired.com/story/emmanuel-macron-talks-to-wired-about-frances-ai-strategy/.

Besides making controversial public statements, governments are increasingly asserting their authority to compel global tech companies to adhere to local laws. Examples of government initiatives in this field, with a variety of justifications, include:

© Internet Society / Nyani Quarmyne / Panos Pictures

55.5% of our survey respondents said consolidation is likely to trigger a response in government policy and regulation over the next five years.

Other countries, like the UK, have taken a broader approach by constituting a panel of experts to investigate and consider potential responses to digital dominance.64Gov.UK. (2018, October 12). Public asked for views on the digital economy. HM Treasury. Available at: https://www.gov.uk/government/news/public-asked-for-views-on-the-digital-economy. The overall trend where governmental responses are concerned, however, is of much more interventionist state action to compel platforms to fulfill a variety of public objectives on competition, taxation, data protection, consumer protection, and content regulation and plurality. This trend is driven partly by consolidation, but also by the sheer size and rapidly growing influence of platforms in many countries around the world:

It is problematic that these and other measures often focus on issues in isolation, potentially failing to understand how different activities fit into the platforms’ overall business models. Some could create unintended consequences by imposing rules with which only the largest companies can comply, further strengthening a dominant position, or by undermining the open and global nature of the Internet itself.

Traditional regulatory tools are evolving to account for the specifics of the Internet economy.83The Internet Society (2018, November 27). Future Thinking: Payal Malik of the Competition Commission of India (interview). Available at: https://www.internetsociety.org/blog/2018/11/future-thinking-payal-malik-competition-commission-of-india/. Regulators are on a steep learning curve, and seem to rarely coordinate with other government actors or regulators with different expertise or mandates looking at the same companies. So far, no holistic responses to consolidation have emerged.

© Internet Society / Nyani Quarmyne / Panos Pictures

In publishing this report, one of our hopes is that policymakers and other decision-makers begin to understand that consolidation in the Internet economy is a much more complex set of issues than the popular press typically covers. Furthermore, this report demonstrates that consolidation trends have positive and negative implications at a number of different layers of the Internet, and that these implications are often interrelated.

Examples of responses from other stakeholders

Some actors in the Internet technical community have also responded to consolidation trends with targeted approaches:

Finally, civil society organisations, NGOs, and intergovernmental organisations92G20 (2018, August 24). G20 Digital Economy Ministerial Declaration. Salta, Argentina. Available at: https://g20.org/sites/default/files/media/g20_detf_ministerial_declaration_salta.pdf. have been vocal about the need for transparency and oversight of influential Internet companies. They play an important role in highlighting gaps. These gaps are, most notably, in the protection of human rights in a diversity of areas ranging from concerns about the gig or platform economy and labour rights,93Oxford Internet Institute (2018, August 3). Fairwork Foundation begins new project on the digital gig economy in South Africa. Available at: https://www.oii.ox.ac.uk/news/releases/fairwork-foundation-begins-new-project-on-the-digital-gig-economy-in-south-africa/. and Internet users' freedom of expression and privacy on social media platforms that are increasingly important public spheres for the exchange of ideas and debates.94c.f. UNESCO’s Internet Indicators project, the Ranking Digital Rights project, or Freedom House’s Freedom on the Net. These and other civil society organisations have started to develop practical standards, benchmarks, and incentives for global platforms to respect human rights everywhere they operate. This includes discernible self-organisation by consumers, (e.g., capacity-building by organisations like Consumers International), to influence business and governments on digital issues.95See, for example: https://www.consumersinternational.org/what-we-do/digital/.  

© Internet Society / Nyani Quarmyne / Panos Pictures

37% of our survey respondents said that there are current efforts in their country or region to address concerns about market dominance in the Internet economy.

Will governance efforts remain siloed?

Many of the consolidation trends highlighted in this report result from platforms leveraging market incentives and opportunities, as well as Internet users’ enthusiasm for the quality, range of offerings, and lower prices – or seemingly-free services – that platform environments can provide. While there is nothing inherently wrong with these trends, concerns remain, including competition, choice, data and consumer protection or welfare, dependencies, and the potential for single points of failure, as well as societal challenges exacerbated by size, scope, and speed of social change wrought by platforms. How those concerns are addressed in the coming years will not only determine the success of addressing the specific question at hand, but also the future development of the Internet as a whole.

This challenge is also an opportunity to test the efficiency of collaborative multistakeholder approaches that typify Internet governance, ensuring a diversity of views inform policy and technical decisions. But will this methodology be effective and sufficient? The question remains to be answered and will largely depend on the ability of stakeholders to quickly stop working in silos.

© Internet Society / Nyani Quarmyne / Panos Pictures

What Is Consolidation? Impact Analysis

Download Takeaways & Observations

Download Full Report

Share with a friend: