Category Archives: SDN

One Open Source To Orchestrate Them All

First the change happened in Information Technology (IT): moving from hardware to software; virtualization inspired by cloud computing; data centers becoming configurable and programmable as software using DevOps approach; traditional vendor-locked solutions superseded by new world open source initiatives such as OpenStack, Open Compute Project and Cloud Native Computing Foundation.

Then Communications Technology (CT) followed the lead, making its move into the new world with notions such as software defined networking (SDN), network functions virtualization (NFV) and central office re-architected as a data center (CORD). Inevitably open source took a lead role here as well, with a multitude of projects popping up, led by different industry forces.

LinuxFoundationNetworkingAndOrchestrationIn fact, too many project, which left the Telecom industry perplexed and unable to converge under one de-facto standard. Have you tried to orchestrate with each player requiring a different sign language from the maestro?

But then came the twist in the plot when the Chinese and Americans decided to join forces: ECOMP (Enhanced Control, Orchestration, Management and Policy) that was open sourced by AT&T, and Open-O (Open Orchestrator) project led primarily by China Mobile, China Telecom and Huawei, have decided to join forces under the Linux Foundation’s umbrella, to create Open Network Automation Platform (ONAP).

What shape will the merged project take? That is yet to be decided by the community. This topic was much discussed February at the announcement on Mobile World Congress and even more so during Open Networking Summit this month, but still more questions than answers for ONAP, around modeling, protocols, descriptors, architecture…

The most important question, however, is whether the new merged mega-project will bear the critical mass required to gravitate the industry towards it, to become the converging force, the de-facto standard. Seeing the forces behind ECOMP, OPEN-O and now ONAP, including Intel, IBM, Cisco, Nokia and others, it looks promising. And the Linux Foundation is a proven vehicle for widely adopted open source projects. If succeed, this may very well be the turning point, taking the NFV & SDN wagon out of the mud and unto the fast track to production.

*Disclaimer: The writer has been working on the orchestration initiatives of ONAP members Amdocs and GigaSpaces.

1311765722_picons03 Follow Horovits on Twitter!

Advertisements

Leave a comment

Filed under Cloud, DevOps, NFV, SDN, Telecommunications

Open Source Is Taking Over Networks, Startups Lead The Way

Innovating in the networking world is hard. With purpose-built boxes, protocols, technologies, legacy, processes… But when industry veterans from the likes of Apple, Juniper and Big Switch start up fresh and think outside the box – that’s when networks get shaken up. Just see the updates from the last couple of weeks:

After building the complex networks for iCloud, Apple engineering veterans decided to leverage their experience and last week launched their new startup SnapRoute. SnapRoute promises to bring a “developer friendly and operations focused network protocol stack that runs on all commoditized network and hardware with any Linux operating system”. This open stack will remove the dependency in the software provided by the vendors providing the network equipment (such as routers and switches) and will enable innovation decoupled from the vendor.

snaproute-open-source-network

SnapRoute’s first open source project is its FlexSwitch, which it contributed to the Facebook-founded Open Compute Project. FlexSwitch will also be offered as an option for the OpenSwitch operating system. OpenSwitch is an open source, Linux-based network operating system designed to power enterprise grade switches from multiple hardware vendors that will enable organizations to rapidly build data center networks that are customized for unique business needs. Earlier this month OpenSwitch got accepted to the Linux Foundation, which will surely facilitate and boost its open source community activity.

openswitch

Another promising startup, which made headlines recently following Google’s investment, is Barefoot Networks, which brings the vision of programmable networks. Their innovative switch chips can be programmed using the P4 language to run various network tasks to replace today’s purpose-built networking equipment. Interesting to note that both Barefoot Networks and P4.org are also members at the OpenSwitch project.

Apstra is another interesting startup that was launched last week and was founded by networking veterans from Big SwitchArista and Juniper, which offers data center network automation. It employs an intent-driven approach for network operations, and treats the network using the methodologies of distributed systems:

“You need to recognize that your network is a distributed system. This allows you to operate your network as a system”

To be fair, startups are not alone in this front. Check out what GoogleFacebook and Amazon have been doing in their data centers. Together, startups, big players and open communities push the traditional networking world to the modern era.

1311765722_picons03 Follow Horovits on Twitter!

2 Comments

Filed under Cloud, SDN, Telecommunications

Programmable Networks – Is The Dream Finally Coming True?

One of the hottest trends in the Telecommunications industry is Software Defined Networking (SDN), the idea that you can control the logic of the data flow dynamically using central programmable logic, instead of having it hard-coded into every individual networking “box”.

Stanford Prof. Nick McKeown, one of the guys who invented SDN, and a serial entrepreneur in networking technology startups, now brings the next transformation: programmable switching chips. While in today’s networks special-purpose chips are used which are hard-wired to run specific protocols, the new switch chips can be programmed so that they could perform different functions such as firewall and load balancing, which currently require specialized networking equipment.

McKeown’s new startup Barefoot Network just completed its series C funding round with $57 million from Google (Alphabet) and Goldman Sachs. Google’s interest isn’t surprising as Google has been exploring next-generation networking for a while, and even earlier this year joined the Open Compute Project (in which Goldman Sachs is also a member).

The chips will be programmed by P4, a language for protocol-independent data packet forwarding. P4 is backed by a large open consortium of industry leaders, including tier-1 Telcos AT&T and Huawei, leading manufacturers such as Intel, Cisco and Juniper, and even software giant Microsoft. Reportedly the new chip can reach up to up to 6.5Tbps (terabits per second)—double the speed of the fastest comparable technology on the market, which is critical in making the new chips realistic for the high-performance standards of Telecom.

The vision of Software Defined Networking and that of programmable switching chips is basically one. As Barefoot puts it:

We envision a world where programmable networks outperform fixed-function networks. We believe that programming the network should be as easy to program as a server.

That’s a vision worth pursuing. And it may just about to come true.

You can read more on the latest announcement on this comprehensive coverage by the Wall Street Journal.

For a more technical deep-dive, download Barefoot’s whitepaper here.

1311765722_picons03 Follow Horovits on Twitter!

 

1 Comment

Filed under NFV, Programming Languages, SDN, Telecommunications

Google Unveils Its Next Gen Datacenter Network Architecture

Organizations such as Google, Amazon and Facebook posses sheer size, scale and distribution of data that pose a new class of challenges for networking, one which traditional networking vendors cannot meet. According to Google’s team:

Ten years ago, we realized that we could not purchase, at any price, a datacenter network that could meet the combination of our scale and speed requirements.

Facebook engineering team ran into much similar problems. Late last year Facebook published its datacenter networking architecture, called “data center fabric”, which is meant to meet this exact challenge, and has continued this year expanding the architecture.

Now Google is joining the game, sharing their in-house datacenter network architecture in a new paper published this week. The current (5th) generation of Google’s architecture, called Jupiter, is able to deliver more than 1 petabit/sec of total bisection bandwidth. This means that each of 100,000 servers can communicate with one another in an arbitrary pattern at 10Gb/s. The new architecture also means substantially improved efficiency of the compute and storage infrastructure, and ultimately much higher utilization in jobs scheduling.

Google based its new networking architecture on the principle of Software-Defined Netowrking (SDN). Using the SDN approach, Google was able to escape the traditional distributed networking protocols with their slow dissemination, high bandwidth overhead and manual switch configurations, and move to a single global configuration for the entire network that is then pushed to all switches, with each switch taking its part of the scheme.

Google has been an advocate of SDN for quite some time, and is a member of the Open Networking Foundation (ONF), a consortium of industry leaders such as Facebook, Microsoft, Deutsche Telecom, Verizon and of course Google, promoting open standards for SDN, primarily the OpenFlow project which Google fully adopted.

SDN and network virtualization have been major trends in the networking realm, especially with cloud-based deployments with their highly distributed, scalable and dynamic environments. All major cloud vendors have been innovating in their next gen networking. Most notably, Google has been actively competing with Amazon on driving its cloud networking to next gen, where Google presented its Andromeda project for network virtualization.

The big players will continue to forefront the networking and scalability challenges of the new cloud and distributed era, and will lead innovation in that field. The open approach that was adopted by the big players, with open standards, open source and sharing with the community, will enable the smaller players to benefit from this innovation and push the industry forward.

You can read Google’s paper on Jupiter here.

1311765722_picons03 Follow Dotan on Twitter!

5 Comments

Filed under Cloud, SDN

Facebook Shares Open Networking Switch Design, Part of its Next Gen Networking

Facebook’s enormous scale comes with enormous technological challenges, which go beyond conventional available solutions. For example, Facebook decided to abandon Microsoft’s Bing search engine and instead develop its own revamped search capabilities. Another important area is Facebook’s massive networking needs, which called for a whole new paradigm, code named data center fabric.

10734294_775986955823316_1197403205_n[1]

The next step in Facebook’s next-gen networking architecture is “6-pack” – a new open and modular switch announced just a few days ago. Interesting to note that Facebook chose to announce the new switch the same day Cisco reported its earnings. This is more than a hint at the Networking equipment giant, representing the “traditional networking”. As Facebook says in its announcement, it started the quest for next-gen networking due to

the limits of traditional networking technologies, which tend to be too closed, too monolithic, and too iterative for the scale at which we operate and the pace at which we move.

The new “6-pack” is a modular high volume switch built on merchant silicon based hardware. It enables you to build any size switch using a simple set of common building blocks. The design uses Software Defined Networking (SDN) hybrid approach: While classic SDN separates control plane from forwarding plane and centralizes control decisions, in Facebook’s hybrid architecture each switching element contains a full local control plane on a microserver that communicates with a centralized controller.

Facebook made the design of “6-pack” open as part of the Open Compute Project, together with all the other components of its data center fabric. This is certainly not good news for Cisco and the other vendors, but great news for the community. You can find the full technical design details in Facebook’s post.

Faceook is not the only one in the front line of scaling challenges. The open cloud community OpenStack, as well as the leading public cloud vendors Google and Amazon also shared networking strategies to meet the new challenges coming with the new workloads in modern cloud computing environment.

Cloud and Big Data innovations were born out of necessity in IT, driven by companies with the most challenging use cases and backed by open community. The same innovation is now happening with networking, paving the way to simpler, scalable, virtual and programmable networking based on merchant silicon.

1311765722_picons03 Follow Dotan on Twitter!

4 Comments

Filed under Cloud, IT, SDN

Facebook Shares Its Next Gen Networking

In this age of cloud-based services, social media and the Internet Of Things, when everyone and everything is connected and even our once-local assets such as our documents, spreadsheets and photos are now stored and edited online, network connectivity has become more expensive than gold. Naturally, the biggest players with the biggest workloads face the challenges first, and pave the way beyond current technologies, protocols and methodologies. Recently we got great case studies when Amazon and Google shared their next-gen networking strategies.

Another major player that recently shared its next-gen networking strategy is Facebook. In a detailed blog post, Alexey Andreyev, a Facebook network engineer, shared a detailed technical overview of their new “data center fabric” that was piloted in their Altoona data center. This caught the attention of GigaOm, which last week invited Facebook’s Director of Network Engineering Najam Ahmad to a dedicated podcast to gain some more insight.

Facebook-data-fabric

Facebook moved away from the old cluster-based architecture to the modern fabric-based one. This helped them overcome the endless race after the bleeding-edge and high-end networking equipment and the associated vendor lock-in:

To build the biggest clusters we needed the biggest networking devices, and those devices are available only from a limited set of vendors.

Another interesting point was about the move to a bottom-up Software Defined Networking (SDN) approach:

The only difference is that were essentially saying that we don’t want to build the networks in the traditional way. We want to build them in more of the SDN philosophy, and the vendors need to catch up, and so whoever provides the solution will be part of the system overall.

We see the trend of SDN and virtual networking also with vendors such as Amazon and Google, as well as with the cloud community such as was evident in the last OpenStack Summit. I expect network virtualization and software-defined methodologies shall become even more prominent in Facebook’s architecture as it evolves and as Facebook’s volumes and complexity grow.

Facebook is a great example of an online company in the largest scale, with more than 1.35 billion users around the globe, with a diverse set of services, application and workloads, and with an ever-increasing traffic volume (vast majority of which is machine-to-machine). These volumes challenge the traditional paradigms and trigger innovative approaches. I would keep a close eye on Facebook as a case study for the challenges we’d all face very soon.

————————————————————————-

Update: on Feb 2015 Facebook shared details on “6-pack”, a new open and modular switch in the heart of their datacenter networking architecture. you can read more about it in this post

1311765722_picons03 Follow Dotan on Twitter!

4 Comments

Filed under Cloud, SDN

Amazon, Google Public Clouds Drive Networking to Next Gen

As more enterprises and telcos are moving their infrastructure to private cloud, the more they raise needs for advanced networking to meet their modern, dynamic and virtualized architectures. This trend is fueled by the recent flux of telcos now looking for a carrier-grade private cloud solution to virtualize their IT. These needs from the community took central place in the OpenStack Summit a couple of weeks ago.

But while the OpenStack community only now gets to address the next-gen networking needs for the private cloud, the major public cloud providers the likes of Amazon and Google have long been facing these challenges.

Amazon’s cloud networking strategy

Amazon, on last week’s AWS re:Invent annual event in Las Vegas, shared some of its networking strategy for managing its global IT deployment, with 11 regions and 28 AZ (Availability Zones) across 5 continents. You can read the full technical details in this great article, but the interesting point I find beyond the details is that Amazon realized that traditional networking backbone and paradigms cannot meet the challenges it’s facing, and therefore innovatively reached out to explore the next gen networking for its organization. One such example was cutting costs of high-end networking equipment. Instead:

it buys routing equipment from original design manufacturers… that it hooks up to a custom network-protocol software that’s supposedly more efficient than commodity gear

Another interesting example was achieving network virtualization by utilizing single-root I/O virtualization (SR-IOV) and supporting multiple virtual functions on same infrastructure while maintaining good network performance.

Amazon didn’t come out with its internal networking strategy for no reason. Amazon’s strategy has been to externalize its networking capabilities as cloud services for its end customers. 5 years ago they offered VPC (Virtual Private Cloud), logically isolated AWS clusters which can be connected to the customer’s data center using VPN. On last year’s AWS re:Invent Amazon announced its “Enhanced Networking” for AWS cloud, where it provided SR-IOV support on its new high-end instances. Then March this year they announced support for VPC peering within a region, to enable private connectivity between VPCs.

www_enriquedans_com_wp-content_uploads_2009_06_google-amazon

Google’s take on cloud networking

While the Stackers had their conference and announcements in Paris a couple of weeks ago, Google ran it’s own Cloud Platform Live event in San Francisco, where it announced its Google Cloud Interconnect. Google has been investing in its networking for over a decade, and is now starting to externalize some of it as network cloud services, much in response to Amazon’s aforementioned networking services.

Google’s first important announcement was made March at the Open Networking Summit with the launch of Andromeda – Google’s network virtualization stack, which now got a new release and increased performance. With its Cloud Interconnect Google also responded to Amazon with its own capabilities around VPN connectivity (to be GA in Q1 2015) and Direct Peering. It is interesting to note that Google specifically targets Telcos, namely access network operators and ISPs, offering to meet the demanding carrier-grade challenge of the Telecommunications industry with their global infrastructure and services.

Public clouds heading for network virtualization

Amazon and Google own massive infrastructure and cater for massive and diverse workloads. As such they face the networking challenges and limitations ahead of the market, and lead with innovation around next gen networking and virtualization. I expect we shall see more work around SDN and network virtualization to meet these challenges, with the private clouds following and perhaps also taking the lead with telco-driven carrier-grade requirements and workloads.

1311765722_picons03 Follow Dotan on Twitter!

6 Comments

Filed under Cloud, SDN