Principles of Communications Week 2 13-15/10/2026

1 Centralised (!) Routing - Fibbing (see fibbing paper for more details - esp. figure 9/10 on failure/recovery modes) - in particular, fail-open and fail-close is used in the paper to refer to the persistence of a path made up by fibbing in the event of a controller failure where in some cases this is needed, and in others it needs to be removed! [1,2]

2 Stateful Routing - MPLS. Multi-protocol label switching has a long history (probably started in Cambridge!). It simplifes switch/router design in terms of forwarding, at the cost of increasing complexity in the control plane  -- possibly in routing, but more crucially, signaling. Signaling protocols have a very long history (from railways over 200 years ago). One interesting computer science dimension that arose from signaling is the concept of mutual exclusion. The first algorithms for avoiding contention for a limited resource are direct descendents of the P and V flags used to prevent two trains entering the same section of track....

In a sense, these two ideas (central and stateful) can be reconciled via "soft state" protocols (see last lecture).

Note also: MLPS involves a "shim" layer between IP and lower levels. Segment routing may use that, or may just use IP6 routing options directly. Recall layering from IB networking course. It is often not a pure picture - IP tunnels are another example of extra layers  between this and that. MPLS can also simplify switch & router port processing (and possibly, if switch is "cell switched" scheduling forwarding packets across the switch fabric - again, recall router architecure from IB networking course). Segment Routing is a re-think of MPLS, which can use IPv6 routing options as labels, and then use IP routing updates to distribute the label information to ( amongst others, upstream) neighbours. There's a nice slidepack SR explainer from CERN which shows the interaction with routing... Note segment routing with IPv6 dispenses with the potential hardware speedup of having 20 bit MLPS labels for forwarding, so one assumes router NICs and Processors may have ASIC support for v6 header processing!

Optional background reading...

2. Another dimension of signaling is that it requires a level of accesss control authentication and authorisation not typically present in pure datagram networks like traditional IP. For a measure of how bad it can get, look no further than the old digital telephone network signaling system number 7 (SS7) which is more complex than the whole TCP/IP regular data stack (see report on vulnerabilities in SS7). RSVP (serves similar function for signaling for MPLS if you don't just rely on routing!) is about as bad.

1. Further work was done based on the fibbing idea:

https://www.michaelschapira.com/_files/ugd/3b1e1e_dc51c8d43c7c41cc9ffbfa84923cd864.pdf

Basically, it leverages FIBbing-like mechanisms to optimize (oblivious) TE in IP networks.

https://www.michaelschapira.com/_files/ugd/3b1e1e_b928d21ed137475bb89f51c9073ed8de.pdf

This paper is about the hardness of configuring ECMP for TE. This is actually based on a very cute hardness amplification proof technique.

Good question asked about stochastic & multipath routing - yes, you can do stochastic unipath (i.e. keep changing the route based on statisitcs) but it is more common load balancing/multipath scenarious...

Principles of Communications Week 1 8/10/2025

I'll be noting progress and also adding occasional related reading/ and corrections on this blog.

If you want to revise anything to warm up for the course, I suggest last year's Computer Networks course should be a quick re-read (e..g on routing ) A fun review of 40+ years of the Internet

This week we'll just make a start on routing. If you want to review just link-state (useful to understand fibbing (lecture 2), then video on link-state routing is very thorough.

Please do ask questions - two good ones today were

Q1 -so there's only one BGP for the whole world- yes, to have multiple Inter-domain routing protocols would mean every borader router might have to implement all of them (sort of "polyglot") which isn't impossible, but would be a nightmare of complexity to manage and operationally hard to understand - although these days, maybe we could use AI tools to manage it?

Q2 - isn't source routing a bit like virtual circuits - excellent question - yes&no - see later in MPLS where we see source routing is a way to manage VCs underlying IP potentially, but it can also be dynamic (well, more so than hard virtual circuit setup)

For fun, you might find this discussion on why LLMs aren't much use for networking, mostly interesting - video recording of panel session

Reference requested for Glossary of Terms: from ISOC

Some acronyms come from the 7 layer model of the communications stack including terms like PHY (short for physical, so not really an acronym).

tl;didn't red

Every year for the last 25 years, I've graded undergrad exam scripts in Cambridge. 

Every year, I reach for the same red ballpoint pen as the pile of scripts lands, wummppphh, on my desk. So this year, the ink pretty much ran out on that pen.

Is this a sign? Well, yes, it suggests biros are really quite well made, given how long they last, and whatever they use for ink has amazing longevity (as anyone knows who has had one leak in their white shirt pocket).

But it made me think - is there a lesson about the length and quality of an academic career that could be combined in this one metric: How long does that biro last?

The argument goes thus: the better you teach, the less red ink you have to use to give feedback (and grades) to students. so you are motivated to teach well (you can't game this by just setting easier questions, because there are second examiners and an exam board and all sorts of statistical checks across each student, each cohort, each paper etc etc). 

On arrival in cambridge, i suggest we give each university teaching officer a single red biro. and they get to retire (at least from teaching) when it runs out.

On a sample of one,  this roughly corresponds with my current expected retirement age (if you accept Cambridge's illegal EJRA arguments - but that's another story).

Fair?

(To note, I'm also attending an alumni dinner at Trinity College this year on the 50th anniversary of Matriculating (admission to Cambridge as a NatSci undergraduate). I also looked at my academic diary and note its 40 years since I formally started teaching (at UCL initially). I also recently met a 3rdyr PhD student whose advisor was advised by one of my past PhD students, so that's 4 generations of PhDs in one place - which kind of makes sense, if you think how long it takes from starting academic study to getting to the point you could advise others, then a generation is roughly a decade. so 4 decades of red ink.

Principles of Communications Last Week 8 2/12/2025

Today we wrap up this course with the network systems design toolbag of tricks. 

It could be instructive to take each trick and see where it showed up earlier in the course.

Statistical multiplexing - in conservation law and scheduling.

Pipelining- the entire idea both of a stack (vertical) and the network path (sequence of links and switches and routers) is illustrative of pipelining. Both closed loop and open loop flow control are trying to balance the pipeline, either through congestion control to share the bottleneck, or through admission control.

Caching/Locality - mentioned in passing memcached as a data center service, for example.

Batching also shows up in some data center distributed processing platforms (not really covered here)

Optimising the common case is probably something that BGP demonstrates how not to do!

Binding and Indirection - e.g. multicast addresses aren't real locations, but logical group identifiers, and the actual locations are distributed by the group membership protocol...

Randomness - as discussed in telephone routing! Also used in some load balancers when talking to replicated services (and flow or packet level balancing over multipath enabled routes).

There are many many other examples...

On the other, space could be cool but cooling in space could be very hard... this is maybe a nice example of how systems thinking can be applied using the simple laws of physics (gravity, EM radiation, thermodynamics) before you get as far even as thinking about resource management of processing, memory, comms.. ... ...

Things you do not need to remember:- Padhye's "simple" TCP throughput equation, and Erlang's call blocking probability ...

Principles of Communications Week 8 25-27/11/2025

tue: traffic management timescales, users, large and small, demands, short and long...

signaling and soft state

thu: systems design patterns

Principles of Communications Week 7 18-20/11/2025

 This week we'll cover

• qjump[qj] - data center networking - a big special corner case of traffic scheduling.

note qj puts the token bucket pacer in a hypversions so it is a regulator and a policer in one. it could also be offloaded to a smart NIC If you had one, or just put in the guest OS if you trust it.

• optimisation - routes for traffic, and traffic for routes

The start of traffic engineering by steering traffic by weights - note the hill descent is a classic old school AI technique.  And the origin of why tcp does AIMD is also a type of optimisation, of joint source and network utility!

Optimisation is a very large topic in itself,  and underpins many of the ideas in machine learning when it comes to training - ideas like stochastic gradient descent (SGD) are seen in how assign traffic flows to routes, here. In contrast, the decentralised, implicit optimisation that a collection of TCP or "TCP friendly" flows use is more akin to federated learning, which is another whole topic in itself.

Why a log function? maybe see bernouilli on risk

Why proportional fairness? from social choice theory!

Are people prepared to pay more for more bandwidth? One famous Index Experiment says yes.

0. See Computer Systems Modeling for why the delay grows quickly as load approaches capacity.

1. see IB Distributed Systems for clock synch

2. see prev year's Cloud Computing (II) module for a bit more about data centers&platforms.

[qj] The qj paper gives lots more details of setup, for anyone interested (the figures in the paper are clickable and take you to software and switch/network configurations and data).

Principles of Communications Week 6 11-13/11/2025

 We've revisited flow and congestion control - one way of visualising the progress of an adaptive flow&congestion control protocol is the time sequence diagram:-

but note this is a massive over-simplification as really what you see here is an ideal with only one source and (apparently) only one bottleneck queue. In reality, in FIFO queues, traffic from multiple sources mixes and interferences (causing high variance in delay, hence round trip time, and very unpredictable loss. If we had Round Robin (by flow) queues, things might be a bit better, but how much? That is what we look at under Scheduling, and with the Generalised Processor Sharing model, can see how close to some ideal of "isolation" between flows, we can get. 

With FIFO queues, RTTs and rates (as estiamted from data or ack packet inter-arrival times are going to be varying fairly chaotically, as the ensemble of flows at any bottleneck will not be coordinated in any special way as they all have different RTTs and perhaps just different performance senders, maybe different packet sizes, possibly different inter-packet timing at transmit time, etc etc

A combination of open loop (admission control) and closed loop (feedback) would allow sources to simply operate at a flat rate (the requested rate) or adapt above it as capacity is made free...

The trade off in flow control and scheduling is all about overall system complexity.

Next, we'll wrap up on queue management, then move on to the special (but important) case of data center networks and latency control!