Ever wonder why no one explains what all the data is in 4 TB a day for autonomous cars

It is covered widely that autonomous cars use TBs a day of data. I use a TB of data a month and that data is used across a wide range of videos, downloads, web browsing, and I can look at statistics on where that data is used and where it goes.

Stacey On IOT writes on the mobile edge and goes over the autonomous car use case and where will the edge be.

Moving 4 terabytes of data across 400 cars generates 1.6 petabytes of data a day, which is an obscene amount of data to transfer over mobile networks. Thus, edge processing is already taking place to produce insights required to drive the car, on the car itself.

In addition to much of that data being processed on the car, Vijay said Uber is also creating storage depots with fat connections that can handle the uploads of multiple cars. In areas where a cluster of self-driving cars may overwhelm the network, he suggested use of a mobile data center packed into what looked like a minivan to help process the data.

Part of me wonders if Uber and others talk about all the data for autonomous cars as a way to get others to waste their time. If they are generating 4TB a day now, they aren’t uploading those images now. It would seem like they are collecting lots of data now and running these cars in an instrumented mode.

Flight test instrumentation (FTI) is monitoring and recording equipment fitted to aircraft during flight test. It is mainly used on experimental aircraft, prototype aircraft and development aircraft - both military and civil, and can monitor various parameters from the temperatures of specific components to the speed of the engines. This may be displayed in the cockpit or cabin to allow the aircrew to monitor the aircraft in flight, and is usually recorded to allow the data to be analysed later.

A small modular data acquisition unit

FTI typically monitors between 10 and 120000 parameters - for example temperatures inside the cargo and pressure distribution along the wing. FTI sources could be temperature sensors, pressure probes, voltages, current transducers, potentiometers, strain gauges, aircraft data buses or cameras.[1] These sensors may be digitalized and acquired by the data acquisition system. A cockpit audio recording may also be included. A telemetry transmitter may be added to the FTI to allow real-time monitoring of the tests from a ground-station.


But when planes fly get approved for production they don’t run in this heavily instrumented mode. They did need the instrumentation data though as part of certification to fly.

If we had details on what is in the 4TB of data you would know how much is needed to drive the car vs what is needed to certify the car.

5G lower latency times more improvements come from back-end than antenna transmission

Everyone says 5G will improve latency, but 4G and 5G are both electromagnetic spectrums that travel at the speed of light. So where is the latency improvement coming from. Nokia has a paper on low latency that goes into lots of details.

Below is a table and graphic that shows you were the times are in a latency calculation.

When you look at transmission and frame alignment you get about 3ms of time savings. Looking at UE and BTS which are user equipment and base station times you get 5 ms of time savings.

So there is actually more time saved in latency in the backend equipment than in transmission.


Ok since I brought up the transmission latency I might as well keep going. If you want to look at where the latency savings in transmission the current standards require a connection to be established to send data, switching between idle and connected modes. In 5G a connection is established and you can suspend and resume which is much quicker.

This applies to the same spectrum with only changing 4G and 5G infrastructure. So the new spectrum is not an issue. It is the transmission, connections, and backend that improve the speeds.

Screen Shot 2018-12-17 at 11.23.38.png

5G is the first network designed for Data First and voice is a much lower priority

Arstechnica has a good article on why buying a 5G smartphone may not be a good move for a while. One of the main ideas to get in your head is 5G is has multiple spectrums.

Below is a graphic from the Arstechnica article showing the millimeter wave spectrum that 5G adds on top of 4G.


So sounds good lots more spectrum, but you thought you had problems with 4G LTE coverage. mmwave 5G is going to be worse for coverage in a building or in a car. To get 5G coverage you will need an antenna outside or an internal antenna system connected to the network.

Still a big confused?

How about this as a way to understand 5G. The 4G LTE spectrum will reach you from 10 miles away. mm microwave can be as short as 1,000 ft of an antenna. Handing off between that many antennas on a voice call would be hard.

One study I haven’t seen yet even though the 5G latency is dramatically better than 4G what is the latency and throughput impact when you jump from one 5G antenna to another?

5G will cover LTE, 802.11, and mmMicrowave technologies. Do you think will be addressed in 2019. I don’t think so.

Lee Kirby has retired as President of Uptime Institute, now only focus is on Salute

In 2016, Uptime Institute announced that Lee Kirby was President. Thanks to friends, I heard 2 weeks ago Lee will be retiring from Uptime. And we were both on the flight to SEA to PHX on Sunday to 7x24 Exchange and Lee told me in person he has retired, And the written proof is Lee Kirby’s LinkedIn profile, showing Lee only job is Chairman of Salute, inc. 

Congratulations to Lee Kirby! A bunch of us will get together on Tues to celebrate Lee’s retirement.


Also went to Uptime Institute’s website. Did not see any press announcements,  if you look at the uptime institute team there is no mention of Lee Kirby. 

Rich Karlgaard 7x24 Opening Keynote

Rich Karlgaard, Forbes publisher had a talk called Technology and 2018 Turbulence

When Rich walked on stage the title had change to “Thriving in the Age of Smart Machines. How to build an unstoppable amidst unstoppable technology acceleration and change.”


I was busy taking note and found this article which summarizes Rich’s talk given to GM. https://www.hydrocarbonprocessing.com/news/2018/03/technology-adaptability-are-key-to-keeping-us-industry-on-top


What got funny was when Rich used the decline of GM talking about the corvette to the Cadillac Cimarron when the company was running from a financial aspect.


Contrast being a numbers person at GM vs. Jeff Bezos who has a two pizza number for how big a team should be. 

Rich added the following slide for the data center audience discussing the importance of talent.

What I took from this slide is how important math skills are to work in technology companies. If you are interested in the rest of the presentation you can read this post on the GM presentation. https://www.hydrocarbonprocessing.com/news/2018/03/technology-adaptability-are-key-to-keeping-us-industry-on-top