Revenue from Data: Capitalism and Privacy and the Autonomous Automotive

This is a picture of the Waze app, a GPS navigation software used by many to navigate. By using the app users provide the app with more data

The rise of the smartphone created many new markets in terms of data gathering and analysis and provide novel uses for telephones. For example, the Global Positioning System (GPS) that comes pre-installed on many phones helps researchers track the mobility of people with Alzheimer’s Disease. MyFitnessPal allows you to track what you eat and how much you exercise on most mainstream phones, which could provide nutritionists and food companies with important data, if the user shares the data. Connected vehicle owners have the opportunity to make money by selling access to their data and their vehicles’ processing power.

The art of data mining is already well-known. Companies such as Facebook and Google collect vast amounts of data from various sources, analyze it, and sell access to the data. There is a saying in the technology industry: “If you are not paying for the product, you are the product.” Currently people usually mine vehicle data for purposes such as traffic analysis and developing self-driving technologies such as cruise control; later on marketers could use data from the vehicles to track how people decide to drive, seeing if they slow down around billboards, learn more about how they pick gas stations, etc. There is already a worldwide trend for car insurers to use car location data to set pricing. Right now programs such as Progressive Insurance’s Snapshot program are optional, but may become mandatory.

People could make a mint by selling access to the processing power in their vehicles’ computers. Vehicles have“electronic control units” (ECUs) inside them to handle functions such as transmission shifting and skid-control. The average car now has somewhere between 25 and 50 central processing units (CPUs) and the top of the line have more than 100. All this processing power is currently being used to run cars, but in the future it is possible that vehicles will have so much processing power that they will be able to “rent out” their unused data to other services, such as hospitals and animation studios. Connected Vehicles can also act as mobile data centers and thus capable of processing information remotely. In dangerous situations vehicular data centers could be more useful than stationary data centers, since they can be moved quickly.

While data mining and renting out access to a vehicle’s processing power can benefit owners and society alike, it raises issues regarding privacy and the resale of purchased data. People are already asking questions about how much data Facebook and other companies should have access to and what they can share. Some Twitter users unthinkingly post pictures of their debit cards, including their security codes, making them vulnerable to theft. Giving people access to your GPS could also make owners vulnerable to crime.

In the future contracts may be written that will allow the driver to own the vehicle, but the manufacturer owns the right to use the data collected and processed by the vehicle itself. There may be real and practical reasons to limiting how much processing power an owner may sell. A driver may overestimate how much processing power he or she can offer, robbing him or her of crucial processing power in dangerous driving situations.

Louis Renault on a car in 1903

What to make of all this? If a discussion about data mining and rented processors sounds strange in respect to connected vehicles, consider the telephone. For a long time a telephone was a device tethered to the wall. We could only imagine a cordless phone; a “videophone” was science fiction. Vehicles have come a long way. The future is an open road, and data will shift the connected vehicle forward.


The Internet of Emergency Situations: How Connected Vehicles Can Save People

Japanese ambulances  after the 2011 earthquke; with the power of the Internet of Things, it will be easier for one to add one’s own vehicle to this ambulance train. Pictrue courtesy of×309.jpg

One of the benefits of connecting vehicles is the recognition that vehicles are computers on four wheels. Regardless of whether they are automated or not, this means all vehicles gather, process, and transmit information. Just as one can use smart phones to create Bluetooth-powered mesh networks through the FireChat app, we can potentially use vehicles, refrigerators, and a variety of other devices to create emergency networks to serve other purposes. Vehicles are no longer independent items on the road, but can now take part in a larger picture that can at minimum improve transportation and at most help save lives. We should take advantage of this potential by using connected vehicles and other devices to perform a variety of services to make our emergency services better than ever before.

The Internet of Things (IoT) is a powerful concept that can greatly aid humanity as a whole, whether it is by helping to automate vehicles or by acting as an advance warning system (AWS) for certain diseases, but it has a critical flaw: it requires access to the Internet to work properly. For instance, vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communication are impossible without a continuous and resilient connection to the Internet to communicate location, help discover other objects that are also connected to the Internet, and perform a variety of other tasks such as broadcasting the vehicle’s future plans and whether it needs repairs. If one cannot access a satellite, then one cannot use the global positioning system (GPS) that has also proved critical for modern transportation. Such a loss is not catastrophic; humans drove without access to networking technologies for decades, and the autonomous vehicle does not require the Internet to function either. Ernst Dickmanns led a team that built an autonomous vehicle capable of driving itself in 1986, before networking technologies were widespread. However, connected vehicles, regardless of their state of automation, can drive more effectively and safely if they can share information and coordinate with other connected devices. It is also true that other smart devices can work more effectively if they are connected. Smart refrigerators cannot help their owners keep track of their contents without the Internet, heart devices cannot broadcast the status of the people they are monitoring, and disaster could strike if an oil drill loses contact with its controllers. The Internet is too important at this point to leave without backups or aid, and connected devices in general and connected vehicles in particular can help solve this problem.

The recognition that connected vehicles can receive and transmit data opens the door to using connected vehicles as emergency network broadcasters. Dr. Yuji Inoue of the Toyota InfoTechnology Center has spoken in the past about using vehicles as a hub for creating an emergency communications network (note: this is a PowerPoint file). This system can help create ad hoc networks in situations where the main providers have been disrupted. Vehicles in particular can act as mobile Internet connection points or as a sender or recipient of information requests while evacuating. For example, if an earthquake strikes and breaks down the main Internet broadcasters, evacuating vehicles could provide an ad hoc emergency communications mechanism by transmitting data from one vehicle to the next in an evacuation train. The vehicles can also serve to amplify any remaining signal and help the emergency communications network connect to the greater Internet while the connection is down. This capability can be used to boost the cloud in emergency situations (as well as non-emergency situations).

Flooding in Venice, Louisiana after Hurricane Katrina

Connected vehicles can be quickly impressed into emergency service. Just as people in the United States can join the United States Coast Guard Auxiliary to help the U.S. Coast Guard whenever they can, people could register their vehicles and other connected devices with local emergency services. In case of a crisis, the local government could send out a request to connected devices to quickly ask for aid. In an autonomous environment, autonomous vehicles can be quickly impressed into service as soon as they receive the request. These vehicles can evacuate, transport disaster survivors, supplies, and act as make-shift ambulances. One should also remember that unmanned autonomous vehicles can go to places that are toxic to humans but not to vehicles. For example, vehicles can be sent to places with toxic fumes following a volcanic eruption or areas prone to mudslides.

Finally, connected vehicles can act as inventory management tools. Cameras and other such devices could be added to the vehicles to better track what they are carrying. When. When emergency responders see a shortage of fresh water, blood, and other materials, they can recall the vehicles that are inside a disaster zone and restock them. This will allow them to create a persistent supply of goods necessary to survive. They can send out fully stocked vehicles, recall the ones that will soon be emptied, and send out new ones just as the empty ones are about to leave. These vehicles can also transport Internet broadcasters that can temporarily reconnect the area during the times when the vehicles are not there and the Internet is still down as well.

One can see from the above that the IoT and automation can greatly benefit emergency services. Just as vehicles can carry sensors that can measure how much salt is on the ground, they can also act as mobile communication network broadcasters to ensure that services that require the Internet to function well can continue to function. They can be quick aids to sudden situations, whether it is by automatically adding extra devices to emergency services (while allowing people to use their connected vehicles in normal situations such as personal driving and loaning out their cars through ride-sharing programs) and ensuring everything goes where it is needed. We know the IoT is a boon to businesses, since it allows them to make existing services more efficient, makes it easier to track when an item needs to be repaired or replaced, and gives some goods new capabilities they never had before. As the world continues to innovate, technology will not just improve our lifestyles, but also our ability to help others. Once the IoT truly gets going, it has great potential in helping the world become safer than ever before.

Autopilot: How the Partial Automation of Airplanes Can Inform On-Road Vehicular Automation

A picture from the 2013 Paris Air Show; picture courtesy of

On June 19, the 52nd Paris Air Show began. This air show showcases technological innovations and acts as a place where airplane manufacturers showcase their newest planes. This year, a few key changes are being highlighted: how aircraft manufacturers are shifting away from focusing on one-time sales of aircraft to services such as using “Power-by-Hour” contracts and engine leases. One item that is not being highlighted is the automation of the aircraft itself. Airplanes are already highly automated and the civil aviation industry is continuing the process.  While on-road vehicle original equipment manufacturers (OEM) are still trying to figure out how to make vehicles autonomous, air travel has been greatly automated for decades. With all this in mind, the automotive sector would be smart to pay attention to the lessons learned by the civil aviation industry.

While it is an exaggeration to say that a plane “flies itself,” the pilot can- and often does- stop flying actively and tells the autopilot how to fly the plane after takeoff and before landing. The autopilot does not “drive” the plane necessarily; it merely absorbs the initial orders (and change in orders) of the pilot. These autonomous technologies are complemented by advance warning systems that can jolt a pilot to attention when necessary. Ground proximity warning systems (GPWS) warn pilots whether they are about to hit the ground or another obstacle. More impressively, a traffic collision avoidance system (TCAS) use vehicle-to-vehicle (V2V) communication to identify whether another aircraft is in the vicinity, if the two aircraft are destined to crash if they maintain their flight plan, communicate with the TCAS on the other plane (or planes), and then the different TCASs tell the pilots on the different planes how to avoid crashing into each other. As a result of these innovations, passenger aircraft- and other aircraft- no longer have engineers or navigators on board. This means the pilots can be content to mostly monitor the flight, take over when human interaction is necessary, and know the only two times they are always required to pay close attention is during takeoff and landing.

One should note that in-air OEMs and suppliers are looking into further automated innovation in the airspace. Boeing says it is developing its own artificial intelligence to run its computer-driven passenger planes in the future. Meanwhile the Defense Advanced Research Projects Agency (DARPA), the United States’ Defense Department’s research organization, is interested in creating robots that can co-pilot alongside a human. One should also note that airplanes created by the European OEM Airbus are already heavily automated, with each task using three different computers each that give orders and select actions based on a vote. This ensures there is at least one back up computer available in case one of the computers fails. It appears that as on-road automation is becoming a reality, airborne automation is further ahead and continuing towards an apparently natural conclusion.

A Flight Management System (FMS) Unit

While automating flight is a global phenomenon, commercial aircraft automation is regulated differently on a regional basis. In the United States, pilots are required to oversee the plane throughout the whole flight, even if the plane is on autopilot. By contrast Asian carriers require pilots to keep the autopilot on above 3,000 feet (~914 meters). Furthermore, while aircraft made by Boeing prefer that humans make the final decisions while the flight management systems (FMS) guide and assist the pilots, Airbus planes usually fly themselves unless the pilot overrides it. None of these approaches are perfect. Automating the plane can eliminate the chance of human error. If one were to extrapolate statistics from the on-road transportation industry, one should consider the National Highway Traffic Safety Administration (NHTSA) report from the mid-2000s said that 93% of accidents are due to human error. That number includes behaviors such as drinking and texting, but even if one excludes such situations, the data suggests that removing the human element from driving and by extension flying could save lives, if only the technology could get there first.

A white and red Turkish Airlines A330-300 with the undercarriages extended over a blue sky.

An Airbus A330, a heavily automated plane flown by Turkish Airlines

What can the on-road industry learn from all this? First of all, there is the debate about whether vehicles should be partially or fully automated.  Ford and Google have been arguing that one should skip the partially automated vehicle phase and go straight to full automation because people may become too trusting of an (incomplete) autopilot. As a result the “drivers” will stop paying attention to the road and will only return to active driving when they hear the advance warning system signal. The question is how much advance notice one should have. This question was discussed when a Tesla car got in trouble because one of its vehicles hit a truck while its driver was disengaged. In this case the accident escaped legal trouble because the driver had at least seven seconds to notice that he was about to crash and the autopilot gave him several warnings before he crashed. The question of when the autopilot should transfer control to a human is an important question in flight as well. Aside from the issue of how much time is needed to react, there is also the question of whether people can figure out how to react in the time allotted. Civil aviation has its own share of stories regarding warning systems and malfunctioning autopilots. For example, Air France Flight 447 crashed in 2009 partially because the pilots had grown used to highly automated airplanes and lacked the experience to fly the plane properly when the autopilot was disconnected due to weather problems. If the Tesla incident is an example of what can happen when the driver is too distracted or too trusting to heed the warnings, the Air France example suggests the need for backups for the autopilot. This may be why Ford says it will not start selling partially autonomous vehicles (AV). Instead, it says it will focus on manual vehicles (and those with driver assisted technologies) until 2021, when they promise to put their first autonomous vehicles on the market. By contrast BMW, Mercedes-Benz, and Volkswagen AG’s Audi are claiming they will sell semi-autonomous cars in 2018, with capabilities such as automated driving under a certain speed, which will warn drivers to take over with little advance notice, perhaps even 10 seconds. The Air France Flight 447 incident suggests the automotive industry should carefully consider copying the aviation industry’s reliance on multiple backup autopilot systems.

The aviation industry teaches us that regulation is imperative to safety and will remain an important issue, and there is no guarantee that countries will regulate automation the same way across the globe. If we are somewhere between fully manual and fully autonomous vehicles, that means regulators need to ascertain where the line should lie in terms of responsibility. As mentioned above Asian fliers are required to let the autopilot take over for most of the flight and the North Americans are supposed to treat their autopilot as a “flyer assist,” not a strict guide. Overall, we need to remember that autonomous vehicles are not a new, unprecedented technology. We have existing examples of autonomous technologies in aviation and there is no need to reinvent the wheel from scratch.

From The Stable to the Rest Stop and Further On

A horse stable found in modern day Poland; these stables used to be more common before vehicles replaced draft animals. 

Autonomous vehicles will greatly change the landscape. In the past, people traveled on horses and had to stop at individual stables to temporarily house their steeds, feed them, and prepare them to go back out into the world. They also served as a place for humans to rest, eat, and take care of themselves until their horses were ready to travel. Nowadays rest stops serve similar roles for people and their horseless carriages, except instead of caring for one’s draft animal the rest stops are designed to fuel and repair one’s vehicle. Just as unhorsing the carriage has removed the stable from the landscape, automating the vehicle and, in some cases, removing its occupants will also transform the environment. While the occupants of autonomous cars may need to eat, autonomous trucks will only need to stop for fuel and maintenance. If trucks are fully automated, it follows that fueling stations will change as well.

The dehumanization of vehicles will likely change how fueling takes place. At first glance it is unclear why anything must differ. Right now most vehicles require outside aid to be fueled. This will not change in the near-term; few automakers are promising vehicles that can fuel themselves as well as drive themselves. Generally fueling stations have at least one person around and this will remain for the foreseeable future. At first, fueling stations may require more staff to handle the differing fueling and payment protocols. Fueling companies may respond by automating the stations. To get there, a great deal will have to change.

A gas station near Mount Fuji

A great deal of work will need to be done to automate the fueling process. One start-up, Powerhydrant, is developing a way to automate fueling electric vehicles, which can facilitate charging vehicles without the need to have human intervention. Automating the process can make it faster. Any successful method of fueling a vehicle will require a great degree of engineering, since the vehicle will need to know when it needs to be reenergized, whether it is attached to a charger (or a pump), whether it is receiving energy, and when to detach from the fueling station. The vehicle will also have to decide when to stop receiving energy or disengage the charger. Should it charge until it is full, or should it leave “early” so it only has to pay a certain amount of money for its fuel or just enough to finish a trip so the vehicle can recharge at its “home base” for free. Payment will be tricky; if there is no human in the vehicle, the people at the fuel stations need to be trusted to service and charge the vehicle as directed, and the vehicle needs to be programmed to pay and monitor whether it has been serviced properly.

The methods of fueling the vehicle- whether the fuel is petrol, diesel, or electricity- will have to be standardized as well to ensure vehicles can be charged at any of these stations. This is already an issue in Europe regarding electric vehicles (EV); while Tesla uses a particular standard to energize its vehicles in most of the world, in the European Union (EU) it is required to use the standard Mennekes plug and allow competitors’ EV charging stations to charge their vehicles. By contrast non-Tesla vehicles such as the Chevy Bolt cannot be charged at Tesla Superchargers in the United States.

Perhaps an even bigger question is how vehicles will choose where to charge. Right now you can find fueling stations from competing companies across the street, with drivers selecting fueling stations based on (fluctuating) prices, brand, and perceived quality of the fuel. Companies will prefer to program priorities into the vehicles to avoid having to make a decision every time a vehicle needs to be refueled. This process opens up another set of questions. No matter what happens, antitrust issues will be in play. Regulators may frown on the Tesla vehicles avoiding non-Tesla branded chargers, and some regulators may worry about a company owning fueling stations, vehicles, and the fuel.

All these processes need to be well-secured. A cyber criminal could interrupt the payment process by absorbing the funds meant for the fuel station attendant, disrupt the process so the fuel station initiates the fueling process without a vehicle available to receive the fuel, or swipe personal information from the vehicle and/or the fuel station’s records. They could even paralyze transportation by preventing refueling.

The future of the fueling plays into a large change in the world of the IoC: a focus on services. Until recently the main focus in vehicular transportation has been on selling vehicles, fueling them, and maintenance. Right now vehicle sales are dropping within the United States and while the  vehicle sales in China and a few other markets increased in 2016, global sales may soon resemble those of the United States. Perhaps people will rely less on personal transportation now that they can use services such as Instacart for delivery of groceries and Amazon for delivery of many other goods and services. While the vehicle is an important part of the connected vehicle, we need to consider how services such as fueling will be effected. If the companies of today want to survive, their business models will have to change.

Computing on Four Wheels

A Google Car that is being used for mapping

What has gigabytes of storage, dozens of central processing units (CPUs), and stays in one place 95% of the time? Not a data center that is rarely moved, but a connected car. Nowadays even completely manual cars spend 95% of their time parked. This is because people only use their cars to travel to and from work and places of leisure, leaving them unused most of the day. This may change if cars become data centers. Now that people are adding computers and sensors to cars, the new “smartcar” revolution may do as much for cars as smartphones today. Just as smartphones can do more than make calls, “smartcars” can do much more than just move, even if they lack autonomous capabilities.

To start, connected vehicles will help maintain infrastructure (To see more on sensorized signs, see my previous blog). Vehicles can serve a similar function in collecting and relaying the state of infrastructure, weather information, and the flow of traffic; and compare that data to sensors in the signs and the road to ensure a near-perfect information environment. Connected vehicles can scan the infrastructure for potholes, non-sensorized signs, and other points of interest and send them to different services. Google is already patenting this technology in regards to finding potholes. previous blog

Data centers will be more mobile and flexible once they become part of the vehicle. Dr. Yuji Inoue (Chairman, Toyota InfoTechnology Center) has spoken to me before about how vehicles can be used as part of the communications infrastructure. These smartcars can act as mobile homes to web domains which are considered strategic and thus may be safer if they are not in a single place, or they can be data centers that can give extra processing power to organizations that want it, like a hospital that needs the extra processing power to get better access to information or an animation company that needs extra computational power. Dr. Inoue suggests connected vehicles can serve as emergency communication centers, a way to create a “temporary internet” when a natural disaster knocks out the main communication infrastructure.

Picture of a truck with a data center attached to it. Picture courtesy of

The beauty of having all the vehicles interconnected is that they create a clear picture when viewed altogether. Each vehicle gives you a moving picture, and adding all the vehicles together can create a picture over a terrain. One can install instruments and sensors to help weather organizations better understand and predict the weather. These connected vehicles can act as mobile data centers that collect and synthesize this information. All of this information can be collected across the vehicles and the signs and analyzed to make a more full understanding of the weather.

Connected vehicles may cross the line from consuming infrastructure to becoming it. Navigation applications such as Waze use user reports to actively inform its users of traffic, blocked roads, and many other incoming obstacles. One can use the information collected by many sensorized vehicles do this automatically. Connected vehicles can make traffic safer and more predictable. Helicopters may no longer be needed. Connected vehicles can act as mobile traffic lights to spot traffic jams and accidents from afar. The vehicle known as the RINSPEED Oasis can “light up” the area in front of itself as a way to signal pedestrians it is safe to pass. Perhaps the headlights could be modified so that they emit colored light, such as red lights for “stop” and green lights for “go.” Further modifications can be made for people who are hard of hearing or who are colorblind. Little to none of this requires vehicles to be fully automated, and all of it can benefit from these sensors. As vehicles become infrastructure and data centers, businessmen and regulators will wonder how this may affect questions such as data ownership, the right to sell that data to others, and how this data must be secured.

Sensitive Signposting

As the connected vehicle becomes more commonplace, signs will have to change to improve transportation. The signs we see alongside the road serve an important purpose. They inform drivers and pedestrians about how the vehicles on the road should behave. This is all buttressed by a legal system that requires everyone on the road and crossing the road to follow the rules, to ensure that everyone acts in a predictable and safe manner. Connected vehicles offer an opportunity to take the existing system of signs and make them more efficient. They can continue to give human drivers and pedestrians information, give guidance to driving programs, and sensors in the signs can give information about the weather, state of the road, and incoming traffic jams to incoming cars. Theoretically the connected vehicle can exist with the current infrastructure, but we can take advantage of the new technology to make infrastructure more effective than ever before.

What we recognize as a stop sign is just a piece of metal to a connected vehicle unless it is programmed to recognize it. This task is more complicated than one might expect, as the computer scientist Artur Filipowicz of Princeton University described. In his paper “Using Virtual Worlds, Specifically GTA5, to Learn Distance to Stop Signs,” he collected more than 1 million images of stop signs from the videogame Grand Theft Auto V in different environments, weather conditions, and times of day to help researchers understand how to make a similar system to help “real” cars identify stop signs. Such a system will have to adjust for different possibilities, such as the sign being defaced. This does not take into account that some countries use different symbols for stop signs. For instance, the Japanese stop sign is an inverse red triangle. There is a simpler solution to this problem: use sensors to tell cars what the humans already know.

We can add sensors to the existing infrastructure so that connected vehicles can quickly recognize signs without having to compare them against millions of pictures. Las Vegas in Nevada and Frisco in Texas are going further by connecting their traffic signal networks with pilot vehicles. The two cities believe this will make traffic smoother by giving the drivers access to more information relating to traffic lights. The pedestrians will not have to alter their behavior at all.


Sensors can do more than just traffic control; they can collect and relay the state of the infrastructure, weather information, and the flow of traffic. Sensors can also be added to roads. Road sensors can tell whether the roads need to be repaired soon or if the ground will be slippery due to rain. Volvo tested magnetic roads that can sense and guide connected vehicles. This technique can help the platoon management of driverless cars. Sensors can also help maintain infrastructure. A group of engineers at Carlos III University in Madrid, Spain created a sensor that can measure how much salt is poured on roads to prevent freezing in real time. Excessive salt can harm the vehicles on the road, the infrastructure, and the environment at large.

Adding sensors to all signs will take time. This could lead to accidents where a connected truck passes by a “sensorless” left turn only sign and fails to turn left. Regulations may be required to “sensorize” the signs because getting it wrong can be fatal. Until sensorization is widespread, cars equipped with such technology may be restricted to sensorized roads. All of these issues can be magnified by the threat of cyber attacks which can reconfigure the signs and cause chaos. All of these sensors must be secured if they are to be trusted. However, overall adding sensors will greatly improve transportation. Technically one can have an autonomous vehicle with the current infrastructure, but if you really want to move forward, you have to remodel the road as well.

The Employment Gap and the Connected Truck

The Employment Gap and the Connected Truck

The above picture is of an autonomous truck that is operated by Uber’s self-driving company, Otto

The American Trucking Association (ATA) believes that freight volumes will increase by 29% over 2015-2026, and this requires the addition of 90,000 jobs in the United States per year to meet demand. However, issues such as pay and erratic hours have created a trucker shortage in this industry. While some companies are trying to solve this problem by making these jobs more enticing to workers, connected vehicle technologies can use Internet of Things technology to fill the gap.

There are currently several approaches to filling this gap. One method is to replace the humans with fully autonomous trucks, but this will not happen within the next few years. Ford and Volvo are promising to put self-driving vehicles on the market by 2021 and 2020 respectively, but even if they meet their objectives it is unlikely that trucking companies will immediately purchase platoons of autonomous trucks. They may eventually replace their human drivers with autonomous trucks- especially since the average age of a trucker is 49 as of 2015 and the ATA expects the number of open driver positions to increase if the economy picks up- but it is doubtful in the short term.

One solution is to use existing technology to have a single human driver drive one truck at the front and several of the trucks behind his truck. Nikola Motors, an electric truck company, is aiming to have a human driver drive the truck they are in and have up to seven trucks drive behind him. This would be scalable, since the technology could be used to drive two trucks at once to a single location and more trucks could be added to create a fleet of trucks. The main issue is that these trucks may not be able to drive to single locations, since trucks are quite large and can take generous amounts of road wherever they are.

One person who has hit on a pre-autonomous solution for vehicles in general and trucks in particular is Maarten Sierhuis, the Director of Nissan Research Center Silicon Valley: “teleoperation.” Since autonomous vehicles will not be a reality in the short term, automotive manufacturers and other companies related to the automotive industry allow humans override the vehicles from afar whenever an autonomous vehicle meets an obstacle it does not understand. Mr. Sierhuis himself believes autonomous vehicles will not be here in the next five to ten years. Instead of putting an autonomous vehicle on the road and trusting it, he and others engage in “Seamless Autonomous Mobility,” where autonomous vehicles are put on the roads while humans watch them through vehicles and other sensors from afar to ensure they drive safely and keep them out of accidents.

Nissan is not the only company that takes advantage of teleoperation. Karl Iagnemma, co-founder and CEO of the autonomous ride-sharing company nuTonomy also says his company is developing a teleoperation system. Google’s Waymo is studying the idea, Uber filed a patent for an autonomous vehicle following a human driven vehicle or being driven through remote control in 2015, autonomous vehicle start-up Zoox has a patent on it, and so does Toyota. One should note that the Nissan vehicles do not switch to “remote control” in times of crisis, only in situations it does not understand, like how nuTonomy’s vehicles had to learn about seagulls. In Nissan’s case, the vehicles are currently wired to ping Nissan’s control centers in certain situations and wait for new instructions. Nissan knows there is a big market for this- CEO Carlos Ghosn sees multiple markets for fleets of vehicles, including logistics companies (cargo).

One can see how heavy use of teleoperation is useful in a pre-automation world. While companies tend to use teleoperation for testing purposes, it can act as an intermediate step between the current stage of driving and full automation. It puts fewer people on the roads and allows companies to put drivers into shifts instead of driving on the road for days at a time. There are still a few issues with this semi-autonomous solution. For instance, the “drivers” will have to eliminate problems related to latency. Furthermore, the remote drivers must ensure the vehicles “learn” so humans can intervene less and less, such as when vehicles learn how to respond to traffic cones. Teleoperation is seen as a stage in the process of automation and should be treated as such.

Overall though, teleoperation is scalable and will help fill the trucking job gap until automation is more accepted. It will shrink the employment gap by allowing truckers to operate multiple trucks at once, rotate the operators, and/or have call centers where truckers can drive remotely or take over when the trucks cannot process what they need to do next. There will be political questions in the short term, since successful use of partial-to-full teleoperation in the short term (and full automation in the long term) could affect overall employment. It will also require creating new signals on the vehicles themselves, since inevitably one of these remote cars will come across an accident on the road and will have to “explain” its intentions to the people there, especially if the remote driver decides to intervene. There is also the issue of whether trucks may be owned by one company while operated by another. Even though teleoperation may be in the short term a stopgap measure to fully automated trucking, it will transform the trucking industry.