Skip to content
Driverless Transportation

Briefing · Technology

LIDAR, Radar and Camera-Only: The Three Sensor Philosophies

There isn't an industry consensus on which sensors a self-driving car needs — three different philosophies are all still in commercial use.

Briefing

Three sensor philosophies compete for space on a self-driving car's roof and bumpers, and none of them has won outright.

Lidar is the most expensive of the three by a wide margin. It fires laser pulses and times how long each one takes to bounce back, which gives a direct, physical measurement of distance rather than an inference. The output is a 3D point cloud: a dense scatter of coordinates describing exactly where every surface around the vehicle sits in space. That directness is the appeal, and the cost is a large part of why it took years for lidar hardware to come down to a price commercial fleets could absorb.

Radar sits at the opposite end of the cost curve. It's comparatively cheap, and it keeps working in conditions that degrade the other two sensors, rain and fog especially, because radio waves punch through weather that scatters light. The tradeoff is resolution. A radar return tells you something is out there and roughly how fast it's moving, but not much about its shape, which is a poor substitute for a point cloud when the question is exactly where an object's edges are.

Camera-only approaches skip a dedicated distance sensor entirely and ask software to do the work instead: infer depth, classify objects, estimate how far away a shape in a 2D image actually is. This shifts cost out of the hardware bill and into the software problem, which is harder to solve and harder to verify from the outside than a physical distance measurement. Mobileye, a chip and perception supplier that sits in the D20 index, has built much of its business case around exactly this bet on vision-first perception.

The disagreement isn't only about price; it's about what happens when a system gets something wrong. A lidar-based error tends to be a measurement error, a return that was occluded or misclassified, but the underlying distance was still measured directly rather than inferred. A camera-only error can be a purer inference failure: the system judged a shape to be well beyond where it actually sat, with nothing in the pipeline that measured distance rather than estimated it from pixels. That distinction matters more to a safety case than it does to a spec sheet, since a measurement error and an inference error tend to get investigated, and weighed, differently after the fact even when the on-road outcome looks identical.

Cost has not stood still either. Lidar hardware has grown cheaper as production volumes rise and mechanical, spinning designs give way to solid-state units with fewer moving parts to manufacture and calibrate. That shift narrows the price gap without settling the underlying argument, because the disagreement was never purely about what a single unit costs on a bill of materials. A company that has already built years of perception software around inferring depth from images has little institutional incentive to bolt on a sensor it spent that same time arguing it doesn't need, regardless of how far the sticker price has fallen since.

In practice, almost no commercial operator picks one lane and stays in it. Most combine two or three sensor types and let each one's weaknesses get covered by the others, a process covered in more detail in the explanation of how sensor fusion actually works. Whether any single philosophy eventually pulls ahead as volumes rise, or the blended approach simply becomes the permanent default, is still an open question.

All briefings are reference and analysis pieces, distinct from the 2013–2018 news archive.

Questions

What does lidar measure that a camera-based system can't?

Lidar times how long a laser pulse takes to bounce back from a surface, which gives a direct physical distance rather than an estimate. A camera-based system has no equivalent physical measurement; it infers distance from patterns in a 2D image, using cues like object size, parallax between frames, and learned expectations about how far away things of a given shape usually are.

Why do companies still use radar if lidar and cameras exist?

Radar keeps functioning in rain, fog, and other conditions that scatter light and degrade both lidar and camera performance, and it does so at a fraction of the cost of a lidar unit. It reports an object's presence and velocity reliably even when it can't describe the object's shape in useful detail, which is exactly the kind of coarse-but-dependable backup a fusion system benefits from.

Is a camera-only self-driving system inherently less safe than one that uses lidar?

Not necessarily, but the two approaches fail differently, and that difference is hard to compare from outside a company's own testing data. A camera-only system depends entirely on how well its depth-inference software generalizes to unfamiliar situations, while a lidar-equipped system still has to fuse and interpret its sensor data correctly; public safety records don't yet settle which failure mode is rarer in practice.

Is lidar likely to get cheap enough to end the debate?

Unit costs have fallen substantially as manufacturing has shifted from mechanical, spinning designs to solid-state units, and that trend is likely to continue. But the debate was never purely a cost argument — companies that built their software around camera-based inference have an accumulated investment in that approach that a lower lidar price alone doesn't erase.

Can a self-driving car actually operate safely with only one sensor type?

It depends on how much weight is placed on that single sensor and how the surrounding software compensates for its blind spots. Camera-only systems that have shipped commercially rely on extensive redundancy within the camera array itself and heavily validated software, rather than on a second sensing modality to catch what the cameras miss.

Does combining more sensor types automatically make a vehicle safer?

No. More sensors only help if the system fusing their data does so accurately, and a poorly calibrated fusion layer can produce a confidently wrong merged picture that's worse than either sensor's raw output alone. The mechanics of that tradeoff are covered in the site's separate explanation of how sensor fusion works.