Understanding Great Circles and Geodesics
A great circle is the largest circle that can be drawn on a sphere, formed by the intersection of a plane passing through the sphere's centre. On a flat map, great circles appear curved or distorted—a consequence of projecting a three-dimensional surface onto two dimensions. On the sphere itself, however, great circles are the straightest possible paths between points, much like longitude lines converging at the poles.
This concept becomes vital when considering real-world navigation. Earth is not a perfect sphere; it's an oblate ellipsoid, slightly flattened at the poles and bulging at the equator. Great circle calculations must account for this shape to provide accurate distances. The difference between spherical and ellipsoidal calculations is modest for most locations but grows noticeable near the poles, where the flattening is most pronounced.
Geodesics on a sphere follow different rules than the straight-line geometry we experience on flat ground. The shortest path between two points on a curved surface is a geodesic—a natural generalisation of the straight line. Understanding geodesics explains why aircraft routes and shipping lanes appear curved on standard map projections.
Calculating Great Circle Distance on a Sphere
To find the great circle distance on a perfect sphere, you need the latitude and longitude of two points. Convert these coordinates to radians, then apply the haversine formula or the spherical law of cosines, both of which yield the same result. The method below uses the law of cosines approach.
d = r × arccos(cos(φ_A) × cos(φ_B) × cos(λ_A − λ_B) + sin(φ_A) × sin(φ_B))
d— Great circle distance in the same units as the radiusr— Radius of the sphere (6,371 km for Earth)φ_A, φ_B— Latitude of point A and point B in degrees (convert to radians by multiplying by π/180)λ_A, λ_B— Longitude of point A and point B in degrees (convert to radians by multiplying by π/180)
Spherical vs. Ellipsoidal Models
For most practical applications, treating Earth as a perfect sphere with a radius of 6,371 km yields acceptable results. All great circles on a sphere have the same circumference: approximately 40,030 km. This simplicity makes spherical calculations straightforward and quick.
However, Earth's true shape—an oblate ellipsoid—introduces measurable differences. The polar circumference is about 40,007 km, while the equatorial circumference reaches 40,075 km. Distances calculated using ellipsoidal models, such as the Vincenty formula or the geodetic reference system, are more precise, particularly for long-distance routes or when sub-kilometre accuracy matters.
For flights and sea routes spanning thousands of kilometres, the difference between spherical and ellipsoidal distances can exceed 1 km, enough to affect fuel calculations and arrival times. Modern GPS and navigation systems use ellipsoidal Earth models as standard.
Practical Considerations and Common Pitfalls
When working with great circle distances, several factors can lead to calculation errors or misinterpretations.
- Sign conventions for hemispheres — Latitude ranges from −90° (South Pole) to +90° (North Pole); longitude spans −180° to +180°. Southern latitudes and Western longitudes are negative. Mixing sign conventions is a frequent source of error. Some calculators accept hemisphere designations (N/S, E/W); others require signed values. Double-check your input format before submitting coordinates.
- Radians vs. degrees — The trigonometric functions in most programming languages expect radians, not degrees. Multiply degree values by π/180 (approximately 0.0174533) before computing sines and cosines. Forgetting this conversion produces wildly incorrect distances—sometimes off by orders of magnitude.
- Antipodal points — When two points are on opposite sides of the sphere (antipodal), the great circle distance equals half the circumference: roughly 20,015 km on Earth. Near-antipodal points can cause numerical instability in some formulas. The Haversine formula handles these edge cases more robustly than the spherical law of cosines.
- Ellipsoidal complexity and accuracy limits — Ellipsoidal calculations provide accuracy to a few metres for terrestrial distances. However, local terrain, ocean currents, and air traffic control restrictions mean the straight-line geodesic distance is not always the actual route flown. Use these calculations as a theoretical baseline, not an absolute navigation truth.
Real-World Example: New York to Sydney
Consider two major cities on opposite sides of the globe: New York (40.71° N, 74.01° W) and Sydney (33.87° S, 151.21° E). Plugging these coordinates into the spherical great circle formula:
d = 6,371 × arccos(cos(40.71°) × cos(−33.87°) × cos(−74.01° − 151.21°) + sin(40.71°) × sin(−33.87°))
This evaluates to approximately 15,989 km. On a flat Mercator map, drawing a straight line between these cities would suggest a northwest passage across the Pacific. In reality, the shortest path curves south and east, following the great circle across the Southern Hemisphere. A pilot navigating this route saves fuel and time compared to following map-space straight lines.