Measuring Instruments and Their Resolution

Introduction

A kitchen scale and a laboratory balance both measure mass, but they tell you very different things. The kitchen scale might say 250 g; the laboratory balance might say 250.47 g. The difference is resolution — the smallest change an instrument can detect and display. Choosing an instrument with the right resolution is one of the first decisions in any experiment. Too coarse, and important differences are hidden; too fine, and you waste time and money measuring detail that does not matter.

Core explanation

What resolution means. The resolution of an instrument is the smallest change in the measured quantity that it can show. On a digital instrument it is one unit in the last displayed digit. On an analogue instrument, such as a ruler or a measuring cylinder, it is usually taken as the smallest scale division, although a careful reader can often estimate between marks.

Common laboratory instruments (typical values):

Instrument Quantity Typical resolution --- --- --- Metre rule Length 1 mm Vernier calliper Length 0.1 mm or 0.02 mm Top-pan balance Mass 0.01 g Analytical balance Mass 0.0001 g 100 cm³ measuring cylinder Volume 1 cm³ 50 cm³ burette Volume 0.1 cm³ (read to 0.05 cm³) 25 cm³ volumetric pipette Volume delivers one fixed volume, 25.00 cm³ Liquid-in-glass thermometer Temperature 1 °C Digital thermometer Temperature 0.1 °C Stopwatch Time 0.01 s

Resolution is not the same as accuracy. A digital stopwatch shows 0.01 s, but a person starting and stopping it by hand has a reaction time of about 0.2 s. The display suggests more certainty than the measurement really has. Resolution describes what the instrument can display; how close the reading is to the true value depends on the method and on how well the instrument is calibrated.

Matching the instrument to the task. The instrument should have a resolution that is small compared with the quantity measured. Measuring 2 cm³ of liquid in a 100 cm³ measuring cylinder is a poor choice, because one scale division is half the volume. A 10 cm³ measuring cylinder or a burette would be far better. In titrations, chemists use burettes and pipettes because volumes must be known to about 0.05 cm³.

Digital versus analogue. Digital instruments remove the need to judge a position on a scale, but they still have a limited resolution and can still be wrongly calibrated. Analogue instruments need careful reading but often allow a skilled user to estimate half a division.

Step-by-step reasoning

1. Estimate roughly how large the quantity is. 2. Decide how small a difference you need to detect. 3. Pick an instrument whose range covers the quantity and whose resolution is much smaller than that difference. 4. Record every reading to the full resolution of the instrument.

Visual explanation

Picture two rulers side by side: one marked only in centimetres and one marked in millimetres. A pencil that ends between the 12 and 13 cm marks can only be recorded as "about 12 cm" on the first, but as 12.4 cm on the second. Finer marks give finer information.

Real-world analogy

Resolution is like the pixel size of a digital photograph. A low-resolution photo shows a face as a few large squares; a high-resolution photo shows every eyelash. Both show the same face, but one records far more detail.

Real-world example

Jewellers weigh gold on balances that read to 0.01 g or finer, because gold is so valuable that even a hundredth of a gram matters. A supermarket scale for vegetables reads only to the nearest 5 g, which is perfectly adequate for potatoes.

Why?

Why do chemists not simply use the finest instrument for everything? High-resolution instruments are expensive, slower to use and more sensitive to draughts, vibration and temperature. Using one where coarse data is adequate adds cost and effort without improving the conclusion.

Common misconception

"A digital reading is always exact." A digital display shows a fixed number of digits, but the last digit is still rounded, and the instrument may be poorly calibrated. A digital reading has an uncertainty just like an analogue one.

Worked example

Question: A student needs to measure about 25 cm³ of acid as precisely as possible. Which is better: a 250 cm³ measuring cylinder (divisions of 2 cm³) or a 50 cm³ burette (divisions of 0.1 cm³)? Explain.

Reasoning: One division of the measuring cylinder is 2 cm³, which is 8% of 25 cm³. One division of the burette is 0.1 cm³, which is only 0.4% of 25 cm³.

Answer: The burette, because its resolution is much finer relative to the volume measured.

Quick check

1. What is the resolution of a digital balance that displays 12.36 g? Answer: 0.01 g, one unit in the last displayed digit.

Exam focus

Be ready to state the resolution of a ruler, balance, burette or thermometer and to justify the choice of instrument. A strong answer compares the resolution with the size of the quantity being measured, not just "it is more accurate".

Advanced insight

In advanced analysis, balances can be read to a microgram, but only inside draught shields on vibration-free benches, after the sample has reached room temperature. At that level, the buoyancy of air, static electricity and even fingerprints on a container can change the reading, so the environment matters as much as the instrument.

Summary

Resolution is the smallest change an instrument can show: one unit in the last digit of a digital display, or roughly the smallest division on an analogue scale. Common laboratory instruments have typical resolutions, such as 1 mm for a ruler and 0.1 cm³ for a burette. Choose an instrument whose resolution is small compared with the quantity measured, and remember that fine resolution does not guarantee accuracy.

Practice questions

1. Define the resolution of a measuring instrument. Answer: The smallest change in the measured quantity that the instrument can detect and display. 2. Why is a burette used rather than a measuring cylinder in a titration? Answer: A burette has a much finer resolution (0.1 cm³ or better), so volumes are known far more precisely. 3. A stopwatch reads to 0.01 s. Explain why hand timing is not that precise. Answer: Human reaction time is about 0.2 s, which is much larger than the stopwatch's resolution, so the timing is limited by the person, not the display. 4. Suggest a suitable instrument to measure the mass of a 0.5 g sample of salt, and explain your choice. Answer: A balance reading to 0.01 g or 0.001 g, because its resolution is small compared with 0.5 g.