What Is the Definition of Resolution of a Measuring Instrument

Although factual precision and accuracy are generally not specified in the data sheets of most available web positioning sensors and web guidance systems, these two measurement indicators should be those used to determine sensor efficiency. So far, the industry has relied on implicit accuracy indicators based on the product of the calibrated profits of the components that make up a web-based guide system. Nevertheless, this is a derived accuracy and precision, as they are not based on actual physical measurements of path position and sensor readings. In addition, the accuracy depends on the calibration of the sensor. In the second part of this article, we show how accuracy, precision, resolution and linearity can be quantified for trajectory position sensors as well as for trajectory guidance systems. Do you want to discuss the accuracy and resolution of your converter? Let us call you. The specification of the tolerance of the measured value and the full-scale value together determine the overall measurement uncertainty of a device. The following calculation example uses the same values as in the examples above: When a series of measurements is made on a steady voltage or other parameter, the measured values show some variation. This is caused by thermal noise in the measuring circuit of the measuring instrument and in the measurement configuration.

The diagram on the left in Figure 1 shows these variations. Accuracy tells you exactly how accurately the output or display reading of a sensor or counter matches the “true” value. Any discrepancy between the reading and the actual value is usually referred to as an “error”. USB-1608G Series Measurement Calculation Example Let`s use the USB-1608G data acquisition device and determine its resolution, accuracy, and sensitivity. (See Table 2 and Table 3 below for specifications.) Imagine a sensor that emits a signal between 0 and 3 volts and is connected to the analog 1608G USB input. We will determine the accuracy under two conditions: condition #1 if the sensor output is 200 mV and condition #2 if the sensor output is 3.0 volts. It`s only in a *reporting* sense. You can`t really measure more accurately than the resolution of the instrument. Resolution is the smallest measurement a device can detect or measure.

This technical specification is usually included in data sheets and is sometimes confused with an indicator of precision and accuracy. The higher the resolution, the more the measurement can be recorded. In the case of web edge sensors, this would be the smallest measurement that the web position sensor can observe or measure. Although high resolution is highly desirable, it does not guarantee accuracy and precision. Here too, the resolution of the sensors may depend on the material, so it may vary with changes in material properties. With existing sensors with a blocking principle, a material that blocks less (light or sound signal) has a lower resolution than a material that blocks more. Therefore, it is known that porosity and opacity affect the resolution of the sensors and therefore their performance. Again, resolution alone makes no sense when working with material changes, when sensors are not calibrated each time to compensate for changes in material properties.

In the case of analog measuring instruments in which the measured value is displayed mechanically, e.B. with a moving coil counter, it is difficult to give an exact number for resolution. First, the resolution is limited by mechanical hysteresis caused by the friction of the needle bearings. On the other hand, the resolution is determined by the viewer, making it a subjective evaluation. First of all, we need to be clear about what these terms actually mean. Typically, these terms are used as performance counters. However, in many cases, these indicators are misapplied or interpreted. The 1 gram resolution ensures that the 10 gram accuracy can be solved without giving a false impression of accuracy.

For example, if the resolution has been increased to 0.1 grams, it makes users feel more accurate. This increased resolution can also lead to unwanted display instability. Imagine a simple test of a 1.5V home battery. If a digital multimeter (DMM) has a resolution of 1 mV in the 3 V range, it is possible to see a change of 1 mV when reading 1 V. The user could see changes as small as a thousandth of a volt or 0.001. Very good explanation of resolution and accuracy. I have a question.. .