Rounding of measurement values or derived values

✍ Scribed by Peter-Th Wilrich

• Publisher: Elsevier Science
• Year: 2005
• Tongue: English
• Weight: 309 KB
• Volume: 37
• Category: Article
• ISSN: 0263-2241
• DOI: 10.1016/j.measurement.2004.08.005

✦ Synopsis

In this paper a procedure for the determination of the cut off point between significant and nonsignificant figures of measurement values or derived values is presented. This procedure uses the standard deviation as a measure of precision and assures, based on the Sheppard correction, that rounding increases the standard deviation of the series of rounded values only slightly due to rounding. Its application to various situations is discussed and demonstrated by four examples.