FieldengInstrumentation & Controls
Sensor Quantization
Theoretical LSB in engineering units for an N-bit unipolar converter over a pressure range.
Instrumentation & Controls
Theoretical LSB in engineering units for an N-bit unipolar converter over a pressure range.
App id: INST-37. Reference version 1.0.
How to fill it
Fill the inputs. The tool shows the outputs.
On the tool screen, Calc is the working sheet. Presets stores values you reuse. Reference is the formula, assumptions, and provenance below.
Formula
LSB = EU_span / (2^N − 1)Inputs
| Name | Unit |
|---|---|
| Resolution (bits) | 1 |
| EU lower | psi |
| EU upper | psi |
Outputs
| Name | Unit |
|---|---|
| LSB (engineering) (hero result) | psi |
| LSB as percent FS | % |
Diagnose
This tool does not attach diagnose observations.
Assumptions
- Unipolar 0 … 2^N − 1 coding.
Provenance
- Endpoint convention matches INST-12. Real sensors are usually worse than this quantization floor.