Oscilloscope Fundamentals¶

Oscilloscopes are the cornerstone of high-speed I/O validation. This guide covers oscilloscope architecture, key specifications, configuration, and measurement techniques for characterizing signals at multi-gigahertz frequencies.

What is an Oscilloscope?¶

An oscilloscope is an electronic test instrument that displays voltage signals as waveforms on a screen, showing how signals change over time. Modern digital oscilloscopes capture, store, and analyze signals, enabling engineers to:

Visualize signal behavior in the time domain
Measure timing relationships between signals
Characterize signal integrity (rise time, overshoot, ringing)
Analyze eye diagrams for serial data validation
Debug complex system interactions

Oscilloscope Architecture¶

Block Diagram¶

┌─────────────────────────────────────────────────────────────────────┐
│                         Oscilloscope                                 │
├─────────────────────────────────────────────────────────────────────┤
│                                                                      │
│   Input ──▶ Attenuator ──▶ Amplifier ──▶ ADC ──▶ Memory ──▶ Display │
│               │               │           │         │         │     │
│               ▼               ▼           ▼         ▼         ▼     │
│           Vertical       Vertical     Sample    Acquisition  Math/  │
│           Scale          Offset       Clock     Buffer       Analysis│
│                                          │                          │
│                             Trigger ◀────┘                          │
│                             System                                   │
└─────────────────────────────────────────────────────────────────────┘

Signal Path¶

Stage	Function	Key Parameters
Input Coupling	AC/DC selection	Impedance (50Ω/1MΩ)
Attenuator	Scale input range	Range, accuracy
Amplifier	Signal conditioning	Bandwidth, noise
ADC	Analog to digital	Resolution (bits), sample rate
Memory	Waveform storage	Depth, segmentation
Trigger	Capture control	Types, sensitivity

Key Specifications¶

Bandwidth¶

Bandwidth is the frequency at which a sine wave input is attenuated to 70.7% (-3 dB) of its original amplitude.

Rule of Thumb: Oscilloscope bandwidth should be at least 5× the highest frequency component of interest.

Required Bandwidth = 0.35 / Rise Time (10-90%)

Signal Type	Minimum Bandwidth
DDR4 3200	8 GHz
DDR5 4800	12 GHz
PCIe Gen4 (16 GT/s)	16 GHz
PCIe Gen5 (32 GT/s)	32 GHz
PCIe Gen6 (64 GT/s)	50+ GHz
USB4 (40 Gbps)	25+ GHz

Sample Rate¶

Sample rate determines how many data points the oscilloscope captures per second.

Nyquist Theorem: Sample rate must be at least 2× the highest frequency component.

Practical Rule: Use 4-5× oversampling for accurate waveform reconstruction.

Minimum Sample Rate = 2 × Bandwidth
Recommended Sample Rate = 4-5 × Bandwidth

Bandwidth	Minimum Sample Rate	Recommended
1 GHz	2 GSa/s	4-5 GSa/s
8 GHz	16 GSa/s	32-40 GSa/s
20 GHz	40 GSa/s	80-100 GSa/s
50 GHz	100 GSa/s	200-256 GSa/s

Memory Depth¶

Memory depth determines how long a waveform can be captured at the maximum sample rate.

Capture Time = Memory Depth / Sample Rate

Memory Depth	At 20 GSa/s	At 100 GSa/s
50 Mpts	2.5 ms	500 μs
500 Mpts	25 ms	5 ms
2 Gpts	100 ms	20 ms

Vertical Resolution¶

Resolution determines the smallest voltage change the oscilloscope can detect.

Resolution	Voltage Levels	Dynamic Range
8-bit	256	48 dB
10-bit	1024	60 dB
12-bit	4096	72 dB

Types of Oscilloscopes¶

Real-Time Oscilloscopes (RTO)¶

Real-time oscilloscopes capture the entire waveform in a single acquisition.

Characteristics:

Single-shot capture capability
Full bandwidth on every channel
Ideal for non-repetitive signals
Protocol decode and triggering

Best For:

Protocol debug and analysis
Capturing glitches and anomalies
Time-correlated multi-channel measurements
Power integrity analysis

Sampling Oscilloscopes¶

Sampling oscilloscopes build up a waveform picture over many acquisitions of a repetitive signal.

Characteristics:

Very high equivalent bandwidth (70+ GHz)
Low intrinsic jitter
Requires repetitive signal
Superior for eye diagram analysis

Best For:

Eye diagram measurements
Jitter analysis (TJ, RJ, DJ)
Compliance testing
Highest bandwidth requirements

Comparison¶

Feature	Real-Time	Sampling
Signal Type	Any	Repetitive only
Capture	Single-shot	Multiple triggers
Bandwidth	Up to 110 GHz	Up to 70+ GHz
Trigger Jitter	Higher	Very low
Eye Diagrams	Software-based	Hardware-based
Cost	Higher for same BW	Lower
Use Case	Debug, protocol	Compliance, characterization

Trigger System¶

Trigger Fundamentals¶

The trigger system determines when the oscilloscope starts capturing data.

                    Pre-trigger              Post-trigger
                    ◀────────────▶           ◀────────────▶
          ─────────────────────┬───────────────────────────
                               │
                         Trigger Point

Trigger Types¶

Type	Description	Use Case
Edge	Triggers on rising/falling edge	Basic waveform capture
Pulse Width	Triggers on pulse duration	Glitch detection
Pattern	Triggers on digital pattern	Bus debugging
Runt	Triggers on incomplete pulses	Signal integrity issues
Window	Triggers on amplitude violations	Out-of-spec detection
Sequence	Multi-stage trigger	Complex event capture
Protocol	Triggers on decoded data	Serial bus debug

Trigger Modes¶

Mode	Behavior
Auto	Triggers automatically if no events
Normal	Only triggers on valid events
Single	Captures one waveform, then stops

Probes and Signal Access¶

Probe Types¶

Probe Type	Bandwidth	Best For
Passive 10:1	< 500 MHz	Low-speed signals
Active Single-Ended	Up to 30 GHz	High-speed single-ended
Active Differential	Up to 50 GHz	High-speed differential
Current	Varies	Power analysis

Probe Selection Guidelines¶

graph TD
    A[Signal Type?] --> B{Differential?}
    B -->|Yes| C[Differential Probe]
    B -->|No| D{Frequency > 1 GHz?}
    D -->|Yes| E[Active Probe]
    D -->|No| F{High Impedance?}
    F -->|Yes| G[Active FET Probe]
    F -->|No| H[Passive 10:1]

Probe Compensation¶

Proper probe compensation is essential for accurate measurements:

Connect probe to compensation output
Adjust compensation capacitor
Verify square wave has flat top (no overshoot/undershoot)

Under-compensated    Properly Compensated    Over-compensated
     ╱────            ┌────┐                     ╱╲
    │                 │    │                    │  ╲──
    └────             └────┘                    │

Measurement Techniques¶

Automatic Measurements¶

Measurement	Description
Frequency	Signal repetition rate
Period	Time for one cycle
Rise Time	10% to 90% transition
Fall Time	90% to 10% transition
Vmax/Vmin	Maximum/minimum voltage
Vpp	Peak-to-peak voltage
Vrms	RMS voltage
Duty Cycle	Positive pulse width / period
Overshoot	% above steady state
Preshoot	% below steady state

Eye Diagram Analysis¶

Eye diagrams overlay multiple bit periods to visualize signal quality.

        Eye Height
            ↕
    ┌───────────────┐
    │   ╱╲   ╱╲     │  ← '1' Level
    │  ╱  ╲ ╱  ╲    │
    │ ╱    ╳    ╲   │
    │╱    ╱ ╲    ╲  │  ← Crossing
    │    ╱   ╲     │
    │   ╱     ╲    │  ← '0' Level
    └───────────────┘
        ◀───────▶
        Eye Width

Key Eye Measurements:

Measurement	Description	Significance
Eye Height	Vertical opening	Voltage margin
Eye Width	Horizontal opening	Timing margin
Jitter	Timing variation	Clock recovery ability
Rise/Fall Time	Transition speed	Bandwidth requirement
Crossing Level	Transition point	Receiver threshold

Jitter Analysis¶

Jitter Component	Description	Bounded?
Total Jitter (TJ)	All jitter components	No
Random Jitter (RJ)	Gaussian noise	No
Deterministic Jitter (DJ)	Systematic timing errors	Yes
Data Dependent Jitter (DDJ)	ISI-related	Yes
Periodic Jitter (PJ)	Clock-related	Yes
Duty Cycle Distortion (DCD)	Asymmetric transitions	Yes

TJ = DJ + n × RJ (at BER)

where n is determined by the target BER (e.g., n=14.07 for BER=10^-12)

Configuration Best Practices¶

Acquisition Setup¶

Setting	Recommendation
Sample Rate	4-5× bandwidth minimum
Memory Depth	Balance capture time vs. processing
Averaging	Use for noise reduction on repetitive signals
High-Res Mode	Enable for better effective resolution

Vertical Settings¶

Setting	Purpose
Scale	Set for signal to use 75% of screen
Offset	Center waveform or view specific level
Coupling	AC for removing DC offset, DC for full signal
Bandwidth Limit	Enable to reduce high-frequency noise

Horizontal Settings¶

Setting	Purpose
Time/Division	Set for desired number of cycles
Position	Move trigger point left/right
Zoom	Magnify specific waveform regions

High-Speed Signal Validation¶

Setup Checklist¶

Use appropriate probe (active differential for high-speed)
Minimize ground loop length
De-embed probe and fixture effects
Calibrate vertical and horizontal systems
Set proper termination (50Ω for high-speed)
Verify trigger stability
Configure sufficient memory depth

De-embedding¶

De-embedding removes the effects of probes, fixtures, and cables from measurements.

Signal at DUT → Cable → Fixture → Probe → Oscilloscope
                 │         │        │
                 └─────────┴────────┴── De-embed these

De-embedding Methods:

S-parameter de-embedding - Mathematically remove fixture response
InfiniiSim - Time-domain correction
Virtual probe - Apply inverse probe response

Mask Testing¶

Mask tests compare captured waveforms against predefined limits.

Result	Meaning
Pass	All samples within mask
Marginal	Close to mask boundary
Fail	Samples violate mask

Protocol Decode¶

Modern oscilloscopes can decode serial protocols:

Protocol	Trigger Capability	Analysis
PCIe	LTSSM states, TLP/DLLP	Link training, errors
DDR	Commands, data patterns	Timing, violations
USB	Packets, handshakes	Enumeration, transfers
I2C/SPI	Address, data	Transaction decode
MIPI	D-PHY, C-PHY	Lane analysis

Common Measurement Issues¶

Aliasing¶

Symptom: Incorrect frequency display, unstable waveform

Cause: Sample rate too low

Solution: Increase sample rate to 4-5× signal bandwidth

Ground Bounce¶

Symptom: Ringing on edges, measurement noise

Cause: Long ground lead inductance

Solution: Use shorter ground connection, differential probe

Probe Loading¶

Symptom: Slower rise times, reduced amplitude

Cause: Probe capacitance affecting circuit

Solution: Use active probe with lower input capacitance

Triggering Issues¶

Symptom: Unstable or missing triggers

Cause: Noise, incorrect trigger level

Solution: Adjust trigger level, enable HF rejection, use trigger holdoff

Brands and Models¶

Keysight Technologies¶

Model	Bandwidth	Key Features
Infiniium UXR	13-110 GHz	Ultra-high bandwidth, 10-bit ADC
Infiniium MXR	6-16 GHz	Mixed signal, 10-bit ADC
Infiniium EXR	2.5-8 GHz	Entry performance
86100D DCA-X	Sampling	Eye/jitter analysis

Tektronix¶

Model	Bandwidth	Key Features
DPO70000SX	33-70 GHz	ATI technology
MSO6 Series	4-8 GHz	FlexChannel
DSA8300	Sampling	Modular platform

Teledyne LeCroy¶

Model	Bandwidth	Key Features
LabMaster 10 Zi-A	36-100 GHz	ChannelSync
WavePro HD	8 GHz	12-bit resolution
WaveMaster 8	20-65 GHz	High bandwidth

Calibration and Maintenance¶

User Calibration¶

Perform regularly to maintain accuracy:

Warm-up: Allow 30 minutes after power-on
Self-Calibration: Run internal calibration routine
Probe Compensation: Adjust for each probe
Vertical Calibration: Verify DC accuracy

Performance Verification¶

Parameter	Interval	Method
DC Accuracy	Monthly	Known voltage source
Time Base	Annually	Reference oscillator
Bandwidth	Annually	Leveled sine source
Trigger Sensitivity	Annually	Sine wave test

BERT Fundamentals - Bit error rate testing
VNA Fundamentals - S-parameter analysis
PCIe Eye Diagram Analysis - PCIe signal validation

References¶

Oscilloscope manufacturer documentation
IEEE measurement standards
JEDEC/PCI-SIG compliance specifications