Variational Quantum Algorithms

Theory of variational quantum algorithms including the variational principle, VQE, QAOA, barren plateaus, and gradient computation methods. This guide connects the theoretical foundations to pyqpanda3's variational quantum circuit (VQC) framework.

---

The Variational Principle

Rayleigh-Ritz Variational Principle

The foundation of all variational quantum algorithms is the Rayleigh-Ritz variational principle:

For any parameterized quantum state $|\psi (\overrightarrow{\theta })⟩$ and any Hamiltonian $H$, the expectation value of the energy provides an upper bound on the ground state energy $E_0$:

$$⟨\psi (\overrightarrow{\theta })|H|\psi (\overrightarrow{\theta })⟩\ge E_0$$

Equality holds if and only if $|\psi (\overrightarrow{\theta })⟩$ is the ground state of $H$.

Energy as a Cost Function

The variational principle allows us to formulate the ground state problem as an optimization:

$$E_0=\underset{\overrightarrow{\theta }}{min}⟨\psi (\overrightarrow{\theta })|H|\psi (\overrightarrow{\theta })⟩$$

The loss function (energy) is:

$$L(\overrightarrow{\theta })=⟨\psi (\overrightarrow{\theta })|H|\psi (\overrightarrow{\theta })⟩$$

This loss function has important properties:

• Non-negative curvature: $L(\overrightarrow{\theta })\ge E_0\ge {\lambda }_{min}(H)$
• Smooth: $L$ is a smooth function of $\overrightarrow{\theta }$ for analytic ansatzes
• Observable: $L(\overrightarrow{\theta })$ can be estimated from quantum measurements

Variational Quantum Circuits as Trial States

In pyqpanda3, the trial state $|\psi (\overrightarrow{\theta })⟩$ is prepared by a variational quantum circuit (VQC) — a parameterized quantum circuit:

$$|\psi (\overrightarrow{\theta })⟩=U(\overrightarrow{\theta })|0{⟩}^{\otimes n}$$

where $U(\overrightarrow{\theta })$ is a unitary circuit parameterized by $\overrightarrow{\theta }=({\theta }_1,{\theta }_2,\dots ,{\theta }_p)$.

The VQC is constructed using pyqpanda3's VQCircuit class:

from pyqpanda3.vqcircuit import VQCircuit
from pyqpanda3.core import RY, CNOT
import numpy as np

# Build a hardware-efficient ansatz
vqc = VQCircuit()
vqc << RY(0, vqc.Param([0], "theta_0"))
vqc << RY(1, vqc.Param([1], "theta_1"))
vqc << CNOT(0, 1)
vqc << RY(0, vqc.Param([2], "theta_2"))
vqc << RY(1, vqc.Param([3], "theta_3"))

Expressibility

The expressibility of a VQC measures how well it can explore the Hilbert space. A perfectly expressible ansatz generates the Haar-uniform distribution of unitaries. Less expressible ansatzes may not be able to reach the optimal solution.

Expressibility is measured by the deviation from the Haar distribution:

$$\mathcal{E}=D_{\text{KL}}(P_{\text{ansatz}}|P_{\text{Haar}})$$

A well-designed ansatz balances expressibility against trainability (avoiding barren plateaus).

---

VQE — Variational Quantum Eigensolver

Algorithm Overview

The Variational Quantum Eigensolver (VQE) is a hybrid quantum-classical algorithm for finding the ground state energy of a Hamiltonian:

Hamiltonian Decomposition

To measure the energy on a quantum computer, the Hamiltonian must be decomposed into measurable Pauli strings:

$$H=\sum _i{h}_i{P}_i$$

where $P_i\in \{I,X,Y,Z{\}}^{\otimes n}$ are Pauli operators and $h_i$ are coefficients.

The energy expectation is then:

$$⟨H⟩=\sum _i{h}_i⟨P_i⟩$$

Each $⟨P_i⟩$ is estimated from quantum measurements. Pauli strings that commute can be measured simultaneously (grouped into the same measurement circuit).

pyqpanda3 provides:

• expval_hamiltonian(prog, hamiltonian, qvm, shots) — direct expectation value computation
• expval_pauli_operator(prog, pauli_op, qvm, shots) — Pauli operator expectation

Ansatz Design Strategies

Hardware-Efficient Ansatz:

Designed to match the native gate set and connectivity of the target hardware:

$$U(\overrightarrow{\theta })=\prod _{l=1}^L[\prod _{i}RY({\theta }_{l,i})]\cdot \text{ENTANGLE}$$

where ENTANGLE is a layer of CNOT gates matching the hardware topology.

• Pros: Shallow depth, native gates, fewer SWAP overhead
• Cons: May require many layers, susceptible to barren plateaus

Chemically-Inspired Ansatz (Unitary Coupled Cluster):

Based on the unitary coupled cluster singles and doubles (UCCSD):

$$U(\overrightarrow{\theta })=e^{T(\overrightarrow{\theta })-T^{†}(\overrightarrow{\theta })}$$

where $T(\overrightarrow{\theta })=\sum _{ia}{\theta }_i^a{a}_a^{†}{a}_i+\sum _{i<j,a<b}{\theta }_{ij}^{ab}{a}_a^{†}{a}_b^{†}{a}_j{a}_i$

• Pros: Physically motivated, few parameters for small molecules
• Cons: Deep circuits, requires Trotterization

Adaptive Ansatz (ADAPT-VQE):

Grow the ansatz iteratively by adding the operator with the largest gradient:

$$U_{k+1}=e^{{\theta }_{k+1}{A}_{k+1}}{U}_k$$

where $A_{k+1}=\arg \underset{A\in \text{pool}}{max}|\frac{\partial E}{\partial {\theta }_A}{|}_{{\theta }_A=0}|$

• Pros: Compact ansatz, systematic construction
• Cons: Requires gradient pool evaluation at each step

Classical Optimization

The classical optimizer updates parameters to minimize the energy:

$${\overrightarrow{\theta }}_{k+1}={\overrightarrow{\theta }}_k-\eta \mathrm{\nabla }L({\overrightarrow{\theta }}_k)$$

Common optimizers used with VQE:

Optimizer	Type	Pros	Cons
Gradient Descent	First-order	Simple, stable	Slow convergence
Adam	First-order (adaptive)	Fast, robust	May oscillate
L-BFGS-B	Quasi-Newton	Superlinear convergence	Noisy gradient sensitive
COBYLA	Derivative-free	Handles noise	Slow for many parameters
SPSA	Stochastic	Noise-tolerant, $O(1)$ measurements per step	Slow convergence
SNOBFIT	Surrogate model	Good for noisy landscapes	Expensive per iteration

Shot Noise and Statistical Error

The energy estimate has statistical uncertainty from finite measurement shots:

$${\sigma }_E=\sqrt{\sum _i{h}_i^2\frac{\text{Var}(P_i)}{N_{\text{shots}}}}$$

where $\text{Var}(P_i)=1-⟨P_i{⟩}^2$ for Pauli observables.

Rule of thumb: Doubling the accuracy requires $4\times$ more shots (standard quantum limit).

Convergence Analysis

VQE convergence depends on:

1. Ansatz quality: Can the ansatz reach the ground state?
2. Optimizer efficiency: How quickly does the optimizer find the minimum?
3. Noise resilience: How much does noise affect the energy estimate?

VQE is generally considered noise-resilient because:

• The variational principle still holds (noisy energy is still an upper bound)
• The optimizer can partially compensate for systematic noise
• Error bars from shot noise can guide the optimizer

---

QAOA — Quantum Approximate Optimization Algorithm

Algorithm Overview

QAOA is designed for combinatorial optimization problems. Given a cost function $C(x)$ on bitstrings $x\in \{0,1{\}}^n$, QAOA prepares a state that approximately minimizes $C$:

$$|\overrightarrow{\gamma },\overrightarrow{\beta }⟩=\prod _{p=1}^P{e}^{-i{\beta }_p{H}_M}{e}^{-i{\gamma }_p{H}_C}|+{⟩}^{\otimes n}$$

where:

• $H_C=\sum _{x}C(x)|x⟩⟨x|$ is the cost Hamiltonian (diagonal in computational basis)
• $H_M=\sum _i{X}_i$ is the mixer Hamiltonian
• $\overrightarrow{\gamma }=({\gamma }_1,\dots ,{\gamma }_P)$ and $\overrightarrow{\beta }=({\beta }_1,\dots ,{\beta }_P)$ are the variational parameters
• $P$ is the QAOA depth (number of alternating layers)

MaxCut Example

The canonical QAOA application is MaxCut. Given a graph $G=(V,E)$:

Cost Hamiltonian:

$$H_C=\sum _{(i,j)\in E}\frac{1}{2}(I-Z_i{Z}_j)$$

This assigns energy $-1$ to edges whose vertices have different $Z$ values (i.e., are in different partitions) and energy $+1$ to edges in the same partition.

Mixer Hamiltonian:

$$H_M=\sum _{i\in V}{X}_i$$

QAOA circuit construction:

Each cost layer $e^{-i{\gamma }_p{H}_C}$ decomposes into RZZ gates:

$$e^{-i{\gamma }_p{H}_C}=\prod _{(i,j)\in E}{e}^{i{\gamma }_p{Z}_i{Z}_j/2}$$

Each mixer layer $e^{-i{\beta }_p{H}_M}$ decomposes into RX gates:

$$e^{-i{\beta }_p{H}_M}=\prod _i{e}^{-i{\beta }_p{X}_i}=\prod _{i}RX(2{\beta }_p{)}_i$$

Approximation Ratio

The approximation ratio measures QAOA quality:

$$\alpha =\frac{⟨H_C{⟩}_{\text{QAOA}}}{\text{opt}(H_C)}$$

• $P=1$: $\alpha =0.6924$ for MaxCut on 3-regular graphs (guaranteed by QAOA theory)
• $P\to \mathrm{\infty }$: $\alpha \to 1$ (QAOA converges to optimal)
• In practice, $P=5$ to $20$ often achieves $\alpha >0.9$

QAOA Variants

Variant	Description	Advantage
Standard QAOA	Fixed depth $P$, optimize $\overrightarrow{\gamma },\overrightarrow{\beta }$	Theoretical guarantees
Warm-Start QAOA	Initialize from classical solution	Better initial point
Recursive QAOA	Fix qubits iteratively	Reduces problem size
Multi-angle QAOA	Different angles per gate	More expressive
QAOA with constraints	Penalty terms in $H_C$	Handles constrained problems

---

Barren Plateaus

The Vanishing Gradient Problem

Barren plateaus occur when the gradient of the cost function vanishes exponentially with the number of qubits:

$$\text{Var}\left[\frac{\partial L}{\partial {\theta }_i}\right]\in O\left(\frac{1}{2^n}\right)$$

This means that for a system of $n$ qubits, the gradient is exponentially small, making optimization intractable.

Causes of Barren Plateaus

1. Expressibility-induced: Highly expressible ansatzes that cover the entire Hilbert space tend to concentrate cost function values around the mean, flattening the landscape.

2. Entanglement-induced: Deep entangling circuits produce global states where local parameter changes have exponentially small effects.

3. Noise-induced: Hardware noise flattens the cost landscape by driving all outputs toward the maximally mixed state.

4. Global cost functions: Cost functions that depend on all qubits simultaneously (e.g., global fidelity) exhibit barren plateaus even for shallow circuits.

Mitigation Strategies

1. Local Cost Functions:

Replace global cost functions with local ones:

$$L_{\text{global}}=1-⟨\psi |U_{\text{target}}^{†}O{U}_{\text{target}}|\psi ⟩$$$$L_{\text{local}}=\frac{1}{n}\sum _{i=1}^n(1-⟨\psi |U_{\text{target}}^{†}{O}_i{U}_{\text{target}}|\psi ⟩)$$

Local cost functions have gradients that vanish polynomially rather than exponentially.

2. Structured Ansatz:

Use ansatzes with built-in structure (e.g., symmetry-preserving, problem-inspired):

• QAOA ansatz for combinatorial optimization
• UCCSD ansatz for chemistry
• Hardware-efficient ansatz with limited depth

3. Parameter Initialization:

• Identity initialization: Start with parameters close to the identity circuit ($\theta \approx 0$)
• Layer-by-layer training: Train one layer at a time, adding layers incrementally
• Classical pre-training: Use classical optimization to find a good initial point

4. Gradient Preserving Architectures:

• Use circuits where the gradient magnitude is provably lower-bounded
• Examples: quantum convolutional neural networks (QCNN), certain hierarchical circuits

---

Gradient Computation Methods

Overview

Computing gradients of the expectation value $⟨H{⟩}_{\overrightarrow{\theta }}$ with respect to parameters $\overrightarrow{\theta }$ is central to optimizing variational quantum algorithms. Several methods exist with different trade-offs:

Parameter-Shift Rule

The parameter-shift rule provides an exact gradient using two circuit evaluations per parameter:

$$\frac{\partial }{\partial {\theta }_i}⟨H⟩=\frac{⟨H{⟩}_{{\theta }_i+s}-⟨H{⟩}_{{\theta }_i-s}}{2\sin (s)}$$

where $s$ is the shift value (typically $s=\pi /2$).

For generators $G$ with eigenvalues $\pm r/2$ (e.g., Pauli generators):

$$\frac{\partial }{\partial {\theta }_i}⟨H⟩=r(⟨H{⟩}_{{\theta }_i+\pi /(2r)}-⟨H{⟩}_{{\theta }_i-\pi /(2r)})$$

Cost: $2p$ circuit evaluations for $p$ parameters.

Advantages:

• Exact gradient (no approximation error)
• Hardware-compatible (only needs forward evaluations)
• Works with shot noise (statistical error only)

Adjoint Differentiation

Adjoint differentiation computes the gradient in $O(1)$ circuit evaluations regardless of the number of parameters. This is the method used by pyqpanda3's ADJOINT_DIFF:

$$\frac{\partial }{\partial {\theta }_i}⟨H⟩=\text{Re}[⟨{\varphi }_L|\frac{\partial U}{\partial {\theta }_i}|{\varphi }_R⟩]$$

where $|{\varphi }_L⟩=U^{†}|{\psi }_{\text{meas}}⟩$ and $|{\varphi }_R⟩=U|{\psi }_{\text{init}}⟩$.

Algorithm (Jones & Gacon, 2020):

1. Forward pass: compute $|{\varphi }_R⟩=U(\overrightarrow{\theta })|0⟩$
2. Backward pass: apply gates in reverse, computing inner products
3. Total: 2 circuit evaluations (one forward, one backward) regardless of parameter count

Cost: 2 circuit evaluations total.

Advantages:

• Dramatically faster for large parameter counts: $O(1)$ vs $O(2p)$
• Exact gradient
• Well-suited for simulation-based optimization

Limitations:

• Requires storing intermediate state vectors (memory: $O(2^n)$)
• Only applicable in statevector simulation, not hardware measurements
• Implementation-dependent on the simulator

Usage in pyqpanda3:

from pyqpanda3.vqcircuit import VQCircuit, DiffMethod
from pyqpanda3.hamiltonian import Hamiltonian
import numpy as np

vqc = VQCircuit()
# ... build ansatz ...

params = np.array([0.1, 0.2, 0.3, 0.4])
observable = Hamiltonian(...)

# Get gradients using adjoint differentiation
gradients = vqc.get_gradients(params, observable, DiffMethod.ADJOINT_DIFF)

# Get both gradients and expectation value simultaneously
result = vqc.get_gradients_and_expectation(params, observable, DiffMethod.ADJOINT_DIFF)
expectation = result.expectation_val()
grads = result.gradients()

Finite Differences

The simplest gradient approximation:

$$\frac{\partial }{\partial {\theta }_i}⟨H⟩\approx \frac{⟨H{⟩}_{{\theta }_i+h}-⟨H{⟩}_{{\theta }_i-h}}{2h}$$

Cost: $2p$ circuit evaluations for $p$ parameters.

Disadvantages:

• Approximation error $\sim O(h^2)$
• Choosing $h$: too small → noise dominated; too large → approximation error
• Not recommended for quantum computing due to shot noise sensitivity

Linear Combination of Unitaries (LCU)

An advanced method using ancilla qubits:

$$\frac{\partial }{\partial {\theta }_i}⟨H⟩=\text{Re}[⟨0|V_i^{†}{U}^{†}HU{V}_i|0⟩]$$

Can be implemented with Hadamard tests or iterative QPE, but requires ancilla qubits and controlled versions of gates.

Comparison Table

Method	Circuit Evals	Exact?	Hardware?	Memory
Parameter-Shift	$2p$	Yes	Yes	$O(n)$ qubits
Adjoint (ADJOINT_DIFF)	2	Yes	No (simulation only)	$O(2^n)$ statevector
Finite Differences	$2p$	No ($O(h^2)$)	Yes	$O(n)$ qubits
LCU	$O(1)$ + ancilla	Yes	Yes (with ancilla)	$O(n+k)$ qubits

For pyqpanda3 simulations, ADJOINT_DIFF is the recommended method due to its $O(1)$ scaling. For hardware experiments, the parameter-shift rule is the standard choice.

---

Parameter Management in pyqpanda3

Multi-Dimensional Parameters

pyqpanda3 supports multi-dimensional parameter arrays through the set_Param() and Param() methods:

vqc = VQCircuit()

# Set parameter dimensions: e.g., 3 layers × 4 parameters
vqc.set_Param([3, 4], ["layer", "param"])

# Access a specific parameter element
theta_00 = vqc.Param([0, 0], "theta_00")  # Layer 0, param 0
theta_12 = vqc.Param([1, 2], "theta_12")  # Layer 1, param 2

This is useful for:

• Batch optimization: Evaluate gradients for multiple parameter sets simultaneously
• Structured ansatzes: Map parameters to physical structure (e.g., layer × qubit)
• Transfer learning: Share parameters between circuit blocks

Batch Gradient Computation

For $N$ sets of parameters, pyqpanda3 provides batch gradient computation:

# Single parameter set
grads = vqc.get_gradients(params_1d, observable, DiffMethod.ADJOINT_DIFF)
# Returns: ResGradients (1 set of gradients)

# N parameter sets (flat array, row-major order)
grads_n = vqc.get_gradients(params_flat, observable, N, DiffMethod.ADJOINT_DIFF)
# Returns: ResNGradients (N sets of gradients)

Result Classes

Class	Method	Returns
ResGradients	get_gradients(params, H, diff)	Gradients for 1 parameter set
ResNGradients	get_gradients(params, H, N, diff)	Gradients for N parameter sets
ResGradientsAndExpectation	get_gradients_and_expectation(params, H, diff)	Gradients + expectation for 1 set
ResNResGradientsAndExpectation	get_gradients_and_expectation(params, H, N, diff)	Gradients + expectation for N sets

---

Practical Considerations

Ansatz Selection Guide

Problem Type	Recommended Ansatz	Rationale
Molecular ground state	UCCSD / k-UpCCGSD	Chemically motivated, systematic improvability
Combinatorial optimization	QAOA	Theoretical guarantees, structured
General optimization	Hardware-efficient	Shallow depth, hardware-native
Quantum machine learning	Layered rotations + entanglement	Expressibility, trainable
Dynamical simulation	Trotterized evolution	Physically motivated

Optimizer Selection Guide

Scenario	Recommended Optimizer
Simulation (exact gradients)	L-BFGS-B with adjoint differentiation
Noisy simulation	Adam with learning rate scheduling
Hardware (shot noise)	SPSA or parameter-shift + Adam
Few parameters	COBYLA (derivative-free)
Many parameters	Adam or natural gradient methods

Performance Tips

1. Use adjoint differentiation when simulating: $O(1)$ vs $O(p)$ gradient evaluations
2. Group Pauli measurements: Commuting Pauli strings can be measured simultaneously
3. Use get_gradients_and_expectation: Computes both in a single call, more efficient than separate computations
4. Warm-start from classical solutions: Initialize parameters from classically solvable approximations
5. Monitor convergence: Track both energy and gradient norm; stop when gradient norm is below threshold

---

See Also

• VQCircuit API — Full API for variational quantum circuits
• DiffMethod — Differentiation method enum
• Gradient Results — ResGradients and related classes
• Hamiltonian — Hamiltonian construction
• VQA Workflow Diagram — Visual VQA optimization loop
• Quantum Gate Theory — Gate fundamentals
• Noise Model Theory — Noise in variational algorithms