# The Full Wiki

Note: Many of our articles have direct quotes from sources you can cite, within the Wikipedia article! This article doesn't yet, but we're working on it! See more info or our list of citable articles.

# Encyclopedia

A radial basis function (RBF) is a real-valued function whose value depends only on the distance from the origin, so that $\phi(\mathbf{x}) = \phi(\|\mathbf{x}\|)$; or alternatively on the distance from some other point c, called a center, so that $\phi(\mathbf{x}, \mathbf{c}) = \phi(\|\mathbf{x}-\mathbf{c}\|)$. Any function φ that satisfies the property $\phi(\mathbf{x}) = \phi(\|\mathbf{x}\|)$ is a radial function. The norm is usually Euclidean distance, although other distance functions are also possible. For example by using Lukaszyk-Karmowski metric it is for some radial functions possible[1] to avoid problems with ill conditioning of the matrix solved to determine coefficients wi (see below), since the $\|\mathbf{x}\|$ is always greater than zero.

Sums of radial basis functions are typically used to approximate given functions. This approximation process can also be interpreted as a simple kind of neural network.

## RBF types

Commonly used types of radial basis functions include $(r = \|\mathbf{x} - \mathbf{c}_i\|)$:

$\varphi(r) = \exp(-\beta r^2)\text{ for some }\beta > 0 \,$
$\varphi(r) = \sqrt{r^2 + \beta^2}\text{ for some }\beta > 0 \,$
$\varphi(r) = r^k,\; k=1,3,5,\dots$
$\varphi(r) = r^k \ln(r),\; k=2,4,6,\dots$
$\varphi(r) = r^2 \ln(r)\;$

## Approximation

Radial basis functions are typically used to build up function approximations of the form

$y(\mathbf{x}) = \sum_{i=1}^N w_i \, \phi(\|\mathbf{x} - \mathbf{c}_i\|),$

where the approximating function y(x) is represented as a sum of N radial basis functions, each associated with a different center ci, and weighted by an appropriate coefficient wi. The weights wi can be estimated using the matrix methods of linear least squares, because the approximating function is linear in the weights.

Approximation schemes of this kind have been particularly used in time series prediction and control of nonlinear systems exhibiting sufficiently simple chaotic behaviour, 3D reconstruction in computer graphics (for example, hierarchical RBF).

## RBF network

Two unnormalized Gaussian radial basis functions in one input dimension. The basis function centers are located at c1=0.75 and c2=3.25.

The sum

$y(\mathbf{x}) = \sum_{i=1}^N w_i \, \phi(\|\mathbf{x} - \mathbf{c}_i\|),$

can also be interpreted as a rather simple single-layer type of artificial neural network called a radial basis function network, with the radial basis functions taking on the role of the activation functions of the network. It can be shown that any continuous function on a compact interval can in principle be interpolated with arbitrary accuracy by a sum of this form, if a sufficiently large number N of radial basis functions is used.

The approximant y(x) is differentiable with respect to the weights wi. The weights could thus be learned using any of the standard iterative methods for neural networks.

## References

1. ^ Lukaszyk, S. (2004) A new concept of probability metric and its applications in approximation of scattered data sets. Computational Mechanics, 33, 299-3004. limited access