iucr

commissions

principles
aperiodic crystals
biological macromolecules
charge, spin and momentum densities
crystal growth and characterization of materials
crystallographic computing
crystallographic nomenclature
crystallographic teaching
crystallography in art and cultural heritage
crystallography of materials
electron crystallography
high pressure
inorganic and mineral structures
international tables
journals
magnetic structures
mathematical and theoretical crystallography
neutron scattering
nmr crystallography
powder diffraction
small-angle scattering
structural chemistry
synchrotron and xfel radiation
xafs

congress

2020 iucr xxv
2017 iucr xxiv
2014 iucr xxiii
2011 iucr xxii
2008 iucr xxi
2005 iucr xx
2002 iucr xix
1999 iucr xviii
1996 iucr xvii
1993 iucr xvi
1990 iucr xv
1987 iucr xiv
1984 iucr xiii
1981 iucr xii
1978 iucr xi
1975 iucr x
1972 iucr ix
1969 iucr viii
1966 iucr vii
1963 iucr vi
1960 iucr v
1957 iucr iv
1954 iucr iii
1951 iucr ii
1948 iucr i

people

nobel prize

all
agre
anfinsen
barkla
boyer
w.h.bragg
w.l.bragg
brockhouse
de broglie
charpak
crick
curl
davisson
debye
deisenhofer
geim
de gennes
hauptman
hodgkin
huber
karle
karplus
kendrew
klug
kobilka
kornberg
kroto
laue
lefkowitz
levitt
lipscomb
mackinnon
michel
novoselov
pauling
perutz
ramakrishnan
roentgen
shechtman
shull
skou
smalley
steitz
sumner
thomson
walker
warshel
watson
wilkins
yonath

resources

commissions

aperiodic crystals
biological macromolecules
charge, spin and momentum densities
crystallographic computing
crystal growth and characterization of materials
crystallographic nomenclature
crystallographic teaching
crystallography in art and cultural heritage
crystallography of materials
electron crystallography
high pressure
inorganic and mineral structures
international tables
journals
magnetic structures
mathematical and theoretical crystallography
neutron scattering
nmr crystallography
powder diffraction
small-angle scattering
structural chemistry
synchrotron radiation
xafs

- Of mentors and role models
- Editorial
- Web links
- Trueblood memorial
- ECM sessions
- 18th IUCr congress
- High Pressure Commission workshop
- Crystal simulation workshop
- Foundations of macromolecular structure refinement
- Area detectors
- New CIF dictionaries
- More from ECM 18
- Martensitic phase transformations
- Indian world of crystallography
- Chemical crystallography in Latvia
- Serbian crystallographers
- ACA summer school
- Microgravity in Granada
- Electron school
- ICDD 2000 scholarship awards
- PDB relocation
- International collaboration
- SHELXTL manual
- ICSD
- Frank G. Foote (1906-1998)
- Evgeny Konstantinovich Vasil'ev (1922-1999)
- Emil Harutyunan (1935-1998)

Techniques for macromolecular refinement continue to advance apace. The quality of data is improving with easier access to synchrotron sources, computing power is increasing while the cost is declining, and new algorithms are helping to put the calculations on a firmer statistical basis. In the past six months, three papers have appeared in *Acta Cryst. A* and *D *discussing the role of the normal matrix, the second-derivative matrix of the refinement target function.

The first problem to address is simply one of size; the normal matrix has the dimension of the number of parameters squared, and the time taken to generate it by classical techniques is proportional to the square of the number of atoms multiplied by the number of observations. The papers by Tronrud ["Efficient calculation of normal matrix in least-squares refinement of macromolecular structures", *Acta Cryst.* A**55** (1999), 700-703]; Murshudov, Vagin, Lebedev, Wilson and Dodson ["Efficient anisotropic refinement of macromolecular structures using FFT", *Acta Cryst.* D**55** (1999), 247-255]; and Templeton ["Faster calculation of the full matrix for least-squares refinement", *Acta Cryst.* A**55** (1999), 695-699] all discuss ways of speeding up the calculations. These methods can be traced back first to Cruickshank who described an approach to refinement using Fourier methods in the 1950s [*Acta Cryst.* **5** (1952), 511-518; *Acta Cryst.* **9** (1956), 747-753], and then to Agarwal who showed how to exploit fast Fourier transforms (FFTs) [*Acta Cryst.* A**34** (1978), 791-809]. He outlined a method for the fast calculation of second-derivative matrices, which is extended by Tronrud and generalized by Murshudov *et al.* Templeton extends another aspect of Agarwal's results, *i.e.*, he makes approximations by replacing summations with integration assuming that the reciprocal space sampling is dense enough to justify this.

Most experience in exploiting the full normal matrix is in the field of small-molecule crystallography; here, it is feasible to generate the derivatives analytically, and to perform the inversion. When there is a high ratio of observations to parameters, its use has been shown to speed up the rate of convergence, and to reduce the likelihood of reaching a false minimum. When the refinement has converged, the inverse of the normal matrix reveals both the precision of the model parameters and the correlations between them. The eigenvectors and eigenvalues of the normal matrix provide information about parameters or parameter combinations that are not determined by the original data.

For large macromolecules, even if the full normal matrix is generated, there will be considerable problems in the inversion of such a large array. However, there are now many numerical tools developed within a variety of disciplines addressing such problems. The stability of the inversion procedure can be analysed using eigenvalues and -vectors, and this was discussed by Cowtan and Ten Eyck at the 18th European Crystallographic Meeting in Prague, Czech Republic in August 1998. They have performed such an eigensystem analysis on the normal matrices resulting from the least-squares refinement of a small metalloprotein using two datasets and models determined at different resolutions (all performed by classical techniques using the program *SHELXL *at the San Diego Supercomputer Center) [Sheldrick (1995), *SHELXL93, a Program for the Refinement of Crystal Structures from Diffraction Data. *Institut für Anorganische Chemie, Göttingen, Germany]. As a protein refinement is usually underdetermined without the application of geometric restraints, and these contributions are routinely included in the minimization residual, they have repeated their analysis including the contributions from such restraints. They show that the eigenvalue spectra reveal considerable information about the conditioning of the problem as the resolution varies. In the case of a restrained refinement, the spectra also provide information about the impact of various restraints on the refinement.

The established procedure used in macromolecular refinement programs such as *SFALL*/*PROLSQ*, *XPLOR*, and *REFMAC *has been to generate only the diagonal elements of the normal matrix for the X-ray data. Although this limits the rate of convergence, it does mean that each cycle is completed quickly because structure factors and gradients can both be generated using FFTs. All such programs incorporate the restraint derivative terms into the matrix, with some rather arbitrary weighting relative to the X-ray elements. The derivatives for these contributions can be generated simply, and provide off-diagonal terms for linked atoms only. Templeton's approximations for the maximum contribution for the X-ray off-diagonal terms show that these fall off rapidly with the distance between the atom pairs. Hence the geometric restraint contributions may well swamp any X-ray contribution to off-diagonal elements, especially when the resolution of the X-ray data is limited. But as Cowtan and Ten Eyck show, there are special situations where unexpected interactions link distant atoms, and these can degrade the course of refinement.

The FFT techniques for estimating the X-ray off-diagonal elements will make it possible to derive a much improved form for the full normal matrix in a realistic time, and we can look forward to further analyses, and a better understanding of the proper parameterization and accuracy of macromolecular structures.

Eleanor Dodson, U. of York, UK
The International Union of Crystallography is a non-profit scientific union serving the world-wide interests of crystallographers and other scientists employing crystallographic methods.

© International Union of Crystallography