AlanTuring.net Reference Articles on Turing

The Church-Turing Thesis

By Jack Copeland

© Copyright B.J. Copeland, June 2000

There are various equivalent formulations of the Turing-Church thesis (which is also known as Turing's thesis, Church's thesis, and the Church-Turing thesis). One formulation of the thesis is that every effective computation can be carried out by a Turing machine.

Effective Methods

The Turing-Church thesis concerns the notion of an effective or mechanical method in logic and mathematics. 'Effective' and its synonym 'mechanical' are terms of art in these disciplines: they do not carry their everyday meaning. A method, or procedure, M, for achieving some desired result is called 'effective' or 'mechanical' just in case

  1. M is set out in terms of a finite number of exact instructions (each instruction being expressed by means of a finite number of symbols);
  2. M will, if carried out without error, always produce the desired result in a finite number of steps;
  3. M can (in practice or in principle) be carried out by a human being unaided by any machinery save paper and pencil;
  4. M demands no insight or ingenuity on the part of the human being carrying it out.

A well-known example of an effective method is the truth table test for tautologousness. In practice, this test is unworkable for formulae containing a large number of propositional variables, but in principle one could apply it successfully to any formula of the propositional calculus, given sufficient time, tenacity, paper, and pencils.

Statements that there is an effective method for achieving such-and-such a result are commonly expressed by saying that there is an effective method for obtaining the values of such-and-such a mathematical function. For example, that there is an effective method for determining whether or not any given formula of the propositional calculus is a tautology - e.g. the truth table method - is expressed in function-speak by saying that there is an effective method for obtaining the values of a function, call it T, whose domain is the set of formulae of the propositional calculus and whose value for any given formula x, written T(x), is 1 or 0 according to whether x is, or is not, a tautology.

The Thesis and its History

The notion of an effective method is an informal one, and attempts to characterise effectiveness, such as the above, lack rigour, for the key requirement that the method demand no insight or ingenuity is left unexplicated. One of Turing's achievements in his paper of 1936 was to present a formally exact predicate with which the informal predicate 'can be calculated by means of an effective method' may be replaced. Church did the same (1936a). The replacement predicates that Turing and Church proposed were, on the face of it, very different from one another, but they turned out to be equivalent, in the sense that each picks out the same set of mathematical functions. The Turing-Church thesis is the assertion that this set contains every function whose values can be obtained by a method satisfying the above conditions for effectiveness. (Clearly, if there were functions of which the informal predicate, but not the formal predicate, were true, then the latter would be less general than the former and so could not reasonably be employed to replace it.) When the thesis is expressed in terms of the formal concept proposed by Turing, it is appropriate to refer to the thesis also as 'Turing's thesis'; and mutatis mutandis in the case of Church.

The formal concept proposed by Turing is that of computability by Turing machine. He argued for the claim (Turing's thesis) that whenever there is an effective method for obtaining the values of a mathematical function, the function can be computed by a Turing machine. The converse claim is easily established, for a Turing machine program is itself a specification of an effective method: a human being can work through the instructions in the program and carry out the operations called for without the exercise of any ingenuity or insight. If Turing's thesis is correct then talk about the existence and non-existence of effective methods can be replaced throughout mathematics and logic by talk about the existence or non-existence of Turing machine programs.

Turing stated his thesis in numerous places, with varying degrees of rigour. The following formulation is one of the most accessible.

Turing's thesis: 'LCMs [logical computing machines: Turing's expression for Turing machines] can do anything that could be described as "rule of thumb" or "purely mechanical".' (Turing 1948: 7.) He adds

'This is sufficiently well established that it is now agreed amongst logicians that "calculable by means of an LCM" is the correct accurate rendering of such phrases.' (Ibid.)

Here are two other formulations of Turing's thesis.

'[T]he "computable numbers" [the numbers whose decimal representations can be generated progressively by a Turing machine] include all numbers which would naturally be regarded as computable.' (Turing 1936: 249.)

(As Turing explains: 'Although the subject of this paper is ostensibly the computable numbers, it is almost equally easy to define and investigate computable functions ... I have chosen the computable numbers for explicit treatment as involving the least cumbrous technique' (1936: 230).)

'It is my contention that these operations [the primitive operations of a Turing machine] include all those which are used in the computation of a number.' (Turing 1936: 232.)

In order to understand these assertions exactly as Turing intended them it is necessary to bear in mind that when he uses the words 'computer', 'computable' and 'computation' he employs them as pertaining to human calculators. In 1936 'computers' were human clerks who worked in accordance with effective methods. These human computers did the sort of calculations nowadays carried out by computing machines, and many thousands of them were employed in commerce, government, and research establishments. The computable numbers and the computable functions are the numbers and functions that can be calculated by human computers (idealised to the extent of living forever and having access to unlimited quantities of paper and pencils).

Turing introduced his thesis in the course of arguing that the Entscheidungsproblem, or decision problem, for the predicate calculus - posed by Hilbert (Hilbert and Ackermann 1928) - is unsolvable. Here is Church's account of the Entscheidungsproblem:

'By the Entscheidungsproblem of a system of symbolic logic is here understood the problem to find an effective method by which, given any expression Q in the notation of the system, it can be determined whether or not Q is provable in the system.' (Church 1936b: 41.)

The truth table test is such a method for the propositional calculus. Turing showed that, given his thesis, there can be no such method for the predicate calculus. He proved formally that there is no Turing machine which can determine, in a finite number of steps, whether or not any given formula of the predicate calculus is a theorem of the calculus. So, given his thesis that if an effective method exists then it can be carried out by one of his machines, it follows that there is no such method to be found.

Church had arrived at the same negative result a few months earlier, employing the concept of lambda-definability in place of computability by Turing machine. Church and Turing discovered the result quite independently of one another. Turing's method of obtaining it is rather more satisfying than Church's, as Church himself acknowledged in a review of Turing's work:

'computability by a Turing machine ... has the advantage of making the identification with effectiveness in the ordinary (not explicitly defined) sense evident immediately'. (1937a: 43.)

(Another aspect in which their approaches differ is that Turing's concerns were rather more general than Church's, in that the latter considered only functions of positive integers (see below), whereas Turing described his work as encompassing 'computable functions of an integral variable or a real or computable variable, computable predicates, and so forth' (1936: 230). He intended to pursue the theory of computable functions of a real variable in a subsequent paper, but in fact did not do so.)

Church used the (informal) expression 'effectively calculable' to indicate that there is an effective method for calculating the values of the function. He proposed that we

'define the notion ... of an effectively calculable function of positive integers by identifying it with the notion of a recursive function of positive integers (or of a lambda-definable function of positive integers)'. (1936a: 356.)

The concept of a lambda-definable function is due to Church and Kleene (Church 1932, 1936a, 1941, Kleene 1935) and the concept of a recursive function to Godel and Herbrand (Godel 1934, Herbrand 1932). The class of lambda-definable functions and the class of recursive functions are identical. This was established in the case of functions of positive integers by Church and Kleene (Church 1936a, Kleene 1936). After learning of Church's proposal, Turing quickly established that the apparatus of lambda-definability and his own apparatus of computability are equivalent (1936: 263ff). Thus, in Church's proposal, the words 'recursive function of positive integers' can be replaced by the words 'function of positive integers computable by Turing machine'.

Post referred to Church's identification of effective calculability with recursiveness as a 'working hypothesis', and quite properly criticised Church for masking this hypothesis as a definition.

'[T]o mask this identification under a definition ... blinds us to the need of its continual verification.' (Post 1936: 105.)

This, then, is the 'working hypothesis' that, in effect, Church proposed:

Church's thesis: A function of positive integers is effectively calculable only if recursive.

The reverse implication, that every recursive function of positive integers is effectively calculable, is commonly referred to as the converse of Church's thesis (although Church himself did not so distinguish, bundling both theses together in his 'definition').

If attention is restricted to functions of positive integers then Church's thesis and Turing's thesis are equivalent, in view of the previously mentioned results by Church, Kleene and Turing.

The term 'Church-Turing thesis' seems to have been first introduced by Kleene, with a small flourish of bias in favour of Church:

'So Turing's and Church's theses are equivalent. We shall usually refer to them both as Church's thesis, or in connection with that one of its ... versions which deals with 'Turing machines' as the Church-Turing thesis.' (Kleene 1967: 232.)

The Evidence for the Thesis

Much evidence has been amassed for the 'working hypothesis' proposed by Church and Turing in 1936. Perhaps the fullest survey is to be found in chapters 12 and 13 of Kleene (1952). In summary: (1) Every effectively calculable function that has been investigated in this respect has turned out to be computable by Turing machine. (2) All known methods or operations for obtaining new effectively calculable functions from given effectively calculable functions are paralleled by methods for constructing new Turing machines from given Turing machines. (3) All attempts to give an exact analysis of the intuitive notion of an effectively calculable function have turned out to be equivalent in the sense that each analysis offered has been proved to pick out the same class of functions, namely those that are computable by Turing machine. Because of the diversity of the various analyses, (3) is generally considered to be particularly strong evidence. Apart from the analyses already mentioned in terms of lambda-definability and recursiveness, there are analyses in terms of register machines (Shepherdson and Sturgis 1963), Post's canonical and normal systems (Post 1943, 1946), combinatory definability (Schonfinkel 1924, Curry 1929, 1930, 1932), Markov algorithms (Markov 1960), and Godel's notion of reckonability (Godel 1936, Kleene 1952).

While there have from time to time been attempts to call the Turing-Church thesis into question (for example by Kalmar (1959); Mendelson (1963) replies), the summary of the situation that Turing gave in 1948 is no less true today: 'it is now agreed amongst logicians that "calculable by means of an LCM" is the correct accurate rendering' of the informal notion in question.

Thesis M

It is important to distinguish between the Turing-Church thesis and the different proposition that whatever can be calculated by a machine can be calculated by a Turing machine. (The two propositions are sometimes confused.) Gandy (1980) terms the second proposition 'Thesis M'.

Thesis M: Whatever can be calculated by a machine is Turing-machine-computable.

Thesis M itself admits of two interpretations, according to whether the phrase 'can be calculated by a machine' is taken in the narrow sense of 'can be calculated by a machine that conforms to the physical laws (if not to the resource constraints) of the actual world', or in a wide sense that abstracts from the issue of whether or not the notional machine in question could exist in the actual world. The narrow version of thesis M is an empirical proposition whose truth-value is unknown. The wide version of thesis M is simply false. Various notional machines have been described which can calculate functions that are not Turing-machine-computable (for example, Abramson (1971), Copeland (1997), (1998c), da Costa and Doria (1991), (1994), Doyle (1982), Hogarth (1994), Pour-El and Richards (1979), (1981), Scarpellini (1963), Siegelmann and Sontag (1994), Stannett (1990), Stewart (1991); Copeland and Sylvan (1999) is a survey).

Notice that the Turing-Church thesis does not entail thesis M; the truth of the Turing-Church thesis is consistent with the falsity of Thesis M (in both its wide and narrow forms). A thesis concerning effective methods - which is to say, concerning procedures of a certain sort that a human being unaided by machinery can carry out - carries no implication concerning the extent of the procedures that machines are capable of carrying out (since, for example, there might be, among a machine's repertoire of atomic operations, operations that no human being who is working effectively is able to perform). The above-mentioned evidence for the Turing-Church thesis is not also evidence for Thesis M.

Bibliography

  • Abramson, F.G. 1971. 'Effective Computation over the Real Numbers'. Twelfth Annual Symposium on Switching and Automata Theory. Northridge, Calif.: Institute of Electrical and Electronics Engineers.
  • Church, A. 1932. 'A set of Postulates for the Foundation of Logic'. Annals of Mathematics, second series, 33, 346-366.
  • Church, A. 1936a. 'An Unsolvable Problem of Elementary Number Theory'. American Journal of Mathematics, 58, 345-363.
  • Church, A. 1936b. 'A Note on the Entscheidungsproblem'. Journal of Symbolic Logic, 1, 40-41.
  • Church, A. 1937a. Review of Turing 1936. Journal of Symbolic Logic, 2, 42-43.
  • Church, A. 1937b. Review of Post 1936. Journal of Symbolic Logic, 2, 43.
  • Church, A. 1941. The Calculi of Lambda-Conversion. Princeton: Princeton University Press.
  • Copeland, B.J. 1996. 'The Church-Turing Thesis', in E. Zalta, ed., Stanford Encyclopaedia of Philosophy.
  • Copeland, B.J. 1997. 'The Broad Conception of Computation'. American Behavioral Scientist, 40, 690-716.
  • Copeland, B.J. 1998a. 'Turing's O-machines, Penrose, Searle, and the Brain'. Analysis, 58, 128-138.
  • Copeland, B.J. 1998b. 'Even Turing Machines Can Compute Uncomputable Functions'. In Calude, C., Casti, J., Dinneen, M. (eds) 1998, Unconventional Models of Computation, London and Singapore: Springer-Verlag, 150-164.
  • Copeland, B.J. 1998c. 'Super Turing-Machines'. Complexity, 4: 30-32.
  • Copeland, B.J. 2000. 'Narrow Versus Wide Mechanism'. Journal of Philosophy, 97, 1-32.
  • Copeland, B.J., Proudfoot, D. 1999a. 'Alan Turing's Forgotten Ideas in Computer Science'. Scientific American, 280 (April), 76-81.
  • Copeland, B.J., Proudfoot, D. 1999b. 'The Legacy of Alan Turing'. Mind, 108, 187-195.
  • Copeland, B.J., Sylvan, R. 1999. 'Beyond the Universal Turing Machine'. Australasian Journal of Philosophy, 77, 46-66.
  • Curry, H.B. 1929. 'An Analysis of Logical Substitution'. American Journal of Mathematics, 51, 363-384.
  • Curry, H.B. 1930. 'Grundlagen der kombinatorischen Logik'. American Journal of Mathematics, 52, 509-536, 789-834.
  • Curry, H.B. 1932. 'Some Additions to the Theory of Combinators'. American Journal of Mathematics, 54, 551-558.
  • da Costa, N.C.A., Doria, F.A. 1991. 'Classical Physics and Penrose's Thesis'. Foundations of Physics Letters, 4, 363-374.
  • da Costa, N.C.A., Doria, F.A. 1994. 'Undecidable Hopf Bifurcation with Undecidable Fixed Point'. International Journal of Theoretical Physics, 33, 1913-1931.
  • Doyle, J. 1982. 'What is Church's Thesis? An Outline.' Laboratory for Computer Science, MIT.
  • Gandy, R. 1980. 'Church's Thesis and Principles for Mechanisms'. In Barwise, J., Keisler, H.J., Kunen, K. (eds) 1980. The Kleene Symposium. Amsterdam: North-Holland.
  • Gandy, R. 1988. 'The Confluence of Ideas in 1936'. In Herken, R. (ed.) 1988. The Universal Turing Machine: A Half-Century Survey. Oxford: Oxford University Press.
  • Godel, K. 1934. 'On Undecidable Propositions of Formal Mathematical Systems'. Lecture notes taken by Kleene and Rosser at the Institute for Advanced Study. Reprinted in Davis, M. (ed.) 1965. The Undecidable. New York: Raven.
  • Godel, K. 1936. 'Uber die Lange von Beweisen'. Ergebnisse eines mathematischen Kolloquiums, 7, 23-24.
  • Herbrand, J. 1932. 'Sur la non-contradiction de l'arithmetique. Journal fur die reine und angewandte Mathematik, 166, 1-8.
  • Hilbert, D., Ackermann, W. 1928. Grundzuge der Theoretischen Logik. Berlin: Springer.
  • Kalmar, L. 1959. 'An Argument Against the Plausibility of Church's Thesis'. In Heyting, A. (ed.) 1959. Constructivity in Mathematics. Amsterdam: North-Holland, pp.72-80.
  • Kleene, S.C. 1935. 'A Theory of Positive Integers in Formal Logic'. American Journal of Mathematics, 57, 153-173, 219-244.
  • Kleene, S.C. 1936. 'Lambda-Definability and Recursiveness'. Duke Mathematical Journal, 2, 340-353.
  • Kleene, S.C. 1952. Introduction to Metamathematics. Amsterdam: North-Holland.
  • Kleene, S.C. 1967. Mathematical Logic. New York: Wiley.
  • Markov, A.A. 1960. 'The Theory of Algorithms'. American Mathematical Society Translations, series 2, 15, 1-14.
  • Mendelson, E. 1963. 'On Some Recent Criticism of Church's Thesis'. Notre Dame Journal of Formal Logic, 4, 201-205.
  • Post, E.L. 1936. 'Finite Combinatory Processes - Formulation 1'. Journal of Symbolic Logic, 1, 103-105.
  • Post, E.L. 1943. 'Formal Reductions of the General Combinatorial Decision Problem'. American Journal of Mathematics, 65, 197-215.
  • Post, E.L. 1946. 'A Variant of a Recursively Unsolvable Problem'. Bulletin of the American Mathematical Society, 52, 264-268.
  • Pour-El, M.B., Richards, I. 1979. 'A Computable Ordinary Differential Equation Which Possesses No Computable Solution'. Annals of Mathematical Logic, 17, 61-90.
  • Pour-El, M.B., Richards, I. 1981. 'The Wave Equation with Computable Initial Data such that its Unique Solution is not Computable'. Advances in Mathematics, 39, 215-239.
  • Scarpellini, B. 1963. 'Zwei Unentscheitbare Probleme der Analysis', Zeitschrift fur mathematische Logik und Grundlagen der Mathematik, 9, 265-289.
  • Schonfinkel, M. 1924. 'Uber die Bausteine der mathematischen'. Mathematische Annalen, 92, 305-316.
  • Shepherdson, J.C., Sturgis, H.E. 1963. 'Computability of Recursive Functions'. Journal of the ACM, 10, 217-255.
  • Siegelmann, H.T., Sontag, E.D. 1992. 'On the Computational Power of Neural Nets'. Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, 440-449.
  • Stannett, M. 1990. 'X-Machines and the Halting Problem: Building a Super-Turing Machine'. Formal Aspects of Computing, 2, 331-341.
  • Stewart, I. 1991. 'Deciding the Undecidable'. Nature, 352, 664-5.
  • Turing, A.M. 1936 .'On Computable Numbers, with an Application to the Entscheidungsproblem'. Proceedings of the London Mathematical Society, Series 2, 42 (1936-37), pp.230-265.
  • Turing, A.M. 1948. 'Intelligent Machinery'. National Physical Laboratory Report. In Meltzer, B., Michie, D. (eds) 1969. Machine Intelligence 5. Edinburgh: Edinburgh University Press.