Codex Wiki OurBigBook logoOurBigBook.comSite Source code

Set theory

Words: 2k Articles: 106
The von Neumann hierarchy is
Every level is transitive, the levels are increasing, and every set belongs to some level.

Rank of a set

Words: 19
The rank is defined by
It is the least ordinal for which .

Transitive set

Words: 20
A set is transitive when every element of an element of is itself an element of .
A relation on is well-founded when every nonempty subset of contains an element with no -predecessor in that subset.
A relation is extensional when distinct elements have distinct sets of predecessors.

Set

Words: 243 Articles: 17
A set is a collection of distinct objects regarded as its elements.
The empty set has no elements.

Singleton set

Words: 7
A singleton set has exactly one element.
Elements are distinct when they are unequal.

Generating set

Words: 20
A generating set is a subset from which every element of a structure can be obtained using the structure's operations.

Subset

Words: 17
A set is a subset of when every element of belongs to .
The union contains exactly the elements that belong to at least one set .
The intersection contains exactly the elements that belong to every set .

Pair

Words: 22 Articles: 2
A pair is a collection of two objects. An ordered pair records which object is first, whereas an unordered pair does not.

Partially ordered set

Words: 64 Articles: 2
A partially ordered set, or poset, is a set equipped with a reflexive, antisymmetric and transitive binary relation.
An element of a partially ordered set is maximal when implies . A poset can have several maximal elements and need not have a greatest element.
An element of a partially ordered set is minimal when implies .

Total order

Words: 56 Articles: 3
A total order is a reflexive, antisymmetric, transitive relation in which every two elements are comparable.
Empty order
Words: 11
The empty order is the unique total order on the empty set.
An element is greatest when every element of the ordered set is less than or equal to it.
Initial segment
Words: 11
An initial segment contains every element below each of its elements.

Binary relation

Words: 84 Articles: 4
A binary relation on a set is a subset of .
A relation on is reflexive when for every .
A relation is symmetric when implies .
A relation is transitive when and imply .
An equivalence relation is a reflexive, symmetric, and transitive binary relation. It partitions a set into disjoint equivalence classes.

Function

Words: 151 Articles: 9
A function assigns exactly one output to each input in its domain.
The identity function on a set maps every to itself.
A piecewise-linear function is linear on each member of a finite or locally finite partition of its domain into intervals or polyhedral pieces.

Bounded function

Words: 30 Articles: 1
A real- or complex-valued function is bounded when the moduli of all its values have one finite upper bound.
An unbounded function has no finite bound on the moduli of its values.
A constant function has the same output for every input.

Real-valued function

Words: 27 Articles: 1
A real-valued function has codomain contained in the real numbers.
Global maximum
Words: 17
A global maximum of a real-valued function is a value satisfying throughout its domain.

Bijection

Words: 19
A bijection is a function that is both injective and surjective, so every target element has exactly one preimage.
A function is periodic when for some nonzero period and every in its domain.

Zorn lemma

Words: 20
If every chain in a nonempty partially ordered set has an upper bound, then the set has a maximal element.

Class in set theory

Words: 164 Articles: 4
A class is a collection of sets specified by a formula, possibly with set parameters. A class is a set when one set has exactly those members.

Proper class

Words: 14
A proper class is a class in set theory that is not a set in the ambient universe.

Transitive class

Words: 123 Articles: 2
A class is transitive when implies . Consequently, every member of a member of is available as an element of the structure .
If a transitive class contains the empty set and is closed under pairing and union, then satisfies extensionality, empty set, pairing, and union. Transitivity makes all members of each visible inside , so the ambient witnesses have the same required membership relations internally.
The relativization of a formula is obtained recursively by restricting every quantifier to :
For parameters in , the ambient statement holds exactly when the structure satisfies .
Every definable function-class maps a set-sized domain to a set-sized range. Functionality means that the defining formula assigns exactly one output to each input in the domain.

Axiom of foundation

Words: 54 Articles: 1
Every nonempty set has an element such that .
The principle of epsilon induction says that every progressive class is universal: if
then holds for every set . Over the other axioms of ZF, it is equivalent to the Axiom of foundation.
For every set there is a set whose members are exactly the subsets of .

Cumulative hierarchy ()

Words: 125 Articles: 4
The cumulative hierarchy is defined by , , and at limit ordinals.

Transitive closure ()

Words: 81 Articles: 2
The transitive closure is the least transitive set containing every member of . It is obtained by taking the union of all finite iterates of the union operation starting from .
A set is hereditarily countable when its transitive closure is countable. These sets form the transitive set and all have rank below .
Reasonable set
Words: 23
A set is reasonable when every member of is countable. In ZFC this is equivalent to being hereditarily countable.
The class of hereditarily finite sets is the set
Equivalently, these are the sets with finite transitive closure, or the sets contained in a finite transitive set.

Axiom schema of specification

Words: 65 Articles: 1
For each formula , the axiom schema of specification forms the subset
of any set . When interpreting the schema inside a class model, the formula must be evaluated internally.
Let be a transitive class. If is closed under the ambient subsets defined by , then satisfies the -instance of separation, because

Axiom of choice

Words: 139 Articles: 4
Every family of nonempty sets has a choice function. In ZF this is equivalent to the well-ordering theorem.

Choice function

Words: 23
A choice function on a family of nonempty sets is a function with for every .

Well-ordering theorem

Words: 62 Articles: 1
Every set admits a well-order. In ZF this statement is equivalent to the axiom of choice.
Given a choice function on all nonempty subsets of , recursively choose the next point from the complement of all earlier choices. Hartogs theorem forces the recursion to exhaust before it defines an injection from into , producing a bijection from an ordinal to .
For any sets , either injects into or injects into . Applying this to and its Hartogs ordinal proves the well-ordering theorem, so over ZF cardinal comparability is equivalent to choice.

Hartogs theorem

Words: 17
For every set there is a least ordinal that does not inject into .
In ZF, if for every infinite , apply this to . The product-sum comparison lemma applied to and its Hartogs ordinal gives either an impossible injection or a surjection . In the latter case, ordering each by its least ordinal preimage well-orders . The converse is the well-orderable-cardinal identity .
Images send subsets of a domain forward through a function, while preimages pull subsets of the codomain back.
The Cartesian product is the set of ordered pairs with and .
The disjoint union tags the elements of its summands, for example .
The fiber product of maps f:A to B and g:A-prime to B consists of pairs with equal images in B.
Cantor’s diagonal argument constructs an object differing from the nth listed object in its nth coordinate, proving no proposed enumeration is complete.

Cardinal number

Words: 356 Articles: 8
In the presence of choice, a cardinal number may be represented by the least ordinal in its bijection class.

Uncountable set

Words: 17
An uncountable set is a set for which no bijection with a subset of the natural numbers exists.

Initial ordinal

Words: 50 Articles: 1
An initial ordinal is an ordinal not equinumerous with any smaller ordinal. It is therefore the canonical ordinal representative of a cardinal.
Aleph number
Words: 28
The alephs enumerate the infinite initial ordinals: , successor indices select the next initial ordinal, and limit indices select the least initial ordinal above all earlier values.

Cardinal arithmetic

Words: 252 Articles: 3
Cardinal sums are cardinalities of disjoint unions, products are cardinalities of Cartesian products, and exponentials count functions from a set of size to one of size .
In ZF, let be nonempty. If injects into , then there is either an injection or a surjection from to .
Indeed, extend the inverse of the given injection to a surjection by sending points outside its range to one fixed pair . If the second coordinate of restricted to the -summand covers , it is the required surjection. Otherwise choose that it misses. Every then has its preimage in the -summand. Except possibly for the default pair, that preimage is unique, so these preimages inject into . In the exceptional case they inject into ; either their image is all of , yielding a surjection from , or an omitted point extends the map to an injection from .
For infinite cardinals, choice gives . Exponentiation satisfies , while a countable sum of cardinals has size the maximum of and their supremum.
If for every , then
The injection uses functions supported at one coordinate. For non-surjectivity, given any map from the disjoint union to the product, choose at coordinate a value omitted by the th row; the resulting diagonal element is outside its image.
If there are injections and , then there is a bijection .

Ordinal

Words: 706 Articles: 29
An ordinal is a transitive set well-ordered by membership and represents the order type of a well-order.
The successor of an ordinal is .
A countable ordinal has a countable set as its underlying set.

Order type

Words: 26 Articles: 1
The order type of a well-order is the unique ordinal isomorphic to it.
Every well-founded extensional relation is uniquely isomorphic to membership on a transitive set.

Limit ordinal

Words: 23
A nonzero ordinal is a limit ordinal when it is not a successor ordinal. Equivalently, it is the supremum of all smaller ordinals.
Transfinite recursion defines a value at each ordinal from the function of all earlier values.
If a property of an ordinal follows whenever it holds for every smaller ordinal, then it holds for every ordinal.

Ordinal addition ()

Words: 61 Articles: 2
Ordinal addition is ordered concatenation and is associative but generally not commutative.
For all ordinals ,
This follows by transfinite induction on from the recursive definition of ordinal addition.
Nonzero ordinals commute under addition precisely when they are positive finite right multiples of a common ordinal. This follows by comparing their Cantor normal forms at the first exponent where they differ.
Ordinal multiplication is defined recursively by
for nonzero limit ordinal . It is associative and left-distributive over ordinal addition, but generally neither commutative nor right-distributive.
Ordinal exponentiation is defined recursively by
for nonzero limit . Transfinite induction gives
For a well-ordered set , let contain the points whose strict initial segments are nonempty and have no greatest element, and iterate this operation transfinitely, taking intersections at limit stages. Every nonempty derivative loses at least its least element. If no derivative became empty, choosing one point from each successive difference would inject the ordinal supplied by Hartogs theorem for into , a contradiction.
For an ordinal ,
Thus the derivative index of is one and that of is two.
For , the ordinal interval is the ordered tail from inclusive to exclusive.

First uncountable ordinal

Words: 26 Articles: 1
The first uncountable ordinal is the set of all countable ordinals.
Deleting any countable initial segment from leaves a well-order of type .

Cantor normal form

Words: 122 Articles: 3
Every nonzero ordinal has a unique finite expression with decreasing exponents and positive finite coefficients.
Leading term of an ordinal
Words: 106 Articles: 2
The leading term is the highest-exponent term in Cantor normal form; the remaining tail is strictly below .
Every nonzero ordinal has a greatest exponent such that . It is the leading exponent in the Cantor normal form of , and
for a positive finite integer and .
Let nonzero ordinals have leading exponents . If is finite, then has leading exponent . If is infinite, so that , then has leading exponent . This follows by multiplying the leading terms in Cantor normal form and using continuity of ordinal multiplication at limit ordinals.

Indecomposable ordinal

Words: 156 Articles: 4
The additively indecomposable ordinals are exactly the powers .
A nonzero ordinal is additively closed when for all . These are exactly the ordinals : sufficiency follows from Cantor normal form, while necessity follows by splitting any leading coefficient or nonzero tail below into two smaller summands.
For every ordinal and , there are unique ordinals such that
Choose the greatest initial multiple ; if its remainder were at least , the next multiple would still fit. Uniqueness follows because every remainder below lies before .
Multiplicatively closed ordinal
Words: 56 Articles: 1
An ordinal is multiplicatively closed when for all . These are exactly
For nonzero , the ordinal is multiplicatively closed exactly when is additively closed. One direction follows from
For the other, the leading exponent of an ordinal product shows that products of ordinals below still have leading exponent below .

Hessenberg natural sum

Words: 71 Articles: 2
The Hessenberg natural sum aligns equal exponents in two Cantor normal forms and adds their finite coefficients; unlike ordinal addition it is commutative.
If a well-order is the union of suborders of types and , its type is at most .
If an ordinal is partitioned into two copies of type , its type is below ; two copies do not always give a strict bound.

Mathematical logic

Words: 1k Articles: 37
Mathematical logic studies formal languages, proofs, models, computability, and the foundations of mathematics.

Propositional logic

Words: 236 Articles: 8
If , every valuation that satisfies all formulae in also satisfies .
A set of formulae is deductively closed when
Equivalently, equals its deductive closure .
A set is syntactically consistent when . Equivalently in classical logic, there is no formula for which both and .
A set is finitary when it is deductively equivalent to some finite set : both and .
If
are deductively closed, then each is consistent and their union is consistent and deductively closed. The union is not finitary. Each conclusion follows from the finite character of formal proofs.
A consistent set is maximal consistent when no proper extension is consistent. It is deductively closed and decides every formula: exactly one of and belongs to . Therefore exactly when defines a model of .

Propositional compactness theorem

Words: 78 Articles: 1
A set of propositions has a model exactly when every finite subset has a model. Syntactically, a contradiction uses only finitely many assumptions, and every consistent set extends by Zorn lemma to a maximal consistent set in propositional logic.
With atoms , finitary propositions can enforce that the true pairs form an injective partial function. If the codomain is infinite, they cannot enforce that every has a value: adjoining every remains finitely satisfiable, so compactness produces a model omitting .

First-order logic

Words: 806 Articles: 27
First-order logic permits quantification over elements of a structure while its nonlogical symbols describe operations, constants, and relations.

First-order language

Words: 47 Articles: 1
A first-order language specifies its constant, operation, and relation symbols, together with the arity of each nonconstant symbol.
A finite set of formulas mentions only finitely many nonlogical symbols. This observation lets compactness reduce arguments in a language indexed by a large set to a finite sublanguage.

Free variable

Words: 19
An occurrence of a variable is free when it is outside the scope of a quantifier binding that variable.
A first-order sentence is a formula with no free variables, so its truth in a structure is independent of a variable assignment.

First-order theory

Words: 177 Articles: 6
A first-order theory is a set of sentences in one first-order language. Depending on convention, the term may instead mean its deductive closure.
A class of structures is first-order axiomatizable when it is exactly the class of models of some first-order theory. If extra constants are allowed, the corresponding class of reducts consists of structures that admit interpretations of those constants satisfying the theory.
Consistent first-order theory
Words: 38 Articles: 1
A theory is consistent when it does not derive a contradiction. By first-order completeness, this is equivalent to having a model.
Every theory containing an inconsistent subtheory is inconsistent, because the same finite derivation of contradiction remains available.
Every formal proof is a finite string and therefore uses only finitely many of the available assumptions.
Universal first-order theory
Words: 58 Articles: 1
A universal theory can be axiomatized by sentences whose quantifiers are all universal. Such sentences often forbid specified finite configurations.
If failure of a property has a finite witness, one can often axiomatize the property by a universal sentence forbidding each possible finite witness. Compactness supplies finite witnesses when failure is expressed by inconsistency of an associated theory.

First-order structure

Words: 207 Articles: 6
A structure supplies a nonempty domain and an interpretation of every constant, operation, and relation symbol in its language.
A structure is a model of when for every sentence .
An automorphism is a bijection from a structure to itself that preserves every operation and relation in its language.
After adjoining a unary function symbol , injectivity, surjectivity, preservation of each operation, and preservation in both directions of each relation form an axiom scheme whose models interpret as an automorphism.
A family of automorphisms satisfying defines a group action. It is faithful exactly when distinct indices define distinct automorphisms, equivalently when embeds in the automorphism group.
Rigid first-order structure
Words: 90 Articles: 1
A first-order structure is rigid when its identity map is its only automorphism. Every finite linear order is rigid, whereas is nonrigid because every translation is an order automorphism.
If a theory has arbitrarily large finite nonrigid models, expand its language by a unary function , axiomatize that is an automorphism, require to move some element, and add sentences demanding at least elements for every . Every finite fragment has a sufficiently large finite nonrigid model, so compactness supplies an infinite nonrigid model.
Every sentence derivable from a first-order theory is true in every model of that theory.
For first-order logic, every sentence true in every model of a theory is derivable from that theory. Equivalently, every consistent theory has a model.

Compactness theorem

Words: 144 Articles: 3
A set of first-order sentences has a model if and only if every finite subset has a model.
If a theory were inconsistent, a proof of contradiction would use a finite inconsistent subset. Therefore consistency of every finite subset implies consistency of the whole theory, and completeness supplies a model.
If a theory claimed that a poset has only finitely many maximal elements, adjoining countably many constants required to be distinct and maximal would remain finitely satisfiable. Compactness would produce a model with infinitely many maximal elements, contradicting the claimed axiomatization.
Suppose a class requires exactly one of two definable sets to be infinite. Add constants witnessing arbitrarily many distinct members of both sets. Every finite fragment can keep one set infinite and make the other large but finite, whereas compactness makes both sets infinite. Therefore such an exclusive disjunction is not first-order axiomatizable.

Lowenheim-Skolem theorem

Words: 133 Articles: 2
The LΓΆwenheim--Skolem theorems control the cardinalities of models of a first-order theory without changing its first-order truths.
If an -theory has an infinite model, then it has models of arbitrarily large cardinality. For a cardinal , add constants for and all inequalities . Every finite fragment is satisfiable in the given infinite model, so compactness gives a model with at least elements. Applying the downward theorem produces a model of exactly when .
If is an infinite -structure and , then has an elementary substructure of cardinality . One proof adds Skolem functions for existential formulas and closes a chosen -element subset under them; the closure still has size , and the Tarski--Vaught test makes it elementary.

Computability theory

Words: 1k Articles: 39

Register machine

Words: 243 Articles: 5
A register machine has finitely many states and finitely many addressed registers, together with instructions that inspect and modify register contents and change state. A computed partial function is defined by the contents at the halt state.

String register machine

Words: 206 Articles: 4
In a string register machine, appends to register ; branches according to whether its final letter is ; tests emptiness; and branches to when empty, or deletes the final letter and branches to otherwise.
A machine computes the characteristic function of a language when it halts on every input with the one-letter output for inputs in and for inputs outside .
Two string registers can recognize by storing one marker per and removing one per . A machine with only its input register cannot: two different terminal -block lengths eventually reach the same state and remaining prefix, forcing equal outputs for one member and one nonmember.
To recognize words ending in a fixed symbol , test the final input letter, choose one of two erasing loops, and append after the accepting loop or after the rejecting loop. The empty word follows the rejecting branch.
Replace the original halt state by a continuation state that tests whether its one-letter output is or , removes it, appends the other symbol, and enters a new halt state. This computes the complement language without changing termination behavior.

Primitive recursive function

Words: 141 Articles: 7
Primitive recursive functions are generated by zero, successor, and projections under composition and primitive recursion.
The initial functions are the zero function, the successor function, and all coordinate projections.
The zero function has the constant value
Dummy variables give a zero function of any finite arity.
The successor function is
The th -ary projection returns its th input:
Given a -ary function and -ary functions , composition forms
From and , primitive recursion defines
The functions generated from the initial functions using composition alone are exactly
for a constant . Structural induction proves necessity, and iterating the successor function on zero or a projection proves sufficiency.
A list of all functions in a class closed under diagonal substitution and successor misses .

Recursively enumerable set

Words: 86 Articles: 1
A set is computably enumerable when a program halts precisely on its members. Equivalently, it is the domain of a partial computable function or some algorithm lists its elements.
For a nonempty set of words, the following are equivalent: is computably enumerable, is the domain of a partial computable function, is the range of a partial computable function, and is the range of a total computable function. The nonempty hypothesis is needed only for the last formulation, since the range of a total function cannot be empty.
Kleene recursion gives programs access to their own effective descriptions: every computable transformation of program indices has a semantic fixed point.

Many-one reduction

Words: 77 Articles: 3
A many-one reduction is a total computable satisfying exactly when .

Many-one degree

Words: 14
Two sets have the same many-one degree when each many-one reduces to the other.
A staged-enumeration reduction controls an output language by enumerating more elements at each simulation stage and changing behavior when a source computation halts.
A set is complete for a class under many-one reductions when and every satisfies .

Index set

Words: 129 Articles: 5
An index set is a set of program codes whose membership depends only on the partial function or enumerable language computed, rather than the code's syntax.
An extensional program property gives identical answers to all codes computing the same object.

Rice theorem

Words: 14
Every nontrivial extensional property of partial computable functions or computably enumerable languages is undecidable.

Infinite-domain index set

Words: 63 Articles: 1
For an effective enumeration of unary partial computable functions,
is an index set.
For a nonempty set of words, the property
is a nontrivial extensional property of unary partial computable functions: the nowhere-defined function fails it, while any total constant function with value in satisfies it. The Rice theorem therefore makes its index set undecidable.
The cofinite index set contains codes whose enumerable language has finite complement.

Padding lemma

Words: 17
The padding lemma produces infinitely many syntactically distinct program indices for the same computed function or language.

Dovetailing

Words: 16
Dovetailing interleaves finite stages of multiple computations so that every computation that halts is eventually observed.

S-m-n theorem

Words: 37
The S-m-n theorem says that fixed inputs can be compiled into program codes by a total computable transformation. For every , there is a total computable such that
whenever either side is defined.

Partial computable function

Words: 141 Articles: 3
A partial function is computable when a program returns its value on every input in its domain and runs forever on inputs outside its domain.
For a partial function , unbounded minimization defines
as the least at which is zero, provided the preceding required computations are defined. If no such is found, is undefined. Closing the primitive recursive functions under this operation gives the partial recursive functions.
A total computable function is a computable function whose domain contains every allowed input.
For a program code , input , and time bound , the truncated computation simulates program on for at most steps and reports either its output or that no halt occurred within the bound. This is a total computable function of .

Arithmetical hierarchy

Words: 119 Articles: 3
The arithmetical hierarchy classifies sets by alternating blocks of number quantifiers over computable predicates.

Sigma-1 set

Words: 29
A set is in exactly when it is the domain of a partial computable function. Equivalently, there is a computable predicate such that

Pi-2 set

Words: 76 Articles: 1
A set is in when membership can be written with one universal block followed by one existential block over a computable predicate. Equivalently, in the word-function formulation, there is a partial computable such that
For an effective enumeration of computably enumerable languages , the totality problem is
It is -complete: a condition maps effectively to a program whose domain is .

Formal language theory

Words: 2k Articles: 56

Regular expression

Words: 43 Articles: 1
A regular expression is built from alphabet symbols, the empty language and the empty word using finite union, concatenation and Kleene star.

Kleene theorem

Words: 21
Kleene's theorem states that a language is denoted by a regular expression exactly when it is accepted by a finite automaton.

Formal grammar

Words: 379 Articles: 13
A grammar generates the terminal words reachable from by finitely many productions.

Variable-based grammar

Words: 365 Articles: 12
A variable-based grammar has disjoint finite terminal and variable alphabets , a start variable , and productions in which and contains at least one variable.
A nonterminal is unreachable when no word derivable from the start symbol contains it. Productions whose left sides are unreachable do not affect the generated language.
A nonterminal is nonproductive when no word derived from it consists entirely of terminal symbols. Every derivation containing such a symbol therefore fails to produce a word in the generated language.
Regular grammar
Words: 127 Articles: 5
A right-linear regular grammar has productions of the forms and , where are variables and is a terminal word.
Every sentential form reachable from the start variable of a right-linear grammar is either a terminal word or , where is the unique variable and occurs at the right end.
A variable is accessible when for some terminal word .
A variable is looping when for some terminal word through a nonempty derivation.
A variable is terminable when for some terminal word .
If a finite right-linear grammar generates an infinite language, some variable is accessible, looping, and terminable. It is the repeated variable on a sufficiently long accepting derivation.
Concatenation grammar
Words: 147 Articles: 3
For grammars and with disjoint variable sets, introduce a new variable and set
If both input grammars are variable based, then .
Regular concatenation grammar
Words: 89 Articles: 1
Retain every production of whose right-hand side contains a variable, replace every production with by , include , and use as start variable. If and are right-linear, the resulting grammar is right-linear and generates .
The regular construction relies on a regular derivation having exactly one terminal rule, at its end. In a general variable-based grammar several variables may each use terminal productions, so replacing every such production can introduce several copies of the second start variable.
Even if both input grammars are regular, the added production has two variables on its right-hand side and therefore need not be a regular production.

Context-free language

Words: 395 Articles: 13
A grammar is context-free when each production has one nonterminal on its left.

Context-free grammar

Words: 326 Articles: 9
A context-free grammar consists of terminal and nonterminal alphabets, a start symbol, and productions whose left side is one nonterminal. A derivation records the order of substitutions, while a parse tree records their hierarchical structure, so several derivations can represent one parse tree.
A grammar derivation is a finite sequence of words in which each step replaces one occurrence of a production's left side by its right side. A leftmost derivation always replaces the leftmost available nonterminal.
Parse tree
Words: 43
A parse tree places the start symbol at its root, the symbols on the right side of a production at the children of its left-side nonterminal, and terminal symbols at its leaves. Reading the leaves from left to right gives the tree's yield.
Equivalent grammar
Words: 52 Articles: 1
Two grammars are equivalent when they generate the same formal language.
Two grammars over a common terminal alphabet are isomorphic when a bijection between their nonterminal alphabets maps one start symbol to the other and maps their productions bijectively after being extended to fix every terminal symbol. Isomorphic grammars are equivalent.
Chomsky normal form
Words: 154 Articles: 4
A context-free grammar is in Chomsky normal form when every production has the form or , with nonterminals and a terminal. If the empty word belongs to the language, one commonly also permits the exceptional rule under the usual restriction on the start symbol.
An epsilon production is a grammar production whose right-hand side is the empty word.
A unit production replaces one nonterminal by one nonterminal and emits no terminal symbols.
A Chomsky-normal-form parse tree for a word of length has terminal productions and binary productions. Every derivation represented by the tree therefore has exactly steps.
Weak Chomsky normal form additionally permits ternary productions . Compressing a two-step pattern , into preserves its generated yields whenever the intermediate variable has no other role, and saves one derivation step each time the pattern is used.
The productions generate exactly the nonempty binary palindromes of even length.
The intersection of a context-free language with a regular language is context-free, because a pushdown automaton and a finite automaton can be run in product.
A context-free grammar can enforce sums such as by nesting one matched terminal pair for each independent count.
For some , every sufficiently long in a context-free language has with , , and in the language for all .
For a word consisting of three long constrained blocks, a pumpable window shorter than each block cannot alter both outer blocks; pumping then breaks a required three-way count relation.

Deterministic finite automaton

Words: 192 Articles: 7
A deterministic finite automaton has finitely many states and one transition for each state-symbol pair.
For a transition function , define
The accepted language is .
A state is accessible when some input word takes the initial state to it. Removing inaccessible states preserves the accepted language.
Two states are indistinguishable when every continuation is accepted from both or rejected from both. Distinguishable states admit at least one suffix with different acceptance outcomes.
Indistinguishability is a right-invariant equivalence relation. The quotient has states , transition , initial state , and accepting classes represented by accepting states. It accepts the original language and has no two distinct indistinguishable states.
A deterministic automaton is irreducible when every state is accessible and every pair of distinct states is distinguishable.
An irreducible deterministic automaton has the fewest states among deterministic automata for its language and is unique up to isomorphism. Its states are the Myhill--Nerode classes.
An accessible automaton over one letter consists of a directed tail entering one directed cycle. Its minimal quotient is obtained by merging positions having the same future binary acceptance sequence.

Nondeterministic finite automaton

Words: 188 Articles: 5
A nondeterministic finite automaton assigns a set of possible successor states to each state-symbol pair and accepts when at least one run ends in a final state.
Without epsilon transitions, define
A word is accepted when the set reached from the initial state meets the final set.
For , a witnessing sequence from to satisfies . Induction on word length shows that exactly when such a sequence runs from to .
The powerset construction turns an NFA with state set into a DFA with state set , transition
and accepting subsets that meet the NFA final set.

Brzozowski automaton

Words: 75 Articles: 1
In the convention used here, a Brzozowski NFA has one final state, every state can reach it, and each word labels a path to it from exactly one starting state.
For distinct accessible subset states, choose a state in their symmetric difference. A word taking it to the unique final state accepts from one subset; uniqueness of the starting state prevents acceptance from the other. Thus the accessible part of the subset automaton is irreducible.
A language is regular exactly when it is accepted by a finite automaton, or equivalently has finitely many Myhill-Nerode classes.
For a deterministic finite automaton with states, every accepted word with has a decomposition such that , , and is accepted for every integer .

Myhill-Nerode theorem

Words: 53 Articles: 1
A language is regular exactly when indistinguishability by all suffixes has finitely many equivalence classes; these classes form its minimal DFA.
For a language , define
This is a right congruence, and its equivalence classes are the states of the minimal deterministic finite automaton for .
A language class is closed under an operation when applying that operation to members always produces another member of the class.

Computably enumerable language

Words: 132 Articles: 4
A language is computably enumerable when a machine recognizes its members, possibly running forever on nonmembers.

Halting problem

Words: 116 Articles: 3
The halting set is computably enumerable but undecidable, and its complement is not computably enumerable.
Diagonal halting set ()
Words: 101 Articles: 2
For an effective enumeration of unary partial computable functions, the diagonal halting set is
Equivalently, for an enumeration of computably enumerable sets, .
Every recursively enumerable set many-one reduces to the diagonal halting set. If a program halts exactly on , the S-m-n theorem produces from an index for a unary program that ignores its input and performs that computation on . Then
Conversely, a computable preimage of a recursively enumerable set is recursively enumerable.
If , then
differs from , while the computable map proves .

Graph theory

Words: 3k Articles: 123

Binomial random graph ()

Words: 144 Articles: 3
The binomial random graph has vertex set and includes each of the possible edges independently with probability .
If counts copies of the complete graph in , then
Consequently implies by the first moment method.
If counts triangles in , then
and
Thus implies , and the second moment method gives .
Partition the vertices into two sets of comparable size. If , the first set contains a triangle with probability tending to one. Conditional on any triangle chosen using only internal edges, the probability that none of its vertices has a neighbour in the second set is at most
Hence contains a triangle with an attached leaf with probability tending to one.

Graph

Words: 60 Articles: 4
A graph consists of vertices joined by edges.
A vertex is one of the objects joined by the edges of a graph.
Two graphs are isomorphic when a bijection between their vertex sets preserves adjacency.

Triangle in a graph

Words: 27 Articles: 1
A triangle is a set of three vertices joined by all three possible edges, equivalently a copy of .
A triangle-free graph contains no triangle.

Graph colouring

Words: 186 Articles: 6
A graph colouring assigns labels called colours to graph elements subject to specified constraints. A proper vertex colouring gives adjacent vertices different colours.

Chromatic number

Words: 41 Articles: 1
The chromatic number is the least number of colours in a proper vertex colouring of .
Brooks' theorem
Words: 23
A connected graph of maximum degree has chromatic number at most unless it is a complete graph or an odd cycle.
The edge chromatic number is the least number of colours required to colour edges so that incident edges receive different colours.

Chromatic polynomial ()

Words: 101 Articles: 2
For each positive integer , the chromatic polynomial counts the proper vertex colourings of a finite graph using a fixed palette of colours.
For a non-loop edge ,
The first term counts colourings after deleting ; the second subtracts those giving its endpoints the same colour, which correspond to colourings of the contraction. Together with for an edgeless graph, induction proves that is a polynomial.
Attaching a new leaf to a graph multiplies its chromatic polynomial by , because after colouring the old graph the leaf may receive any colour except its neighbour's.

Independent set

Words: 25
An independent set is a set of vertices no two of which are adjacent. In every proper colouring, each colour class is an independent set.
A leaf is a vertex of degree one.

Edge of a graph

Words: 20
An edge joins two vertices of a graph; in a simple graph it is an unordered pair of distinct vertices.

Path in a graph

Words: 51 Articles: 2
A path of length is a sequence of distinct vertices in which consecutive vertices are adjacent.
Every connected -vertex graph of minimum degree contains a path of length at least .
An -vertex graph containing no path of length has at most edges.

Subgraph

Words: 85 Articles: 2
A subgraph is obtained from a graph by selecting some of its vertices and edges while retaining every selected edge's endpoints.
The subgraph induced by a vertex set contains every edge of the original graph whose two endpoints lie in .
Every finite graph has a three-colourable subgraph with at least edges. Give vertices three independent uniform colours and retain edges whose endpoints have different colours. Each edge survives with probability , so the expected number surviving is .

Complete graph

Words: 58 Articles: 2
The complete graph has vertices and every possible edge between distinct vertices.

Clique

Words: 24
A clique in a graph is a vertex set whose induced subgraph is complete. A copy of is therefore an -vertex clique.
For the adjacency matrix of ,
Hence are linearly dependent for every .

Graph Laplacian ()

Words: 49 Articles: 1
For a finite graph with adjacency matrix and degree matrix , its graph Laplacian is
Its quadratic form is .
The graph Laplacian of the complete graph has eigenvalue zero on the constant vector and eigenvalue on the -dimensional subspace whose coordinates sum to zero.
A minimum-cost flow minimizes a linear edge cost subject to vertex flow balances and edge capacity intervals. Subtracting every lower capacity from its edge flow converts all lower bounds to zero while shifting the balance vector and objective by constants.

Extremal graph theory

Words: 160 Articles: 6

Extremal number ()

Words: 34 Articles: 1
The extremal number is the largest number of edges in an -vertex graph containing no subgraph isomorphic to .
Mantel theorem
Words: 12
Every triangle-free graph on vertices has at most edges.

Turan theorem

Words: 126 Articles: 3
Among -vertex graphs containing no , the maximum number of edges is attained by the complete -partite graph whose part sizes differ by at most one, denoted .
Every -vertex graph containing no satisfies
Rhombus-free edge bound
Words: 85 Articles: 1
A graph-theoretic rhombus is two triangles sharing an edge. Every rhombus-free graph on vertices has at most
edges. If the graph is triangle-free this is TurΓ‘n's theorem. Otherwise remove a triangle: every remaining vertex has at most one neighbor in it, and induction bounds the edge count by
.
The triangular prism has six vertices and nine edges. Each edge lies in at most one triangle, so it has no rhombus; its two triangles show that it is not .

Flow network

Words: 111 Articles: 2
A flow network is a directed capacitated graph with a source and sink. A feasible flow respects edge capacities and conserves flow at every other vertex.

Max-flow min-cut theorem

Words: 85 Articles: 1
The greatest value of a feasible source-to-sink flow equals the least capacity of a source-to-sink cut. For a maximum flow, the vertices reachable from the source in the residual graph define a cut whose forward edges are saturated and whose backward edges carry zero flow.
If one edge leaving the source has capacity , every cut capacity is affine in with coefficient zero or one. In the 2024 Cambridge Part IB example, cuts of capacities and are both sharp, giving

Eulerian graph

Words: 54 Articles: 1
An Eulerian graph has a closed trail that traverses every edge exactly once.
A finite graph with at least three vertices is Eulerian exactly when it is connected and every vertex has even degree. A maximal trail closes by parity; closed trails based at vertices with unused incident edges can then be spliced together.

Line graph

Words: 46 Articles: 1
The line graph has one vertex for each edge of , with adjacency when two original edges share an endpoint.
If is connected and -regular, then is connected and every one of its vertices has degree . The Euler circuit criterion therefore applies.

Planar graph

Words: 87 Articles: 3
A planar graph admits a drawing in the plane whose edges meet only at common endpoints.
For a connected planar graph with vertices, edges, and faces,
Deleting a cycle edge preserves connectedness and decreases both and by one, reducing the formula to its immediate tree case.
A simple planar graph with vertices has at most edges.
If every face of a connected planar graph has size at least , double-counting edge-face incidences and using Euler's formula gives

Crossing number

Words: 70 Articles: 1
The crossing number of a graph is the minimum number of edge-crossing pairs among its plane drawings. For a fixed drawing, deleting at most one edge per crossing pair leaves a planar graph.

Crossing lemma

Words: 37
If a simple graph has vertices and edges, every plane drawing has at least
crossings. Apply the linear planar bound to the random induced subgraph obtained by retaining vertices independently with probability .

Graph neighbourhood ()

Words: 35 Articles: 1
The neighbourhood of a vertex set consists of all vertices adjacent to at least one vertex of .
A common neighbour of vertices and is adjacent to both of them.

Degree of a vertex ()

Words: 34 Articles: 1
The degree of a vertex is the number of edges incident with it, equivalently the cardinality of its neighbourhood in a simple graph.
A graph is locally finite when every vertex has finite degree.

Cut of a graph

Words: 180 Articles: 5
A cut is a partition of the vertex set. Its size is the number of edges with one endpoint in each part.

Maximum cut

Words: 13
A maximum cut has greatest size among all cuts of a finite graph.

Unfriendly partition of a graph

Words: 143 Articles: 3
An unfriendly partition puts at least as many neighbours of every vertex in the opposite part as in its own part.
Every finite graph has an unfriendly partition. In a maximum cut, moving any vertex to the other side cannot increase the number of crossing edges, which is exactly the required neighbour inequality.
Take unfriendly partitions of an exhaustion by finite induced subgraphs and use a diagonal subsequence to stabilize the colour of each vertex. Local finiteness makes every neighbourhood stabilize after finitely many steps, so each unfriendly inequality passes to the limit.
Independently colour the vertices of a countable graph red or blue with equal probabilities. If every vertex has infinite degree, then each fixed vertex has infinitely many neighbours of each colour almost surely. A countable union of the exceptional null events is null, so such a colouring exists.

Bipartite graph

Words: 60 Articles: 2
A graph is bipartite when its vertices split into two classes and every edge joins the two different classes.
The complete bipartite graph has vertex classes of sizes and and contains all edges between the classes.
A finite graph is bipartite exactly when it has a proper colouring with two colours. Equivalently,
for its chromatic polynomial.

Directed graph

Words: 108 Articles: 4
A directed graph consists of vertices joined by oriented edges.

Directed edge

Words: 16
A directed edge has an initial vertex and a terminal vertex .

Directed walk

Words: 33 Articles: 1
A directed walk is a sequence of vertices in which each consecutive pair is joined by a directed edge in the direction traversed.
A directed walk is closed when its first and last vertices agree.
The adjacency matrix of a finite directed graph has entry equal to the number of directed edges from vertex to vertex . The entry counts length- directed walks from to , so counts pointed closed directed walks of length .
The adjacency matrix of a finite simple graph has entry when vertices are adjacent and zero otherwise.
For every nonnegative integer , the entry equals the number of length- walks from to . This follows by induction, since matrix multiplication appends one adjacent vertex to each walk.

Graph distance ()

Words: 74 Articles: 2
The distance between connected vertices is the least length of a path joining them.

Graph diameter ()

Words: 59 Articles: 1
The diameter of a connected finite graph is the maximum distance between two vertices.
If a connected graph has adjacency matrix and diameter , then
are linearly independent. For the largest index with a nonzero coefficient, choose vertices at distance ; the corresponding entries of all lower powers vanish, while by the walk count from powers of an adjacency matrix.
The eigenvalues of a finite graph are the eigenvalues of its adjacency matrix.

Bipartite adjacency matrix

Words: 47 Articles: 1
With the two vertex classes listed consecutively, a bipartite graph has adjacency matrix .
If a square bipartite adjacency matrix has nonzero determinant, some product in its Leibniz expansion is nonzero. Its permutation selects one edge at each vertex and therefore gives a perfect matching.

Matching in a graph

Words: 227 Articles: 8
A matching is a set of edges with no shared endpoints. It saturates a vertex set when every vertex in that set is incident to one of its edges.
A perfect matching saturates every vertex of the graph.
A matching is maximal when no edge can be added to it, and maximum when no matching has more edges. Every maximum matching is maximal, and the unmatched vertices of a maximal matching form an independent set.

Matching number

Words: 16
The matching number is the largest number of edges in a matching of .

Hall marriage theorem

Words: 78 Articles: 2
A bipartite graph has a matching saturating exactly when for every .
For Hall's theorem, either every proper nonempty set has one excess neighbour and one deletes an arbitrary edge's endpoints, or a tight set with splits the problem into the induced graph on and its complement.
In a -regular bipartite graph, edge counting gives equal vertex-class sizes and . Hall's theorem therefore supplies a perfect matching.
If a -regular graph on vertices has a maximum matching of size , its unmatched vertices are independent. Counting their incident edges gives , and hence .
The disjoint union of triangles is -regular on vertices and has matching number , attaining the regular-graph lower bound .

Antichain

Words: 13
An antichain is a family of sets no one of which contains another.

Ramsey theorem

Words: 239 Articles: 8
Every sufficiently large graph contains either a prescribed clique or a prescribed independent set.

Diagonal Ramsey number

Words: 34 Articles: 1
The diagonal Ramsey number is the least such that every red-blue edge-colouring of contains a monochromatic .
The off-diagonal recursion
with gives
In particular, .

Graph Ramsey number

Words: 191 Articles: 5
For a finite graph , its two-colour Ramsey number is the least such that every red-blue colouring of contains a monochromatic copy of . It exists because a monochromatic clique on vertices contains a copy of .
The Ramsey number is the least such that every red-blue colouring of contains a red copy of or a blue copy of .
If denotes a path of length , then
for and .
For the star ,
The parity distinction follows from the handshake lemma applied to a hypothetical -regular colour class on vertices.
Paw graph
Words: 72 Articles: 1
The paw graph is a triangle with one pendant edge.
The paw graph has . A colouring of with two disjoint red triangles and all cross-edges blue avoids a monochromatic paw. In , a monochromatic triangle exists; avoiding a paw forces all its edges to the other four vertices into the opposite colour, which then forces those four internal edges into the triangle's colour and creates a paw.

Dirac theorem

Words: 15
Every graph on vertices with minimum degree at least has a Hamilton cycle.

Longest-path rotation

Words: 109 Articles: 1
If an endpoint of a longest path is adjacent to an internal vertex, replacing the incident path edge by that chord produces another longest path with the same vertex set and a new endpoint. Every neighbour of every endpoint obtained this way must remain on the original path.
Let be vertices of a bipartite graph, each of degree at least . If the graph has no -cycle, then . Indeed, any pair in has at most one common neighbour, so
If , Cauchy--Schwarz and make the left side strictly larger than , a contradiction.
A strongly regular graph has constant degree and fixed common-neighbour counts for adjacent and nonadjacent vertex pairs.

Moser spindle

Words: 12
The Moser spindle is a seven-vertex unit-distance graph with chromatic number four.

Random graph

Words: 287 Articles: 8
A random graph is a graph sampled from a probability distribution on graphs.
An isolated vertex has degree zero.

ErdΕ‘s-RΓ©nyi model

Words: 268 Articles: 6
In the model, each of the possible edges is included independently with probability .
Let be the number of isolated vertices in . Indicator variables give
and, because a specified pair is simultaneously isolated precisely when the incident edges are absent,
For , the number of isolated vertices satisfies
The upper side follows from the first-moment bound. On the lower side, and , so the second-moment method applies.
For every fixed ,
whereas the probability tends to zero when . Above the threshold a union bound excludes every component of size at most ; below it isolated vertices remain with high probability.
If a fixed graph has vertices, edges, and unlabelled copies in , then the number of its copies in satisfies
This follows by writing as a sum of indicator random variables.
For , the number of copies of satisfies
and . Two distinct copies have dependent indicators only when they share at least two vertices; pairs sharing two or three vertices contribute respectively and to the variance.
For , the expected number of pairs of copies sharing a vertex is
Thus, with probability tending to one, all the copies are vertex-disjoint. Together with sparse clique-count concentration, this gives arbitrarily many vertex-disjoint copies with probability tending to one.
The complement of a simple graph has exactly the edges absent from the original graph; a vertex of degree acquires degree .

Menger theorem

Words: 239 Articles: 10
The maximum number of disjoint paths joining two vertex sets equals the minimum size of a separating set, with vertex and edge versions according to the chosen notion of disjointness.
An - vertex separator is a set of vertices, excluding and , whose deletion leaves no path from to .
Paths with common endpoints are internally vertex-disjoint when they share no other vertex.
For vertex sets , the maximum number of pairwise vertex-disjoint - paths equals the minimum size of a vertex set meeting every - path.

Linked graph

Words: 26
A graph is -linked when any distinct vertices paired as can be joined by mutually vertex-disjoint paths from to .

Vertex connectivity

Words: 64 Articles: 2
Vertex connectivity is the smallest number of vertices whose deletion disconnects a nontrivial graph or reduces it to one vertex.
Dirac circumference theorem
Words: 43 Articles: 1
A -connected graph has a cycle of length at least .
A component outside a longest cycle has at least attachment vertices in a -connected graph, and no two attachments are consecutive, forcing cycle length at least .
Edge connectivity is the smallest number of edges whose deletion disconnects the graph.
For every nontrivial graph, .
Two large cliques joined by a bipartite cross graph with edge count and vertex-cover number realize edge connectivity and vertex connectivity while preserving a chosen minimum degree.
KΓΆnig's theorem equates the minimum vertex-cover size of a bipartite graph with its maximum matching size.

Statistical learning theory

Words: 844 Articles: 33
If independent inputs enter a function whose value changes by at most when only coordinate changes, then
A learning algorithm has uniform stability for a loss when replacing one training example changes the loss at every test example by at most .

Hypothesis class

Words: 40 Articles: 1
A binary hypothesis class is a family of functions from an input space to a two-element label set, commonly .
The sign function records whether a real number is positive or negative, with a convention chosen separately at zero.

Empirical risk minimization

Words: 32 Articles: 1
Empirical risk minimization chooses a hypothesis that minimizes the average loss on the observed data.
For data and predictions , it is convenient to write
Its gradient is

Regression tree

Words: 91 Articles: 1
A regression tree recursively partitions predictor space by axis-aligned splits. At each leaf, candidate coordinates and thresholds are compared by the residual sum of squares after replacing that leaf by its two children; the selected split minimizes the total criterion. The fitted value in each terminal region is the sample mean there.
For a deterministic partition and
conditional independence gives
If the conditional response variance is at most , the prediction variance at an independent test point is at most .

Shattering coefficient ()

Words: 180 Articles: 7
The shattering coefficient is
For binary hypothesis classes,
because the label vectors realized by the union form the union of the two sets of realized label vectors.

VC dimension ()

Words: 142 Articles: 5
The VC dimension is the largest number of points on which a binary hypothesis class realizes every possible labeling.
Sauer-Shelah lemma
Words: 26 Articles: 1
If , then .
The elementary estimate converts finite VC dimension into a polynomial bound on the number of sample labelings.
The class of lower orthants in has VC dimension at most . Among any points, choose a coordinate maximizer for each of the coordinates. A remaining point cannot be excluded while all those maximizers are included.
Indicators of real intervals have VC dimension two: two ordered points can be labeled arbitrarily, while an interval containing the two outer points of a triple must contain the middle point.
Intervals together with their label complements shatter three ordered points, but cannot realize an alternating labeling on four, so their VC dimension is three.

VC dimension of a vector space

Words: 125 Articles: 3
The sign class of a -dimensional real vector space of functions has VC dimension at most . If points were shattered, the evaluation map from the function space to would have a nonzero vector orthogonal to its image. Choosing labels according to the signs of that vector contradicts orthogonality.
The indicators of closed Euclidean balls in have VC dimension at most . Indeed,
where
belongs to the span of .
The map embeds homogeneous quadratic forms in a linear function space of dimension .
The signs of homogeneous linear forms on have VC dimension at most . The Sauer-Shelah growth bound therefore gives
For with drawn from a binary class , fixing leaves an -dimensional linear sign class. Consequently
when is finite, and in general
A bias-free network with inputs, sign-activated hidden nodes, and a thresholded linear output satisfies
The hidden units contribute sample patterns, and the output weights contribute .

AdaBoost

Words: 63 Articles: 1
AdaBoost constructs an additive classifier by repeatedly fitting a base classifier to exponentially reweighted observations. Misclassified observations receive greater weight at the next iteration, and the final score is a nonnegative weighted sum of the base classifiers.
For labels and a real-valued score , the exponential loss is . Its population and empirical risks are

Rademacher complexity

Words: 177 Articles: 7
Rademacher complexity measures how strongly a hypothesis class can correlate with independent random signs on a sample.
For a finite with , its empirical Rademacher complexity is at most .
For and a binary class of VC dimension at most , the vectors have norm at most and at most distinct values. The Massart finite-class lemma gives
A linear functional has the same supremum over a class and its convex hull. Thus taking convex combinations does not increase empirical Rademacher complexity.
Composition with an -Lipschitz scalar map increases Rademacher complexity by at most the factor after centering at zero.
Independent signs cancel cross terms in , leaving .
For , , , and , the complexity is at most .
With the Rademacher convention, an empirical risk minimizer has expected excess risk at most twice the Rademacher complexity of its loss class.

Hinge loss

Words: 12
The hinge loss is and is one-Lipschitz in the signed margin.

Mathematical proof

Words: 75 Articles: 3
A mathematical proof is a finite deductive argument from stated assumptions to a conclusion.

Counterexample

Words: 19
A counterexample is one instance satisfying a claim’s hypotheses but not its conclusion, and therefore disproves the universal claim.
Structural induction proves a property of every recursively generated object by checking the initial objects and showing that every construction rule preserves the property.
A probability-preserving bijection pairs outcomes of two events without changing their masses, proving the events have equal probability.

 Ancestors (3)

  1. Area of mathematics
  2. Mathematics
  3.  Home