Chapter 1 Matrices and Systems of EquationsLinear systems arise in applications to such areas as engineering, physics, electronics, business, economics, sociology（社会学）, ecology （生态学）, demography(人口统计学), and genetics（遗传学）, etc. §1. Systems of Linear EquationsNew words and phrases in this section:Linear equation 线性方程Linear system，System of linear equations 线性方程组Unknown 未知量Consistent 相容的Consistence 相容性Inconsistent不相容的Inconsistence 不相容性Solution 解Solution set 解集Equivalent 等价的Equivalence 等价性Equivalent system 等价方程组Strict triangular system 严格上三角方程组Strict triangular form 严格上三角形式Back Substitution 回代法Matrix 矩阵Coefficient matrix 系数矩阵Augmented matrix 增广矩阵Pivot element 主元Pivotal row 主行Echelon form 阶梯形1.1 DefinitionsA linear equation (线性方程) in n unknowns（未知量）is1122...n na x a x a x b+++=A linear system of m equations in n unknowns is11112211211222221122...... .........n n n n m m m n n m a x a x a x b a x a x a x b a x a x a x b+++=⎧⎪+++=⎪⎨⎪⎪+++=⎩ This is called a m x n (read as m by n) system.A solution to an m x n system is an ordered n-tuple of numbers （n 元数组）12(,,...,)n x x x that satisfies all the equations.A system is said to be inconsistent （不相容的） if the system has no solutions.A system is said to be consistent （相容的）if the system has at least one solution.The set of all solutions to a linear system is called the solution set（解集）of the linear system.1.2 Geometric Interpretations of 2x2 Systems11112212112222a x a xb a x a x b +=⎧⎨+=⎩ Each equation can be represented graphically as a line in the plane. The ordered pair 12(,)x x will be a solution if and only if it lies on bothlines.In the plane, the possible relative positions are(1) two lines intersect at exactly a point; (The solution set has exactly one element)(2)two lines are parallel; (The solution set is empty)(3)two lines coincide. (The solution set has infinitely manyelements)The situation is the same for mxn systems. An mxn system may not be consistent. If it is consistent, it must either have exactly one solution or infinitely many solutions. These are only possibilities.Of more immediate concerns is the problem of finding all solutions to a given system.1.3 Equivalent systemsTwo systems of equations involving the same variables are said to be equivalent（等价的，同解的）if they have the same solution set.To find the solution set of a system, we usually use operations to reduce the original system to a simpler equivalent system.It is clear that the following three operations do not change the solution set of a system.(1)Interchange the order in which two equations of a system arewritten;(2)Multiply through one equation of a system by a nonzero realnumber;(3)Add a multiple of one equation to another equation. (subtracta multiple of one equation from another one)Remark: The three operations above are very important in dealing with linear systems. They coincide with the three row operations of matrices. Ask a student about the proof.1.4 n x n systemsIf an nxn system has exactly one solution, then operation 1 and 3 can be used to obtain an equivalent “strictly triangular system ”A system is said to be in strict triangular form (严格三角形) if in the k-th equation the coefficients of the first k-1 variables are all zero and the coefficient ofkx is nonzero. (k=1, 2, …,n)An example of a system in strict triangular form:123233331 2 24x x x x x x ++=⎧⎪-=⎨⎪=⎩Any nxn strictly triangular system can be solved by back substitution (回代法).(Note: A phrase: “substitute 3 for x ” == “replace x by 3”)In general, given a system of linear equations in n unknowns, we will use operation I and III to try to obtain an equivalent system that is strictly triangular.We can associate with a linear system an mxn array of numbers whose entries are coefficient of theix ’s. we will refer to this array as thecoefficient matrix (系数矩阵) of the system.111212122212.....................n nm m m n a a a a a a a a a ⎛⎫⎪ ⎪ ⎪ ⎪⎝⎭A matrix （矩阵） is a rectangular array of numbersIf we attach to the coefficient matrix an additional column whose entries are the numbers on the right-hand side of the system, we obtain the new matrix11121121222212n n s m m m na a ab a a a b b a a a ⎛⎫ ⎪ ⎪ ⎪⎝⎭We refer to this new matrix as the augmented matrix （增广矩阵） of a linear system.The system can be solved by performing operations on the augmented matrix. i x ’s are placeholders that can be omitted until the endof computation.Corresponding to the three operations used to obtain equivalent systems, the following row operation may be applied to the augmented matrix.1.5 Elementary row operationsThere are three elementary row operations:(1)Interchange two rows;(2)Multiply a row by a nonzero number;(3)Replace a row by its sum with a multiple of another row.Remark: The importance of these three operations is that they do not change the solution set of a linear system and may reduce a linear system to a simpler form.An example is given here to illustrate how to perform row operations on a matrix.★Example:The procedure for applying the three elementary row operations:Step 1: Choose a pivot element (主元)(nonzero) from among the entries in the first column. The row containing the pivotnumber is called a pivotal row（主行）. We interchange therows (if necessary) so that the pivotal row is the new firstrow.Multiples of the pivotal row are then subtracted form each of the remaining n-1 rows so as to obtain 0’s in the firstentries of rows 2 through n.Step2: Choose a pivot element from the nonzero entries in column 2, rows 2 through n of the matrix. The row containing thepivot element is then interchanged with the second row ( ifnecessary) of the matrix and is used as the new pivotal row.Multiples of the pivotal row are then subtracted form eachof the remaining n-2 rows so as to eliminate all entries belowthe pivot element in the second column.Step 3: The same procedure is repeated for columns 3 through n-1.Note that at the second step, row 1 and column 1 remain unchanged, at the third step, the first two rows and first two columns remain unchanged, and so on.At each step, the overall dimensions of the system are effectively reduced by 1. (The number of equations and the number of unknowns all decrease by 1.)If the elimination process can be carried out as described, we will arrive at an equivalent strictly triangular system after n-1 steps.However, the procedure will break down if all possible choices for a pivot element are all zero. When this happens, the alternative is to reduce the system to certain special echelon form（梯形矩阵）. AssignmentStudents should be able to do all problems.Hand-in problems are: # 7--#11§2. Row Echelon FormNew words and phrases:Row echelon form 行阶梯形Reduced echelon form 简化阶梯形 Lead variable 首变量 Free variable 自由变量Gaussian elimination 高斯消元Gaussian-Jordan reduction. 高斯-若当消元 Overdetermined system 超定方程组 Underdetermined systemHomogeneous system 齐次方程组 Trivial solution 平凡解2.1 Examples and DefinitionIn this section, we discuss how to use elementary row operations to solve mxn systems.Use an example to illustrate the idea.★ Example : Example 1 on page 13. Consider a system represented by the augmented matrix111111110011220031001131112241⎛⎫ ⎪--- ⎪ ⎪-- ⎪- ⎪ ⎪⎝⎭ 111111001120002253001131001130⎛⎫⎪ ⎪ ⎪ ⎪- ⎪ ⎪⎝⎭………..(The details will given in class)We see that at this stage the reduction to strict triangular form breaks down. Since our goal is to simplify the system as much as possible, we move over to the third column. From the example above, we see that the coefficient matrix that we end up with is not in strict triangular form,it is in staircase or echelon form (梯形矩阵).111111001120000013000004003⎛⎫ ⎪ ⎪ ⎪ ⎪- ⎪ ⎪-⎝⎭The equations represented by the last two rows are:12345345512=0 2=3 0=4 03x x x x x x x x x ++++=⎧⎪++⎪⎪⎨⎪-⎪=-⎪⎩Since there are no 5-tuples that could possibly satisfy these equations, the system is inconsistent.Change the system above to a consistent system.111111110011220031001133112244⎛⎫ ⎪--- ⎪ ⎪-- ⎪ ⎪ ⎪⎝⎭ 111111001120000013000000000⎛⎫⎪ ⎪ ⎪ ⎪ ⎪ ⎪⎝⎭The last two equations of the reduced system will be satisfied for any 5-tuple. Thus the solution set will be the set of all 5-tuples satisfying the first 3 equations.The variables corresponding to the first nonzero element in each row of the augment matrix will be referred to as lead variable .（首变量） The remaining variables corresponding to the columns skipped in the reduction process will be referred to as free variables （自由变量）.If we transfer the free variables over to the right-hand side in the above system, then we obtain the system:1352435451 2 3x x x x x x x x x ++=--⎧⎪+=-⎨⎪=⎩which is strictly triangular in the unknown 1x 3x 5x . Thus for each pairof values assigned to 2xand4x , there will be a unique solution.★Definition: A matrix is said to be in row echelon form (i) If the first nonzero entry in each nonzero row is 1.(ii)If row k does not consist entirely of zeros, the number of leading zero entries in row k+1 is greater than the number of leading zero entries in row k.(iii) If there are rows whose entries are all zero, they are below therows having nonzero entries.★Definition : The process of using row operations I, II and III to transform a linear system into one whose augmented matrix is in row echelon form is called Gaussian elimination （高斯消元法）.Note that row operation II is necessary in order to scale the rows so that the lead coefficients are all 1.It is clear that if the row echelon form of the augmented matrix contains a row of the form (), the system is inconsistent.000|1Otherwise, the system will be consistent.If the system is consistent and the nonzero rows of the row echelon form of the matrix form a strictly triangular system (the number of nonzero rows<the number of unknowns), the system will have a unique solution. If the number of nonzero rows<the number of unknowns, then the system has infinitely many solutions. (There must be at least one free variable. We can assign the free variables arbitrary values and solve for the lead variables.)2.2 Overdetermined SystemsA linear system is said to be overdetermined if there are more equations than unknowns.2.3 Underdetermined SystemsA system of m linear equations in n unknowns is said to be underdetermined if there are fewer equations than unknowns (m<n). It is impossible for an underdetermined system to have only one solution.In the case where the row echelon form of a consistent system has free variables, it is convenient to continue the elimination process until all the entries above each lead 1 have been eliminated. The resulting reduced matrix is said to be in reduced row echelon form. For instance,111111001120000013000000000⎛⎫ ⎪ ⎪ ⎪ ⎪ ⎪ ⎪⎝⎭ 110004001106000013000000000⎛⎫⎪- ⎪ ⎪ ⎪ ⎪ ⎪⎝⎭Put the free variables on the right-hand side, it follows that12345463x x x x x =-=--=Thus for any real numbersαandβ, the 5-tuple()463ααββ---is a solution.Thus all ordered 5-tuple of the form ()463ααββ--- aresolutions to the system.2.4 Reduced Row Echelon Form★Definition : A matrix is said to be in reduced row echelon form if :(i)the matrix is in row echelon form.(ii) The first nonzero entry in each row is the only nonzero entry in its column.The process of using elementary row operations to transform a matrix into reduced echelon form is called Gaussian-Jordan reduction.The procedure for solving a linear system:(i) Write down the augmented matrix associated to the system; (ii) Perform elementary row operations to reduce the augmented matrix into a row echelon form;(iii) If the system if consistent, reduce the row echelon form into areduced row echelon form. (iv) Write the solution in an n-tuple formRemark: Make sure that the students know the difference between the row echelon form and the reduced echelon form.Example 6 on page 18: Use Gauss-Jordan reduction to solve the system:1234123412343030220x x x x x x x x x x x x -+-+=⎧⎪+--=⎨⎪---=⎩The details of the solution will be given in class.2.5 Homogeneous SystemsA system of linear equations is said to be homogeneous if theconstants on the right-hand side are all zero.Homogeneous systems are always consistent since it has a trivial solution. If a homogeneous system has a unique solution, it must be the trivial solution.In the case that m<n (an underdetermined system), there will always free variables and, consequently, additional nontrivial solution.Theorem 1.2.1 An mxn homogeneous system of linear equations has a nontrivial solution if m<n.Proof A homogeneous system is always consistent. The row echelon form of the augmented matrix can have at most m nonzero rows. Thus there are at most m lead variables. There must be some free variable. The free variables can be assigned arbitrary values. For each assignment of values to the free variables, there is a solution to the system.AssignmentStudents should be able to do all problems except 17, 18, 20.Hand-in problems are 9, 10, 16,Select one problem from 14 and 19.§3. Matrix AlgebraNew words and phrases:Algebra 代数Scalar 数量，标量Scalar multiplication 数乘 Real number 实数 Complex number 复数 V ector 向量Row vector 行向量 Column vector 列向量Euclidean n-space n 维欧氏空间 Linear combination 线性组合 Zero matrix 零矩阵Identity matrix 单位矩阵 Diagonal matrix 对角矩阵 Triangular matrix 三角矩阵Upper triangular matrix 上三角矩阵 Lower triangular matrix 下三角矩阵 Transpose of a matrix 矩阵的转置(Multiplicative ) Inverse of a matrix 矩阵的逆 Singular matrix 奇异矩阵 Singularity 奇异性Nonsingular matrix 非奇异矩阵 Nonsingularity 非奇异性The term scalar (标量，数量) is referred to as a real number (实数) or a complex number （复数）. Matrix notationAn mxn matrix, a rectangular array of mn numbers.111212122212.....................n nm m m n a a a a a a a a a ⎛⎫⎪ ⎪ ⎪ ⎪⎝⎭()ij A a =3.1 VectorsMatrices that have only one row or one column are of special interest since they are used to represent solutions to linear systems.We will refer to an ordered n-tuple of real numbers as a vector （向量）.If an n-tuple is represented in terms of a 1xn matrix, then we will refer to it as a row vector . Alternatively, if the n-tuple is represented by an nx1 matrix, then we will refer to it as a column vector . In this course, we represent a vector as a column vector.The set of all nx1 matrices of real number is called Euclidean n-space (n 维欧氏空间) and is usually denoted by nR.Given a mxn matrix A, it is often necessary to refer to a particular row or column. The matrix A can be represented in terms of either its column vectors or its row vectors.12(a ,a ,,a )n A = ora (1,:)a(2,:)a(,:)A m ⎛⎫ ⎪⎪= ⎪ ⎪⎝⎭3.2 EqualityFor two matrices to be equal, they must have the same dimensions and their corresponding entries must agree★Definition : Two mxn matrices A and B are said to be equal ifij ij a b =for each ordered pair (i, j)3.3 Scalar MultiplicationIf A is a matrix,αis a scalar, thenαA is the mxn matrix formed by multiplying each of the entries of A byα.★Definition : If A is an mxn matrix, αis a scalar, thenαA is themxn matrix whose (i, j) is ij a αfor each ordered pair (i, j) .3.4 Matrix AdditionTwo matrices with the same dimensions can be added by adding their corresponding entries.★Definition : If A and B are both mxn matrices, then the sum A+B is the mxn matrix whose (i,j) entry isij ija b + for each ordered pair (i, j).An mxn zero matrix (零矩阵) is a matrix whose entries are all zero. It acts as an additive identity on the set of all mxn matrices.A+O=O+A=AThe additive of A is (-1)A since A+(-1)A=O=(-1)A+A.A-B=A+(-1)B-A=(-1)A3.5 Matrix Multiplication and Linear Systems3.5.1 MotivationsRepresent a linear system as a matrix equationWe have yet to defined the most important operation, the multiplications of two matrices. A 1x1 system can be writtena xb =A scalar can be treated as a 1x1 matrix. Our goal is to generalize the equation above so that we can represent an mxn system by a single equation.A X B=Case 1: 1xn systems 1122... n n a x a x a x b +++=If we set()12n A a a a =and12n x x X x ⎛⎫ ⎪⎪= ⎪ ⎪⎝⎭, and define1122...n n AX a x a x a x =+++Then the equation can be written as A X b =。
IMPORTANT NOTICETexas Instruments and its subsidiaries (TI) reserve the right to make changes to their products or to discontinue any product or service without notice, and advise customers to obtain the latest version of relevant information to verify, before placing orders, that information being relied on is current and complete. All products are sold subject to the terms and conditions of sale supplied at the time of order acknowledgement, including those pertaining to warranty, patent infringement, and limitation of liability.TI warrants performance of its semiconductor products to the specifications applicable at the time of sale in accordance with TI’s standard warranty. Testing and other quality control techniques are utilized to the extent TI deems necessary to support this warranty. Specific testing of all parameters of each device is not necessarily performed, except those mandated by government requirements.CERTAIN APPLICATIONS USING SEMICONDUCTOR PRODUCTS MAY INVOLVE POTENTIAL RISKS OF DEATH, PERSONAL INJURY, OR SEVERE PROPERTY OR ENVIRONMENTAL DAMAGE (“CRITICAL APPLICATIONS”). TI SEMICONDUCTOR PRODUCTS ARE NOT DESIGNED, AUTHORIZED, OR WARRANTED TO BE SUITABLE FOR USE IN LIFE-SUPPORT DEVICES OR SYSTEMS OR OTHER CRITICAL APPLICATIONS. INCLUSION OF TI PRODUCTS IN SUCH APPLICATIONS IS UNDERSTOOD TO BE FULLY AT THE CUSTOMER’S RISK.In order to minimize risks associated with the customer’s applications, adequate design and operating safeguards must be provided by the customer to minimize inherent or procedural hazards.TI assumes no liability for applications assistance or customer product design. TI does not warrant or represent that any license, either express or implied, is granted under any patent right, copyright, mask work right, or other intellectual property right of TI covering or relating to any combination, machine, or process in which such semiconductor products or services might be or are used. TI’s publication of information regarding any third party’s products or services does not constitute TI’s approval, warranty or endorsement thereof.Copyright © 1999, Texas Instruments Incorporated。
