高级计算机体系结构 第一章

PCA L1 Intro.7 Wu Spring 10 ©USTC
Today’s Goal:
°Introduce you to Parallel Computer Architecture
°Provide you a sense of the trends that shape the field
PCA L1 Intro.10 Wu Spring 10 ©USTC
What will you get out of PCA? °In-depth understanding of the design and engineering of modern parallel computers
• Technology forces • Fundamental architectural issues - naming, replication, communication, synchronization
°Organization:
• • • • • • • • 第一章 绪论 第二章 性能评测 第三章 互连网络 第四章 SMP 第五章 MPP 第六章 Cluster 第七章 DSM 第八章 Communication and Latency
PCA L1 Intro.5
Wu Spring 10 ©USTC
Interconnection Networks: An Engineering Approach , Jose Duato, Sudhakar Yalamanchili, Lionel M. Ni 中译本 并行计算机互连网络技术——一种工程方法
Computer Architecture：A Quantitative Approach，John L. Hennessy, David A. Patterson (Fourth Edition)
• Resource Allocation:
- how large a collection? - how powerful are the elements? - how much memory? • Data access, Communication and Synchronization - how do the elements cooperate and communicate? - how are data transmitted between processors? - what are the abstractions and primitives for cooperation? • Performance and Scalability - how does it all translate into performance? - how does it scale?
°Intro to Parallel Computer Architecture °Break °Application Trends °Technology Trends °Architectural Trends
PCA L1 Intro.9
Wu Spring 10 ©USTC
What is Parallel Architecture? °A parallel computer is a collection of processing elements that communicate and cooperate to solve large problems fast. °Some broad issues:
Schedule
°3/1 Lec1 Introduction °3/8 Lec2 Trends and Tech issues in PCA °3/15 Lec3 Evaluation °3/22 Lec4 Interconnect °3/29，4/12 Lec5-6 Interconnect Continued °4/19 Lec7 SMP °4/26, 5/10 Lec8-9 SMP Continued °5/17 Lec10 CMP °5/24 Lec11 DSM °5/31 Lec12 MPP °6/7 Lec13 Cluster
°6/14 Lec14 Cloud Computing+ Virtualization
°6/21 Lec15 Presentation
PCA L1 Intro.6
°6/28 Exam
Wu Spring 10 ©USTC
About Project °要求：本校计算机体系结构专业学生必须完成一项。其 他专业学生感兴趣的也可参加。 °分组：每组1-2人 °题目：可选提供的，也可以结合自己以后的研究方向自 选，但必须经老师同意。不同的组尽量不选相同的课题 ，不要把其他课程的作业拿过来交差 。 °完成方式：阅读关于所选课题方面的文章（该领域经典 的文章及最近的进展），形成一篇该领域的综述文章或 研究论文（要求按照论文格式，结构完整，关键词、摘 要、索引，参考文献都需要），希望能提出自己的见解 。最后每组选一个同学参与答辩（PowerPoint,10分钟 ）。 °时间安排：3月13号前完成分组选题，6月13号前上交 paper，6月21号答辩。 °提交方式：统一用电子版（jmwu@ustc.edu.cn)
Parallel Computer Architecture 并行计算机体系结构 Lecture 1
March 1, 2010
Wu Junmin (jmwu@ustc.edu.cn)
PCA L1 Intro.1
Wu Spring 10 ©USTC
Overview
°Administrative Matters
• 体系结构专业的学生要求完成一个Project.
PCA L1 Intro.4
Wu Spring 10 ©USTC
About the Textbook °Authors:
• 陈国良教授，中科院院士，国家高性能中心（合肥）主任
• 并行算法学科体系：并行算法的设计与分析、并行计算机体系结构、 并行算法实践、并行计算
°Answer your questions about this course
°统计：学过Computer Architecture, Parallel Computing的同学
PCA L1 Intro.8
Wu Spring 10 ©USTC
Overview
°Administrative Matters
• Is increasingly central in information processing
PCA L1 Intro.13
Wu Spring 10 ©USTC
Why Study it Today? °History: diverse and innovative organizational structures, often tied to novel programming models °Rapidly maturing under strong technological constraints
wk.baidu.com
Why Study Parallel Architecture?
Role of a computer architect:
To design and engineer the various levels of a computer system to maximize performance and programmability within limits of technology and cost.
°Intro to Parallel Computer Architecture °Break °Application Trends °Technology Trends °Architectural Trends
PCA L1 Intro.2
Wu Spring 10 ©USTC
Course Administration °Instructor: 吴俊敏 (jmwu@ustc.edu.cn)
• Naming, Ordering, Replication, Communication performance
PCA L1 Intro.14
Wu Spring 10 ©USTC
Overview
°Administrative Matters
°Intro to Parallel Computer Architecture °Break °Application Trends °Technology Trends °Architectural Trends
• migrate downward with time
°Understand implications for software
SuperServers
Departmenatal Servers
Workstations Personal Computers
PCA L1 Intro.12
Wu Spring 10 ©USTC
°Across the hardware/software boundary
PCA L1 Intro.11
Wu Spring 10 ©USTC
Will it be worthwhile? °The fundamental issues and solutions translate across a wide spectrum of systems. °Pioneered at the thin-end of the platform pyramid on the most-demanding applications
°Materials:
http://www.bb.ustc.edu.cn
°Text: 并行计算机体系结构，陈国良等编著，高等教育
出版社
°Reference Book:
Parallel Computer Architecture: A Hardware/Software Approach, David E.Culler etc. Morgan Kaufmann Publishers 中译本 并行计算机系统结构 李晓明等译
• The “killer micro” is ubiquitous
• Laptops and supercomputers are fundamentally similar! • Technological trends cause diverse approaches to converge
°Technological trends make parallel computing inevitable °Need to understand fundamental principles and design tradeoffs, not just taxonomies
Parallelism:
• Provides alternative to faster clock for performance • Applies at all levels of system design • Is a fascinating perspective from which to view architecture
PCA L1 Intro.3 Wu Spring 10 ©USTC
Grading °Grade breakdown
• • • • Final Exam: Homework Assignments Project Class Participation: 50% (70%) 20% 20% (0) 10%
• Basic design techniques - cache coherence, protocols, networks, pipelining, … • Methods of evaluation • Underlying engineering trade-offs
°From moderate to very large scale