Dcc Ppt
•Download as PPT, PDF•
0 likes•683 views
The document introduces a distributed computing coordination (DCC) system based on Coord, an open source distributed computing platform. The DCC system aims to decrease wait times for software builds by distributing jobs across multiple machines. It discusses Coord's architecture using distributed hash tables and space-based communication. The DCC system generates jobs from makefiles, indicates which machines should execute which jobs, and then executes the jobs in parallel across machines to speed up the build process.
Report
Share
Related slideshows
Dcc Ppt
- 1. Team XID Lee Won Guk Kim Dong Soo Lee Kyung Young Lee Hang Seok Park Hyun Joong
- 2. Contents Introduction What is Coord DCC: Architecture distcc: Job scheduling DCC: Job scheduling DCC: Sequence User interface Reference
- 3. Motives Advantages Decreased wait time for builds Introduction Our System is Based on Coord, open source for distributed environment of NHN Faster time-to-market Complex and massive softwares Very long compile time Idle low spec machines
- 4. A space-based architecture built on distributed hash tables SBA(Space-based Architecture) –processes communicate with others thru. only spaces DHT(Distributed Hash Tables) –data identified by hash functions are placed on numerically near nodes A computing platform to project a single address space on distributed memories As if users worked in a single computing environment Coord What Is Coord Simple APIs write: write an object read: read a copy of an object take: read an object & delete it Coord = SBA + DHT simple to use scale well to large numbers of nodes locate data with low latency balance the distribution of data evenly amongst the participating nodes handle node join/leave scalably ease the maintenance of per-node routing Tables
- 5. Coord Applications Provide inter-process communication, resource share, and synchronization thru. the space Support a variety of distributed programming models with only simple API(write/read/take) Proper for general-purpose distributed programming as well as data-/computation-intensive distributed programming Coordhides some complicated codes for network programming The peers don’t need to recognize each other since Coordprovides time-/location-decoupling What Is Coord Client-Server Master-Worker -provide a scalable framework for parallel processing Scatter-Gather -provide an on-the-flyframework for data exchange Map-Reduce -provide a simplified framework for massive data processing
- 6. What Is Coord Master-Worker Model Instantiate a virtual space Set some keys a key to write/take jobs different keys to take/write results Perform tasks in parallel
- 7. Scatter-Gather Model What Is Coord Master-Worker Model Client-Server Model Master-Worker Model
- 8. D CC Architecture
- 9. Distcc Job Scheduling Deamon 1 Host1 Deamon 2 Deamon 3 Deamon 4 Deamon 1 Host2 Deamon 2 Deamon 3 Deamon 4 distcc is a program to distribute builds of C, C++ C or C++ code across several machines on a network Client 1 make –j4 Client 2 make –j2 Client 3 make –j2
- 10. DCC Job Scheduling Resource list Request Request Job
- 11. Job Job Job Job Job Job Job Job Job Job Job Job Job Job Job Job Job Job Job Job Job Job Job Job Step 1 Generate Job D CC Sequence MAKEFILE
- 12. Step 2 Indicate Jobs D CC Sequence
- 13. Step 3 Execute Jobs D CC Sequence
- 14. D CC Sequence Step 3 Execute Jobs
- 15. User Interface
- 16. Developing Environment Tools Bibliography CentOS ver. 5.3 (Linux kernel 2.6) Reference VIM 7.0, gedit, Eclipse Code::Blocks IDE wxGTK 2.8.10 Coord ver.0.3 C++ 를 이용한 크로스 플랫폼 개발 C++ Standard Library 튜토리얼 레퍼런스 Linux Programming 4 th Edition