Next: Computer Networks Laboratory Up: Software Department Previous: Foundation of Computer Science Lab

Distributed Parallel Processing Laboratory


/ N. N. Mirenkov / Professor
/ S. G. Sedukhin / Professor
/ Shietung Peng / Associate Professor
/ Alexander Vazhenin / Visiting Associate Professor

Our general program is high-performance computing and advanced information infrastructure. We are also thinking about a planetary machine and active knowledge being developed by humanity. We are undertaking research efforts in parallel and distributed algorithms/architectures, visual (multimedia) languages and tools. We lead joint research projects "Communication-efficient parallel computing" and "A new paradigm for clustered computing". In the first research project, we focus on the design of communication-efficient parallel algorithms for Bulk-synchronous parallel computers. The key is to develop a router that can perform efficient point-to-point and collective communication among processors. The second research project will focus on modeling, developing software packages, investigating fault-tolerance and performance analysis for the clustered computing.

We are studying the problem of parallel program portability, skeleton-based techniques and developing the supporting tools. Our theoretical work is related to efficient algorithms for parallel numerical computation including linear algebra and Fourier transformation as well as for fault tolerant routing on certain interconnection networks, like hypercubes, star graphs, and torus. Information about our activities can be found on the laboratory Home Page: http://www.u-aizu.ac.jp/labs/sw-dpp/, which contains links to three experimental laboratory WWW servers. These servers hold the High-Performance Computing and Communication topics, on-line CD-ROM Digital Library and serve as mirror sites of, for instance, the "Computational Science Educational Project".

As one of our results we would like to mention the S4CAD system. S4CAD (System of Systolic Structures Synthesis) is a high level interactive software tool for designing, analysis and modeling of systolic VLSI-oriented array processors. Starting with a localized data dependence graph of the algorithm S4CAD automatically produces all permissible array processors, among which the designer may chose the optimal one. World Wide Web page of the S4CAD is available at http://www-dpp.u-aizu.ac.jp/HPCC/S4CAD/.

The important question of our research is parallel program transparency and accessibility of massively parallel computers to large user populations. We are developing a multimedia technology for the interactive specification of application algorithms. This technology is related to visualization, animation and sonification of data processing methods. In fact, it is a 'filmification' of application algorithms. Each film is based on a rather big peace of knowledge of a class of the algorithms. Our approach is close to the idea of algorithmic skeletons (higher order functions). However, skeletons leave a big gap between reality and a human (a multi-channel being). So, we use algorithmic multimedia skeletons based on both mathematical and physical abstractions. Each film is a series of frames (computational steps) displaying one or more parameterized sets of nodes and/or moving objects in multi-dimensional space-time. Each frame highlights a subset of these nodes and/or moving objects. The films have their own sets of figures, sounds, colors and their own ``shape'' of the movement. Users recognize them due to a combination of all these features. Each film defines a partial order of scanning of the nodes or objects (and possibly, colors and sounds). As a rule, computation specified on different nodes (objects) of a frame is considered to be performed in parallel. Computation specified in different frames is performed sequentially. So, it is possible to say: the shorter film the better.

The user defines the specification by creating his new film. The corresponding program (sequential or parallel) is generated automatically. Each film itself is considered as a special-purpose application for which a parallel program is developed in advance as an item of the system library. The specification of a problem is considered as input data for such a parallel program. However, this data can introduce a composition of a few films, an irregularity of computation, special sizes of data, etc. So, each film is supported at least by a few parallel programs from the system library. Different programs are related to different conditions being defined by the specification. In other words, a film has a special space of decision-making. This space takes into account levels of problem granularity, irregularity, dynamics of the data decomposition, and some others related to algorithm features. In fact, we are developing film machines where data, knowledge and algorithms (as well as results) are specified by films. Distributed film databases can be considered as active common knowledge/software being developed by humanity. We lead two projects related to filmification of methods and data: Active Knowledge Studio and F-mail System for Elderly People and Handicaps.


Refereed Journal Papers

  1. Ikedo, T. and Mirenkov, N., Aizu Supercomputer Project. International Journal of Computers and Applications, vol.20, No.1, p.40--48, 1998.

    This paper describes a project of a massively parallel system related to Aizu's multimedia center. The system employs a highly parallel MIMD architecture using a conflict-free communication system as well as special-purpose units for graphic\&sound processing and image buffering which support high-speed input-output operations. The scalable communication system is comprised by a few networks using electronic and optical links. The idea behind the project software is making use of animation films as communication units for computer-human dialog. Each film is related to series of frames (computational steps) and reflects some knowledge about data processing. Each frame highlights a substructure of data for which operations should be specified. As a rule, this substructure is a set of points and/or moving objects in a multi-dimensional space-time.

  2. Peng, S. and Sedukhin, S., Design of optimal array processors for two-step division-free Gaussian elimination. IEICE Trans, on Information and Systems, 1999, accepted.

    The design of array processors for solving linear systems using two-step division-free Gaussian elimination method is considered. The two-step method can be used to improve the systems based on the one-step method in terms of numerical stability as well as the requirements for high-precision. In spite of the rather complicated computations needed at each iteration of the two-step method, we develop an innovative parallel algorithm whose data dependency graph meets the requirements for regularity and locality. Then we derive two-dimensional array processors by adopting a systematic approach to investigate the set of all admissible solutions and obtain the optimal array processors under linear time-space scheduling. The array processors is optimal in terms of the number of processing elements used.

  3. Gu, Q.P. and Peng, S., Node-to-set and set-to-set cluster fault tolerant routing in hypercubes. Parallel Computing, vol.24, No.8, p.1245--1261, 1998,

  4. Gu, Q.P. and Peng, S., An efficient algorithm for k-pairwise disjoint paths in star graphs. Information Processing Letters, vol.67, No.6, p.283--287, 1998.

  5. Gu, Q.P. and Peng, S., A 2-approximation Algorithm for Genome Rearrangements by Reversals and Transpositions. Theoretical Computer Science vol.210, No.2, p.327--339, 1999.

  6. Peng, S. and Sedukhin, S., Design of optimal array processors for two-step division-free Gaussian elimination. IEICE Trans, on Information and Systems, to appear, 1999.

    The design of array processors for solving linear systems using two-step division-free Gaussian elimination method is considered. The two-step method can be used to improve the systems based on the one-step method in terms of numerical stability as well as the requirements for high-precision. In spite of the rather complicated computations needed at each iteration of the two-step method, we develop an innovative parallel algorithm whose data dependency graph meets the requirements for regularity and locality. Then we derive two-dimensional array processors by adopting a systematic approach to investigate the set of all admissible solutions and obtain the optimal array processors under linear time-space scheduling. The array processors is optimal in terms of the number of processing elements used.

Refereed Proceeding Papers

  1. Mirenkov, N. and Mirenkova, T., Filmification of methods and film machines. Proceedings of the International Symposium on High-performance Computing, p.329--334, SCS, Apr. 1998.

    A multimedia technology to specify application problems and corresponding simulation techniques is presented. The idea behind the approach is making use of special-purpose animation (and video) films as communication units for computer-human dialog as well as units for data/knowledge acquisition. In fact, these films are a new set of multimedia signs. These signs are watchable, hearable, and executable. They combine features of animation/video clips with sounds and programs. As a result, conventional computers should become film machines. The paper presents basic ideas, methods and techniques for the implementation of this technology, describes a film management system and an approach to program synthesis.

  2. Mirenkov, N. and Vazhenin, A., Filmification of Methods: Computation on Matrices. Proceedings of the International Symposium on Software Engineering for Parallel and Distributed Systems (PDSE'98), p.176-185, IEEE Press, Apr. 1998.

    We are developing a multimedia programming technology to specify application problems in a format of special-purpose animation films. According to this technology users should employ a new set of multimedia signs. These signs are watch-able, hear-able, and executable. They combine features of animation clips with sounds and programs. In this paper we describe a film (a multimedia sign) as a series of frames related to computational schemes for solving the linear algebraic systems. We also present a special form to be filled out by users for the specification of computation on nodes of a 2-D structure, as well as template programs and files to support automatic synthesis of programs from the film specification.

  3. Mirenkov, N., Monakhov, O., Chunikhin, O., A multimedia system for the investigation of mapping algorithms. Proceedings of the International Conference on High-Performance Computing and Networking, LNCS, vol. 1401, p.737-746, Springer Verlag, Apr. 1998.

    TOPAS (Test and Optimization of Parallel Algorithms and Structures), a programming tool for visualization, animation and investigation of algorithms of mapping graphs is presented. The tool is implemented in Java and can be accessible on WWW. Keywords: parallel algorithms, mapping, multicomputer system, visualization of methods, Java, network technologies, programming environment.

  4. Mirenkov, N. and Hirotomi, T., Filmification of Methods: Computation on Depth Search Machines. Proc. of the Int. Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'98), p.1297-1304, CSREA, July 1998.

    We are developing a new programming technology based on filmification of methods. In this paper we describe a film to be used for the specification of algorithms of the Depth Search Machine type. Some details of program synthesis from the film specifification are also considered.

  5. Mirenkov, N. and Ebihara, T., Filmification of Methods: Computation on Pyramids. Proc. of the Int. Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'98), p.1353-1356, CSREA, July 1998.

    The paper presents a special-purpose animation film related to basic computational schemes on pyramids. The film shows a partial order of the node traversal on a top-less quad pyramid. Frames of the film reflect a layer-by-layer technique of the computation. The user can employ it to specify his algorithmic ideas. A template control file and a template program supporting the code synthesis from film specifications are also considered. In addition, a taxonomy of pyramid shapes and layer traversals to show other types of the pyramid films are presented.

  6. Yoshioka, R. and Mirenkov, N., A Visual Language for Filmification of Methods. Proceedings of the International Symposium on High-performance Computing (HPC'99), p.152-158, SCS, April 1999.

    A visual language to specify application problems and corresponding simulation techniques is considered. The idea behind the approach is making use of special-purpose animation films as communication units for computer-human dialog as well as units for data/knowledge acquisition. In fact, these films are a new set of multimedia signs. These signs are watchable, hearable, and executable. They combine features of animation clips with sounds and programs. Usually, a film is related to a parameterized set of nodes (and/or moving objects) in 4-D space-time and to a partial order of traversing the nodes. A set of nodes is a structure like a grid, tree, pyramid, multi-stage networks, etc. It can be also considered as an index space or a data structure. The variety of these sets is based on existing methods, possible structures in 3-D space, and structure compositions. This paper presents a visual language to develop such multimedia signs. The basis of the language is a set of micro-icons to specify different partial orders of 1-D structure scanning and compositions of these structures, as well as to create film formats and multimedia names (super-icons) for application methods.

  7. Mirenkov, N., Vazhenin A., Yoshioka, R., Ebihara, T., Hirotomi,T. and Mirenkova, T., Active Knowledge Studio. Proceedings of the International Conference on Information Systems Analysis and Synthesis (ISAS'99), July-August 1999.

    A multimedia programming technology based on filmification of methods and data is presented. Within the framework of this technology software modules are created in a film format. This format is to support a new type of abstraction combining both mathematical and physical notions. Special operations on the modules to create new films are allowed. Films can be considered not only as building blocks, but also as multimedia signs with self-explanatory features, as well as large-grained units of data/knowledge representing some properties of real world objects/processes. So, databases of such films should become sources of active knowledge.

  8. Sedukhin, S. and Peng, S., A model for cluster of computers. The IASTED International Conference on Parallel and Distributed Computing and Networks, p.154--159, IASTED, ACTA Press, Dec. 1998.

    In this paper, we present a model for cluster of computers which uses an arbitrage for partially decentralized control. Then, we derive formula for the coefficient of effective processing in different modes defined by the average number of communication requests in queue. Based on these formula and criteria data of the parametrs we investigate the performance of the cluster.

  9. Sedukhin, S. and Takigahira, T., Synthesis of size-optimal toroidal array processor for solving linear system of equations. The International Conference on Parallel and Distributed Techniques and Applications, Editor: H.R. Arabnia, p.1229--1235, CSREA, July 1998.

    In this paper, parallel algorithm and application- specific array processors using division-free Gaussian elimination method are introduced. It is shown that the number of processing elements of initial design of array processor can be reduced on 2/3 by using pipelining approach. This approach is based on unlinear scheduling of computations.

  10. Gu, Q.P. and Peng, S., Cluster fault tolerant routing in hypercubes. The 1998 International Conference on Parallel Processing, p.148--155, Penn. State University, IEEE Computer Society, Aug. 1998.

  11. Sedukhin, S. and Peng, S., A model for cluster of computers. The IASTED International Conference on Parallel and Distributed Computing and Networks p.154--159, IASTED, ACTA Press, Dec. 1998.

  12. Gu, Q.P. and Peng, S., Efficient broadcasting algorithms with faulty nodes. The IASTED International Conference on Parallel and Distributed Computing and Networks, p.25--30, IASTED, ACTA Press, Dec. 1998.

  13. Gu, Q.P. and Peng, S., Routing in hypercubes with large number of faulty nodes. The 1998 International Conference on Parallel and Distributed Systems, p.718--724, National Cheng Kung University, IEEE Computer Society, Dec. 1998.

Books

  1. N. Mirenkov and A.Vazhenin. Aizu International Student Forum-Contest on Multimedia. University of Aizu, Aizu-Wakamatsu, Japan, 1998.

Grants

  1. Shietung Peng., Ministry of Education Scientific Research Fund, Basic Research (C), Computer Software, Parallel Processing, Thesis No. 10680362, 1998.

Academic Activities

  1. Nikolay N. Mirenkov., Member of the Program Committee of the ISPAN-99, Australia. University of Perth, 1998/99,

  2. Member of the Program Committee of the International Conferences on Parallel and Distributed Processing Techniques and Applications: CSREA, (1) (PDPTA-98), July 13-16, 1998, Las Vegas, Nevada, USA (2) (PDPTA-99), June 28-July 1, 1999, Las Vegas, Nevada, USA

  3. Nikolay N. Mirenkov., Chair of the First and Second Aizu International Student Forum-Contest on Multimedia (1998/99), University of Aizu, Aizu-Wakamatsu, Japan.

  4. Nikolay N. Mirenkov., Member of the Program Committee of the SMI-99, University of Aizu, 1998/99, Japan.

  5. Nikolay N. Mirenkov., Member of the Program Committee of the PaCT99, Russia. Russian Academy of Sciences, 1998/99.

  6. Nikolay N. Mirenkov., Member of Editorial Board of the Journal Scientific programming, John Wiley Publisher, USA. 1998.

  7. Nikolay N. Mirenkov., Member of the IFIP Working Group 10.3 (Concurrent Systems), 1998.

  8. Nikolay N. Mirenkov., Member of ACM, IEEE and The New York Academy of Sciences. 1998.

  9. Nikolay N. Mirenkov., Co-chair of the 6-th International Conference on Distributed Multimedia Systems (DMS'99), University of Aizu, Aizu-Wakamatsu, Japan. 1998/99.

  10. Stanislav G. Sedukhin., Member of the Editorial Board of the International Journal Parallel Processing Letters, World Scientific Publ. (1991.9- ).

  11. Stanislav G. Sedukhin., Member of the Program Committee of the International Conferences on Parallel and Distributed Processing Techniques and Applications: (1) (PDPTA-98), July 13-16, 1998, Las Vegas, Nevada, USA (2) (PDPTA-99), June 28-July 1, 1999, Las Vegas, Nevada, USA 1998/99.

  12. Stanislav G. Sedukhin., Section Chair of the Second IASTED International Conference on Parallel and Distributed Computing and Networks, IASTED, Dec. 1998, Australia.

  13. Stanislav G. Sedukhin., Member of the (1) IEEE and IEEE Computer Society, (1994 - ) (2) ACM (1994 - ) (3) SIAM (1995 - ) (4) AMS (1996 - )

Others

  1. Itabashi, K., Filmification of Methods: A New Document Layout System. Univ. of Aizu, 1998. Thesis Advisor: N. Mirenkov.

  2. Itou, T., Filmification of Methods: Computation on Stacks and Queues. Univ. of Aizu, 1998, Thesis Advisor: N. Mirenkov.

  3. Kikuchi, K., Filmification of Methods: Computation on Pyramids. Univ. of Aizu, 1998, Thesis Advisor: N. Mirenkov.

  4. Nishiashitani, K., A Film Language for Observation Systems. Univ. of Aizu, 1998, Thesis Advisor: N. Mirenkov.

  5. Tomohiko Saitoh., Architectural Design of Array Processors for Deconvolution. Univ. of Aizu, 1998, Thesis Advisor: S. Sedukhin.

  6. Tarou Nakashima., Experimental Web-site for Computing Based Traning. Univ. of Aizu, 1998, Thesis Advisor: S. Sedukhin.

  7. Takao Morita., Architectural Design of Array Processors for Cconvolution. Univ. of Aizu, 1998, Thesis Advisor: S. Sedukhin.

  8. Hiroaki Takeyama., Experimental Web-site for Geographical Data. Univ. of Aizu, 1998, Thesis Advisor: S. Sedukhin.

  9. Kikuchi, Y., Client/Server Modeling with Java. Univ. of Aizu, 1998, Thesis Advisor: S. Peng.

  10. Koyama, T., Computer Assisted Animation using Java. Univ. of Aizu, 1998, Thesis Advisor: S. Peng.



Next: Computer Networks Laboratory Up: Software Department Previous: Foundation of Computer Science Lab


www@u-aizu.ac.jp
October 1999