oscar4.2-quick_install

How to Install an OSCAR Cluster Quick Start Install Guide Software Version 4.2 Documentation Version 4.2 http://oscar.sourceforge.net/ oscar-users@lists.sourceforge.net The Open Cluster Group http://www.openclustergroup.org/ October 28, 2005 1 Contents 1 Introduction 4 1.1 Latest Documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.2 Terminology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.3 Supported Distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.4 Minimum System Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.5 Document Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 2 Downloading an OSCAR Distribution Package 6 3 Release Notes 6 3.1 Release Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 3.2 Notes for All Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 3.3 Red Hat Enterprise Linux 4 & Fedora Core 3 SELinux Conflict . . . . . . . . . . . . . . . 9 3.4 Red Hat Enterprise Linux 4 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 3.5 CentOS 4 ia64 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 3.6 Red Hat Enterprise Linux 3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 3.7 Mandriva Linux (previously known as ”Mandrake Linux”) Notes . . . . . . . . . . . . . . . 10 3.8 Fedora Core 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 4 Quick Cluster Installation Procedure 12 4.1 Server Installation and Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 4.1.1 Install Linux on the server machine . . . . . . . . . . . . . . . . . . . . . . . . . . 12 4.1.2 Disk space and directory considerations . . . . . . . . . . . . . . . . . . . . . . . . 12 4.1.3 Download a copy of OSCAR and unpack on the server . . . . . . . . . . . . . . . . 12 4.1.4 Configure and Install OSCAR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 4.1.5 Configure the ethernet adapter for the cluster . . . . . . . . . . . . . . . . . . . . . 13 4.1.6 Copy distribution installation RPMs to /tftpboot/rpm . . . . . . . . . . . . . . 14 4.2 Launching the OSCAR Installer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 4.3 Downloading Additional OSCAR Packages . . . . . . . . . . . . . . . . . . . . . . . . . . 14 4.4 Selecting Packages to Install . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 4.5 Configuring OSCAR Packages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 4.5.1 Selecting a Default MPI Implementation . . . . . . . . . . . . . . . . . . . . . . . 15 4.6 Install OSCAR Server Packages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 4.7 Build OSCAR Client Image . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 4.8 Define OSCAR Clients . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 4.9 Setup Networking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 4.10 Monitor Cluster Deployment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 4.11 Client Installations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 4.11.1 Network boot the client nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 4.11.2 Check completion status of nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 4.11.3 Reboot the client nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 4.12 Complete the Cluster Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 4.13 Test Cluster Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 4.14 Congratulations! . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 4.15 Adding and Deleting client nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 4.15.1 Adding OSCAR clients . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 2 4.15.2 Deleting clients . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 4.16 Install/Uninstall OSCAR Packages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 4.16.1 Selecting the Right Package . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 4.16.2 Single Image Restriction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 4.16.3 Failures to Install and Uninstall . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 4.16.4 More Debugging Info . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 4.17 Starting over – installing OSCAR again . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 3 1 Introduction OSCAR version 4.2 is a snapshot of the best known methods for building, programming, and using clusters. It consists of a fully integrated and easy to install software bundle designed for high performance cluster computing (HPC). Everything needed to install, build, maintain, and use a modest sized Linux cluster is included in the suite, making it unnecessary to download or even install any individual software packages on your cluster. OSCAR is the first project by the Open Cluster Group. For more information on the group and its projects, visit its website http://www.OpenClusterGroup.org/. This document provides a step-by-step installation guide for system administrators, as well as a detailed explanation of what is happening as you install. Note that this installation guide is specific to OSCAR version 4.2. 1.1 Latest Documentation Please be sure that you have the latest version of this document. It is possible (and probable!) that newer versions of this document were released on the main OSCAR web site after the software was released. You are strongly encouraged to check http://oscar.sourceforge.net/ for the latest version of these instructions before proceeding. Document versions can be compared by checking their version number and date on the cover page. 1.2 Terminology A common term used in this document is cluster, which refers to a group of individual computers bundled together using hardware and software in order to make them work as a single machine. Each individual machine of a cluster is referred to as a node. Within the OSCAR cluster to be installed, there are two types of nodes: server and client. A server node is responsible for servicing the requests of client nodes. A client node is dedicated to computation. An OSCAR cluster consists of one server node and one or more client nodes, where all the client nodes [currently] must have homogeneous hardware. The software contained within OSCAR does support doing multiple cluster installs from the same server, but that process is outside the scope of this guide. An OSCAR package is a set of files that is used to install a software package in an OSCAR cluster. An OSCAR package can be as simple as a single RPM file, or it can be more complex, perhaps including a mixture of RPM and other auxiliary configuration / installation files. OSCAR packages provide the majority of functionality in OSCAR clusters. OSCAR packages fall into one of three categories: • Core packages are required for the operation of OSCAR itself (mostly involved with the installer). • Included packages are shipped in the official OSCAR distribution. These are usually authored and/or packaged by OSCAR developers, and have some degree of official testing before release. • Third party packages are not included in the official OSCAR distribution; they are “add-ons” that can be unpacked in the OSCAR tree, and therefore installed using the OSCAR installation framework. 1.3 Supported Distributions OSCAR has been tested to work with several distributions. Table 1 lists each distribution and version and specifies the level of support for each. In order to ensure a successful installation, most users should stick to a distribution that is listed as Fully supported. 4 Administrator 高亮 Distribution and Release Architecture Status Red Hat Enterprise Linux 3 x86 Fully supported Red Hat Enterprise Linux 3 x86 64 Fully supported Red Hat Enterprise Linux 3 ia64 Fully supported Red Hat Enterprise Linux 4 x86 Fully supported Red Hat Enterprise Linux 4 x86 64 Fully supported Red Hat Enterprise Linux 4 ia64 Fully supported Fedora Core 2 x86 Fully supported Fedora Core 3 x86 Fully supported Mandriva Linux 10.0 x86 Fully supported Mandriva Linux 10.1 x86 Fully supported Table 1: OSCAR supported distributions Clones of supported distributions, especially open source rebuilds of RedHat Enterprise Linux such as CentOS and Scientific Linux, should work but are not officially tested. See the release notes (Section 3) for your distribution for known issues. 1.4 Minimum System Requirements The following is a list of minimum system requirements for the OSCAR server node: • CPU of i586 or above • A network interface card that supports a TCP/IP stack • If your OSCAR server node is going to be the router between a public network and the cluster nodes, you will need a second network interface card that supports a TCP/IP stack • At least 4GB total free space – 2GB under / and 2GB under /var • An installed version of Linux, preferably a Fully supported distribution from Table 1 The following is a list of minimum system requirements for the OSCAR client nodes: • CPU of i586 or above • A disk on each client node, at least 2GB in size (OSCAR will format the disks during the installation) • A network interface card that supports a TCP/IP stack1 • Same Linux distribution and version as the server node • All clients must have the same architecture (e.g., ia32 vs. ia64) • Monitors and keyboards may be helpful, but are not required • Floppy or PXE enabled BIOS 1Beware of certain models of 3COM cards – not all models of 3COM cards are supported by the installation Linux kernel that is shipped with OSCAR. See the OSCAR web site for more information. 5 1.5 Document Organization Due to the complicated nature of putting together a high-performance cluster, it is strongly suggested that even experienced administrators read this document through, without skipping any sections, and then use the detailed installation procedure to install your OSCAR cluster. Novice users will be comforted to know that anyone who has installed and used Linux can successfully navigate through the OSCAR cluster install. The rest of this document is organized as follows. First, Section 2 tells how to obtain an OSCAR version 4.2 distribution package. Next, the “Release Notes” section (Section 3) that applies to OSCAR version 4.2 contains some requirements and update issues that need to be resolved before the install. Section 4 details the cluster installation procedure (the level of detail lies somewhere between “the install will now update some files” and “the install will now replace the string ‘xyz’ with ‘abc’ in file some file.”) More information is available on the OSCAR web site and archives of the various OSCAR mailing lists. If you have a question that cannot be answered by this document (including answers to common installation problems), be sure to visit the OSCAR web site: http://oscar.sourceforge.net/ 2 Downloading an OSCAR Distribution Package The OSCAR distribution packages can be downloaded from: http://oscar.sourceforge.net/ Note that there are actually three flavors of distribution packages for OSCAR, depending on your band- width and installation/development needs: 1. “Regular”: All the OSCAR installation material that most users need to install and operate an OSCAR cluster. 2. “Extra Crispy”: Same as Regular, except that the SRPMs for most of the RPMs in OSCAR are also included. SRPMs are not required for installation or normal operation of an OSCAR cluster. This distribution package is significantly larger than Regular, and is not necessary for most users – only those who are interested in source RPMs need the Extra Crispy distribution. The SRPMs can be found under packages/*/SRPMS/ directories. 3. “Secret Sauce”: This distribution contains only the SRPMs for RPMs in OSCAR in the Regular and Extra Crispy distributions (it’s essentially (Extra Crispy - Regular)). It is intended only for those who initially downloaded the Regular distribution and later decided that they wanted the SRPMs as well. The Secret Sauce distribution is intended to be expanded over your Regular installation – it will create packages/*/SRPMS/ directories and populate them with the relevant .src.rpm files. All three distributions can be downloaded from the main OSCAR web page. 3 Release Notes The following release notes apply to OSCAR version 4.2. 6 3.1 Release Features • x86 64 support for Red Hat Enterprise Linux 3 & 4, • Fedora Core 3, Red Hat Enterprise Linux 4 and Mandriva Linux 10.1 support • New feature! “Monitor Cluster Deployment” in Wizard • Ganglia updated to v3.0.1 • PVM updated to v3.4.5+4 • Torque updated to v1.2.0p5 • SystemImager updated to v3.5.3 • MPICH updated to v1.2.7 • AutoInstallFloppy changed to AutoInstallCD due to large kernel images. • Replaced tftp-server with atftp-server for better scalability • Software RAIDs on cluster nodes are now supported 3.2 Notes for All Systems • The OSCAR installer GUI provides little protection for user mistakes. If the user executes steps out of order, or provides erroneous input, Bad Things may happen. Users are strongly encouraged to closely follow the instructions provided in this document. • Each package in OSCAR has its own installation and release notes. See the full Installation Guide for these notes. • All nodes must have a hostname other than “localhost” that does not contain any underscores (“ ”) or periods “.”. Some distributions complicate this by putting a line such as as the following in /etc/hosts: 127.0.0.1 localhost.localdomain localhost yourhostname.yourdomain yourhostname If this occurs the file should be separated as follows: 127.0.0.1 localhost.localdomain localhost 192.168.0.1 yourhostname.yourdomain yourhostname • A domain name must be specified for the client nodes when defining them. • Although OSCAR can be installed on pre-existing server nodes, it is typically easiest to use a machine that has a new, fresh install of a distribution listed in Table 1 with no updates installed. If the updates are installed, there may be conflicts in RPM requirements. It is recommended to install Red Hat updates after the initial OSCAR installation has completed. 7 • The “Development Tools” packages for are not default packages in all distributions and are required for installation. • The following benign warning messages will appear multiple times during the OSCAR installation process: awk: cmd. line:2: fatal: cannot open file ‘/etc/fstab’ for reading (No such file or directory) rsync_stub_dir: no such variable at ... Use of uninitialized value in pattern match (m//) at /usr/lib/perl5/site_perl/oda.pm ... It is safe to ignore these messages. • The OSCAR installer will install the MySQL package on the server node if it is not already installed. A random password will be automatically generated for the oscar user to access the oscar database. This password will be stored in the file /etc/odapw. It should not be needed by other users. • The OSCAR installer GUI currently does not support deleting a node and adding the same node back in the same session. If you wish to delete a node and then add it back, you must delete the node, close the OSCAR installer GUI, launch the OSCAR installer GUI again, and then add the node. • If ssh produces warnings when logging into the compute nodes from the OSCAR head node, the C3 tools (e.g., cexec) may experience difficulties. For example, if you use ssh to login in to the OSCAR head node from a terminal that does not support X windows and then try to run cexec, you might see a warning message in the cexec output: Warning: No xauth data; using fake authentication data for X11 forwarding. Although this is only a warning message from ssh, cexec may interpret it as a fatal error, and not run across all cluster nodes properly (e.g., the button will likely not work properly). Note that this is actually an ssh problem, not a C3 problem. As such, you need to eliminate any warning messages from ssh (more specifically, eliminate any output from stderr). In the example above, you can tell the C3 tools to use the “-x” switch to ssh in order to disable X forwarding: # export C3_RSH=’ssh -x’ # cexec uptime The warnings about xauth should no longer appear (and the button should work properly). • The SIS multicast facility (Flamethrower) is “experimentally” supported. If you are having problems with multicast and would like to experiment please check the oscar-users and/or sisuite-users mailing lists for tips. 8 • Due to some distribution portability issues, OSCAR currently installs a “compatibility” (python2- -compat-1.0-1) RPM to resolve the Python2 prerequisite that is slightly different across different Linux distributions. Also see the file packages/c3/RPMS/NOTE.python2. • FutureWarning message during APItests on Python2.3 based systems. The following is a warning message about the for the version of TwistedMatrix used by the APItest tool. It is only a warning and can be ignored. Running Installation tests for pvm /usr/lib/python2.3/site-packages/twisted/internet/defer.py:398: FutureWarning: hex()/oct() of negative int will return a signed string in Python 2.4 and up return "<%s at %s>" % (cname, hex(id(self))) • In some cases, the test window that is opened from the OSCAR wizard may close suddenly when there is a test failure. If this happens, run the test script, testing/test cluster, manually in a shell window to diagnose the problem. 3.3 Red Hat Enterprise Linux 4 & Fedora Core 3 SELinux Conflict • Due to issues with displaying graphs under Ganglia, and installing RPMs in a chroot environment (needed to build OSCAR images), SELinux should be disabled before installing OSCAR. During installation, it can be deactivated on the same screen as the firewall. If it is currently active it can be turned off in /etc/selinux/config by setting SELINUX to “disabled” and rebooting. 3.4 Red Hat Enterprise Linux 4 • On x86 systems using Red Hat Enterprise Linux 4, the pfilter package causes image deployment to freeze midway through, so it is necessary to uncheck the pfilter package during Step 1 or turn it off prior to network booting the nodes defined in Step 5 . • On ia64 systems using Red Hat Enterprise Linux 4, it may be possible that proc remains mounted on the image after it has been built; this causes subsequent compute node installations (rsync) to fail. To get around this problem, you need to umount the directory manually after image has been created and before installing the compute nodes. First, find out what is mounted by looking in /proc/mounts with # cat /proc/mounts It should list something like the following: proc /var/lib/systemimager/images/oscarimage/proc proc rw,nodiratime 0 0 none /var/lib/systemimager/images/oscarimage/proc/sys/fs/binfmt_misc binfmt_misc rw 0 0 Then umount the two directories that are mounted, e.g., 9 # umount -f /var/lib/systemimager/images/oscarimage/proc/sys/fs/binfmt_misc # umount -f /var/lib/systemimager/images/oscarimage/proc" Note the ordering of the umount commands is important. • On ia64 systems using Red Hat Enterprise Linux 4, the ia32el.rpm is needed. This rpm is located on the extra

本文档为【oscar4.2-quick_install】，请使用软件OFFICE或WPS软件打开。作品中的文字与图均可以修改和编辑， 图片更改请在作品中右键图片并更换，文字修改请直接点击文字进行修改，也可以新增和删除文档中的内容。
该文档来自用户分享，如有侵权行为请发邮件ishare@vip.sina.com联系网站客服，我们会及时删除。
[版权声明] 本站所有资料为用户分享产生，若发现您的权利被侵害，请联系客服邮件isharekefu@iask.cn，我们尽快处理。
本作品所展示的图片、画像、字体、音乐的版权可能需版权方额外授权，请谨慎使用。
网站提供的党政主题相关内容(国旗、国徽、党徽..)目的在于配合国家政策宣传，仅限个人学习分享使用，禁止用于任何广告和商用目的。

下载需要： 免费 已有0 人下载

立即下载

你可能还喜欢

• 浙江师范大学2004年度国家奖学金
• 岛津高效液相色谱仪工作站 lcsolution安装说明书道
• 2021年医院感染科工作总结 院感工作总结
• 03J930-1图集
• 手术分统计表
• 第12章磁介质中的磁场
• 能量功及热量单位换算表
• 帐外物资处理办法
• 自学考试专题金融理论与实务小抄笔记
• 香港公司法说明
• 高中语文学习方法总结
• 河北7市市长大调整（石家庄市委履新）
• 分店每日主要工作项目时间管制表大润发
• 校本课程折纸教案
• [高效]八字五行特征
• 十一国庆节演讲稿范文格式
• 大一 新职业英语 课后答案
• 大一 新职业英语 课后答案
• 大一 新职业英语 课后答案
• 大一 新职业英语 课后答案

最新资料

资料动态

专题动态

• 安责险政策解读培训
• 【doc】中小跨度桥梁的新成员—SRC梁桥
• [Word]★【谈心时填写,支部会用】班子成员相互批评意见(庆丰村)
• 霍去病石雕教案
• 无机化学(周祖新)习题解答 第四章
• 日本园试营养液配方计算表格
• 公路桥梁交工验收桥梁工程实体检测
• 自己真了不起
• 科研伦理与学术规范习题(1)
• 1200字作文纸
• 园中同行歌(钢琴谱)-简谱-吉他谱-钢琴谱-电子琴谱-手风琴谱-二胡谱-笛萧谱-萨克斯谱-古筝谱
• 提升SMT制造能力改善案例总结
• 学校基本情况
• 常见三角瓶规格尺寸
• 安责险政策解读培训
• 【doc】中小跨度桥梁的新成员—SRC梁桥
• [Word]★【谈心时填写,支部会用】班子成员相互批评意见(庆丰村)
• 霍去病石雕教案
• 无机化学(周祖新)习题解答 第四章
• 日本园试营养液配方计算表格
• 公路桥梁交工验收桥梁工程实体检测
• 自己真了不起
• 科研伦理与学术规范习题(1)
• 1200字作文纸
• 园中同行歌(钢琴谱)-简谱-吉他谱-钢琴谱-电子琴谱-手风琴谱-二胡谱-笛萧谱-萨克斯谱-古筝谱
• 提升SMT制造能力改善案例总结
• 学校基本情况
• 常见三角瓶规格尺寸

• 液碱的理化性质
• 电大机械制图第2次形考任务答案
• 吊车行车记录本
• 流感防控知识(2021)
• 六一儿童节歌曲：小牛牛放牛牛
• 单螺杆式油气混输泵工作原理及特点
• 信息学院第四届田径运动会秩序册（新）
• 我和倩姐
• 2012年注会-公司战略与风险管理-第03章课后作业
• 酒店工程部弱电岗位职责3篇
• 产业沼气工程平台建设项目沼气工程初步设计说明书
• 大连海洋大学进一步加强课程建设实施方案
• 2020高考英语新增分方案大一轮人教新课改省份专用精练：选修6Unit2课下作业(一_三)含答案
• 中国民航发展史试卷及答案
• 有限空间作业安全责任制度
• 百家论坛-解读中医
• 公共场所卫生许可证注销公告
• 逐桩坐标计算表
• 船舶稳性计算(中)
• 喷塑件表面划伤如何修复
• 幼儿园网络安全管理制度

• 3c认证产品目录
• 优人一等的心阅读题答案
• 生物质锅炉技术现状与存在问题
• 路上有个小土坑PPT优秀课件
• 集体合同协商主持词
• 烟酒领用的相关规定
• 小学冬季常见传染病预防知识主题班会-ppt课件
• 2018-2022年吉林省长春市近五年中考物理试卷及答案
• 导游年终工作自我总结
• 10#-—20#无缝钢管常用规格理论重量表
• 常用的后台万能登陆密码
• 林如高简介
• 《乡愁》说课稿1
• 山东省高程DEM等高线下载(百度网盘下载)
• 3c认证产品目录
• 优人一等的心阅读题答案
• 生物质锅炉技术现状与存在问题
• 路上有个小土坑PPT优秀课件
• 集体合同协商主持词
• 烟酒领用的相关规定
• 小学冬季常见传染病预防知识主题班会-ppt课件
• 2018-2022年吉林省长春市近五年中考物理试卷及答案
• 导游年终工作自我总结
• 10#-—20#无缝钢管常用规格理论重量表
• 常用的后台万能登陆密码
• 林如高简介
• 《乡愁》说课稿1
• 山东省高程DEM等高线下载(百度网盘下载)

is_266192

暂无简介~

格式：pdf

大小：290KB

软件：PDF阅读器

页数：0

分类：工学

上传时间：2011-05-13

浏览量：4

相关资料

• 脑血管造影术后护理的研究进展【最新】
• 计算机网络实验四__交换机基本配置实验(4.1交换机的登录与基本配置_4.2交换机的远程登录_4.3_VLAN的划分)
• 重庆市巴蜀中学初二上期八年级期末考试英语试题卷
• 后现代主义对中国当代文学的影响
• 关于BUFFALO NAS管理员admin的更改
• 机械制图习题集(重庆大学出版社)丁一第三章xingai答案
• 日语综合模拟试题27
• 多联机中央空调维护保养方案(最新最全含报价)
• 生产部管理制度15篇
• 2012年各县(区)农机跨区作业(水稻)市场信息统计表
• 启示_五年级记叙文作文500字
• CPE白炭黑共混改性研究
• 山东安全技术交底 全
• 燕山大学 信息科学与工程学院硕士研究生毕业发表学术论文规定
• 农民工工伤保险费计算公式(北京)
• 土地整理工程施工设计方案教材
• 中央空调清洗报价单
• 雨_五年级记叙文作文300字
• 保安全安监局长的社会责任——访韶关南雄市安全监管局局长李新仁
• 药品生产企业检查记录表

热点搜索

MCNP_5A程序使用说明书 中班数学：按物体特征分类 住房和城乡建设局职能配置、内设机构和人员编制规定 红岩第29章内容概括 学生个人考试成绩分析表 青海柴达木枸杞与宁夏枸杞比较 生命之花作文【初中初二700字】_1 山东人民版品德教案第一单元爱在身边 质量保证体系调查表(1) 压力表的培训教材课件 DP-Pro Ocean V3.0用户手册 99乘法表 matlab编程 同等学力英语(第六版)考试大纲及样卷 拟增设诊疗科目人员名录 MCNP_5A程序使用说明书 中班数学：按物体特征分类 住房和城乡建设局职能配置、内设机构和人员编制规定 红岩第29章内容概括 学生个人考试成绩分析表 青海柴达木枸杞与宁夏枸杞比较 生命之花作文【初中初二700字】_1 山东人民版品德教案第一单元爱在身边 质量保证体系调查表(1) 压力表的培训教材课件 DP-Pro Ocean V3.0用户手册 99乘法表 matlab编程 同等学力英语(第六版)考试大纲及样卷 拟增设诊疗科目人员名录

资料大全 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z 0-9

专题大全 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z 0-9

网站声明 | 侵权处理 | 投诉反馈 | 帮助中心 | 网站地图 | 爱问办公

京ICP证000007-6 爱问文库-Copyright © 2024 版权所有

浙公网安备 33021202002483

客服热线：0755-26904047

工作日：9:00-18:00

在线客服

• 

  关注爱问文库服务号