1、云计算技术与架构前瞻,Presented by: Fubo Zhang,云计算的市场前景 云计算的现状 云计算的技术、架构发展趋势,内容提要,3,1979: CFD Contributions to the 767,4,2005: CFD Contributions to the 787,Gartner View of Private Cloud Market,可升级的,共享,自动化,弹性计算,451 Group View of the Cloud Market,管理,自动化,安全,存储,Forrester View on Cloud Computing Platforms,云计算实现的3 条
2、路径,Time,Scope of sharing,2003,2015,2009,Client/Server Silos,Public & Private Cloud,9,公共云 - What do we believe?,ESX,Virtual Machine,Virtual Machine,Virtual Machine,Virtual Machine,Virtual Machine,Virtual Machine,物理机,PC cloud,手机 移动上网 3G,上网机 Internet 接入上网,Workstation VIP 接入,10,虚拟机,公共云 - What do I belie
3、ve?,11,PC cloud 上网笔记本等终端设备 台式电脑、笔记本将会被淘汰 虚拟PC服务运营商将会替代MS和google Data Bank 解决数据、信息安全的最终解决方案 衍生许多种数据服务, 比如医疗健康,个人企业信用征询,个人数据银行 Many SPs PC SP Storage SP Game SP Many SAAS SPs Many other SPs,Platform ISF,HPC Apps,Test & Dev,Analytics,LSF, Symphony, ,LSF, Symphony, ,Private cloud management software,私有云
4、,Java,JBoss, Tomcat, ,数据中心体系很复杂, 系统的维护和管理难度大IT成本高,资源占用多,配置峰值资源需求 = 浪费资源系统稳定性、可靠性低。人工服务为主,高成本、低满意度IT传统模式不能适应业务部署速度的需求 (至少2个月),地理上分布的用户,根据应用静态分配IT资源,Supply and Demand Not Aligned,今天IDC 数据中心的挑战,云计算(虚拟化)带来的好处,资源虚拟化,从而实现全局共享 节省投资 SOA 框架使得IT能对业务需求提供快速部署, 时间从原来的几个月缩短到半天 提高了业务支撑能力 一体化管理打破了原来IT烟囱式业务系统管理,使得系统
5、维护人员的效率大大提高 运维效率提高 消除单点故障造成的稳定、可靠性问题 提高系统稳定性和可靠性 帮助IT投资风险和决策 Smart IT 节能减排 绿色IT,实现云计算(虚拟化)的困难,没有成熟的产品和方案让运营商有直观的理解。 各个厂商都在推、强调自己的云计算概念和产品,像盲人摸象,无法让用户有个全局的认识。 现有IT系统的改动成本和风险 传统业务系统虚拟化改造 少有成功案例可以借鉴 组织管理和人们的认识需要提高,Platform在实现云计算方面的优势,Platform已经有了自己的云计算产品ISF - IAAS Platform的云计算产品是建立在许多用户的需求上的, 如 JP Morg
6、en, CityBank, Amazon, Alatum 我们帮助用户实现小步快跑的策略, 降低IT系统的改动成本和风险 我们本地有近200名研发团队来协助用户的业务系统虚拟化改造 Platform已有几个云计算成功案例 Platform可提供业务培训和成功用户案例考察,Java Cloud: Fortune 500 FS Companies,App Server,App 1,烟囱式的业务系统导致了系统部署时间长,资源利用率低下,IT管理维护成本高,Virtual Servers,Self-Service Portal,100s Java 应用软件运行在1000s UNIX SMP 服务器,A
7、pp Server,App 2,App Server,App N,App 1,App 2,App N,挑战,环境,SaaS Cloud: Fetch Technologies,Platform ISF,CUST A,CUST B,CUST C,CUST X,由于手动部署业务系统,无法满足日益增长的业务需求 简单的用户系统配置的改变,需要几个小时乃至几天,200 virtual servers in production and test/dev using VMware,环境,挑战,IaaS Cloud: SingTel,在人工操作的方式下, 管理和维护出租的计算机、计算用户使用情况和计费非常
8、的不方便,Xen, VMware, Hyper-V, and physical blades on 2,400 cores providing public cloud services,挑战,环境,HPC Cloud: CERN,系统无法为用户提供灵活的资源配置,需要等待很长的时间,RHEL, KVM, Xen, Hyper-V for widely diverse set of scientific applications on x86 commodity boxes,挑战,利用私有云的技术Platform ISF自动管理和部署系统,在固有的资源上, 开发了更多的服务项目; 对一些应用系
9、统的运行效率提高了一倍多 降低成本, 提高资源利用率 通过自动化管理, 降低了维护费用,解决方案,Benefits,环境,3 个层次的云计算服务,2019/3/9,21,Each level provides a higher level of service abstraction & may use lower level(s),云计算体系架构,服务调度和管理引擎,云计算平台VM中间构建,IAAS 调度分配引擎,资源池,IAAS,服务管理,SAAS,PAAS,服务系统,IAAS 服务平台,服务应用系统,云计算门户,IDC 服务,Placement Engine Policy,3/9/201
10、9,23,Placement Engine,1) Application Topology,DB,App Server,App Server,App Server,Web Server,Web Server,2) Resource Hierarchy,3) Network Access Cost Matrix (Available Bandwidth / Dynamic Utilization),DC,Rack Group,Rack Group,Rack Group,Rack,Rack,Tier 1,Tier 2,Tier 3,Rack,Rack,Rack,Rack,Output:Initia
11、l Placement - Run-Time Management - Defragmentations& Migration,DC,/,4) Previous reservations committed & Account Quotas,5) C-language plug-in placement policy: vem_policy_init() vem_policy_fin() vem_policy_distribute() vem_policy_place() vem_policy_housekeep() vem_policy_status() vem_policy_info(),
12、基于资源可用状态的分配策略,PTM Framework,Application-Aware 调度,ISF Master,Application Orchestrator,KVM Hypervisor Resource Group,Deploy & Monitor VMs,Monitor,Get historical usage,Grow/Shrink,Vmware Hypervisor Resource Group,Physical Linux Resource Group,Application Performance Manager,ICM,PVMO,PTM,Call ISF or sen
13、d Alert,1,3,2,需求: 动态的调整业务应用对资源的需求改变,而无须修改应用的中间件 输入: 系统负载参数(cpu, mem) 集成的应用软件效率管理系统 需求的调度策略,Add custom attributes about hosts from 3rd party tools via API Attributes can be used in scheduling & placement policies Useful to organize hosts by location, energy efficiency, model types, lease dates Suppor
14、ts both static and dynamic attribute updates,资产管理与监控,Asset DB,Resource Updater,Monitoring DB,ISF,CMDB,API,资源使用数据用来做计费和能力规划,Rate Definition,Usage DataReserved Amount & TimeOn-Demand Amount & TimeCPU UsageMem UsageBy AccountBy Application DefBy UserBy Resource Group,Platform ISF,HPC Application,Report
15、ing App,JBOSS App,External Billing System,Other Data,存储的集成,10G,10TB,Storage Containers,5G,100G,5TB,20TB,2G,10G,Storage Adaptor,ISF Master,25G,50G,适配器来发现存储的内容和生成存储的资源池 用户使用存储资源就如同使用一个服务的定义 系统可以预约存储资源 系统启动适配器来生成存储的分配空间 工作流和后置配置步骤用来连接存储服务器,Storage Manager APIs (EMC, NetApp),High Performance,Mid-range s
16、torage,Low-end storage,网络集成,企业私有云,West Coast Data Center,East Coast Data Center,Europe Data Center,ISF Market Place Broker,Enterprise Messaging Infrastructure / JMS,Enterprise DB Infrastructure,Remote Proxy,Leverage EGO capabilities to distribute ISF services across multiple nodes and provide centra
17、lized monitoring, troubleshooting, and HA,Application,End-User,Cloud Admin,ISF Master Node,P-VMO,Portal,ICM,CES,App Manager,Blad eLogic,VMware,Amazon,Tivoli,xCAT,ISF Master Node,P-VMO,Portal,ICM,CES,Blad eLogic,VMware,Citrix,RedHat,Opsware,xCAT,VMware,xCAT,Nagios,Remote Proxy,VMware,xCAT,Nagios,Plat
18、form Computing, Inc.,The leader in cluster, grid and cloud management software: 17 years of profitable growth 2,000 of the worlds most demanding client organizations 5,000,000 CPUs under management 500 professionals working across 13 global centers Many Strategic relationships including Dell, Intel, Microsoft, Red Hat and SAS,Platform Clusters, Grids, Clouds, Whatever Computing,Platform Product Portfolio,Thank ,